-- Logs begin at Wed 2022-08-03 12:08:43 UTC, end at Wed 2022-08-03 13:09:40 UTC. -- Aug 03 12:37:06.630248 dv-cinder-850836-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 03 12:37:06.643205 dv-cinder-850836-4-smb devstack@keystone.service[91779]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 03 12:37:06.643205 dv-cinder-850836-4-smb devstack@keystone.service[91779]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 3 12:37:06 2022] *** Aug 03 12:37:06.643205 dv-cinder-850836-4-smb devstack@keystone.service[91779]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 03 12:37:06.643205 dv-cinder-850836-4-smb devstack@keystone.service[91779]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 03 12:37:06.643205 dv-cinder-850836-4-smb devstack@keystone.service[91779]: nodename: dv-cinder-850836-4-smb Aug 03 12:37:06.643205 dv-cinder-850836-4-smb devstack@keystone.service[91779]: machine: x86_64 Aug 03 12:37:06.643205 dv-cinder-850836-4-smb devstack@keystone.service[91779]: clock source: unix Aug 03 12:37:06.643205 dv-cinder-850836-4-smb devstack@keystone.service[91779]: pcre jit disabled Aug 03 12:37:06.643205 dv-cinder-850836-4-smb devstack@keystone.service[91779]: detected number of CPU cores: 4 Aug 03 12:37:06.643205 dv-cinder-850836-4-smb devstack@keystone.service[91779]: current working directory: / Aug 03 12:37:06.643205 dv-cinder-850836-4-smb devstack@keystone.service[91779]: detected binary path: /usr/bin/uwsgi-core Aug 03 12:37:06.643205 dv-cinder-850836-4-smb devstack@keystone.service[91779]: your processes number limit is 47680 Aug 03 12:37:06.643205 dv-cinder-850836-4-smb devstack@keystone.service[91779]: your memory page size is 4096 bytes Aug 03 12:37:06.643205 dv-cinder-850836-4-smb devstack@keystone.service[91779]: detected max file descriptor number: 2048 Aug 03 12:37:06.643205 dv-cinder-850836-4-smb devstack@keystone.service[91779]: lock engine: pthread robust mutexes Aug 03 12:37:06.643205 dv-cinder-850836-4-smb devstack@keystone.service[91779]: thunder lock: enabled Aug 03 12:37:06.643205 dv-cinder-850836-4-smb devstack@keystone.service[91779]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 03 12:37:06.643205 dv-cinder-850836-4-smb devstack@keystone.service[91779]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 03 12:37:06.680611 dv-cinder-850836-4-smb devstack@keystone.service[91779]: Python main interpreter initialized at 0x55c64ef5c9c0 Aug 03 12:37:06.680611 dv-cinder-850836-4-smb devstack@keystone.service[91779]: python threads support enabled Aug 03 12:37:06.680611 dv-cinder-850836-4-smb devstack@keystone.service[91779]: your server socket listen backlog is limited to 100 connections Aug 03 12:37:06.680611 dv-cinder-850836-4-smb devstack@keystone.service[91779]: your mercy for graceful operations on workers is 90 seconds Aug 03 12:37:06.680939 dv-cinder-850836-4-smb devstack@keystone.service[91779]: mapped 403077 bytes (393 KB) for 2 cores Aug 03 12:37:06.681040 dv-cinder-850836-4-smb devstack@keystone.service[91779]: *** Operational MODE: preforking *** Aug 03 12:37:06.681315 dv-cinder-850836-4-smb devstack@keystone.service[91779]: *** uWSGI is running in multiple interpreter mode *** Aug 03 12:37:06.681315 dv-cinder-850836-4-smb devstack@keystone.service[91779]: spawned uWSGI master process (pid: 91779) Aug 03 12:37:06.681521 dv-cinder-850836-4-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 03 12:37:06.685549 dv-cinder-850836-4-smb devstack@keystone.service[91779]: spawned uWSGI worker 1 (pid: 91788, cores: 1) Aug 03 12:37:06.685549 dv-cinder-850836-4-smb devstack@keystone.service[91779]: spawned uWSGI worker 2 (pid: 91789, cores: 1) Aug 03 12:37:06.685549 dv-cinder-850836-4-smb devstack@keystone.service[91779]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 03 12:37:12.156598 dv-cinder-850836-4-smb devstack@keystone.service[91788]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 12:37:12.156598 dv-cinder-850836-4-smb devstack@keystone.service[91788]: from cryptography.utils import int_from_bytes Aug 03 12:37:12.157421 dv-cinder-850836-4-smb devstack@keystone.service[91789]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 12:37:12.157421 dv-cinder-850836-4-smb devstack@keystone.service[91789]: from cryptography.utils import int_from_bytes Aug 03 12:37:12.157906 dv-cinder-850836-4-smb devstack@keystone.service[91788]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 12:37:12.157906 dv-cinder-850836-4-smb devstack@keystone.service[91788]: from cryptography.utils import int_from_bytes Aug 03 12:37:12.158037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 12:37:12.158037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: from cryptography.utils import int_from_bytes Aug 03 12:37:12.207105 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 12:37:12.207304 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 12:37:12.207398 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 12:37:12.207483 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] command line args: [] {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 12:37:12.207560 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 12:37:12.207730 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] command line args: [] {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 12:37:12.207807 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 12:37:12.207919 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ================================================================================ {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 12:37:12.208002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 12:37:12.208174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ================================================================================ {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 12:37:12.208251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] admin_token = **** {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.208417 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] config_dir = [] {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.208493 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] admin_token = **** {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.208605 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.208688 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] config_dir = [] {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.208785 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] config_source = [] {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.208867 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.208966 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] debug = True {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.209054 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] config_source = [] {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.209166 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.209418 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] debug = True {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.209418 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.209592 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.209663 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.209725 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.209783 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.209974 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.210062 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.210224 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.210309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.210457 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] list_limit = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.210542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] list_limit = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.210637 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] log_config_append = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.210714 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] log_config_append = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.210816 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.210887 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.210982 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] log_dir = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.211052 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] log_dir = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.211145 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] log_file = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.211221 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] log_file = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.211397 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.211504 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.211631 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.211744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.211880 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.212006 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.212142 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.212263 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.212378 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.212469 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.212604 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.212694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.212772 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.212894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.212975 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.213095 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.213175 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.213299 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.213373 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.213485 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.213654 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.213726 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.213832 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.213922 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.214081 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.214158 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.214327 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.214410 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.214602 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.214687 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.215102 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.46/identity {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.215199 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.46/identity {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.215323 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] publish_errors = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.215403 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] publish_errors = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.215523 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.215601 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.215715 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.215799 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.215874 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.215993 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.216122 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.216216 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.216342 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.216416 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.216579 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] standard_threads = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.216665 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] standard_threads = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.216813 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.216896 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.217060 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.217137 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.217232 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.217307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.217407 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] use_journal = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.217511 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] use_journal = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.217595 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] use_json = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.217666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] use_json = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.217763 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] use_stderr = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.217866 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] use_stderr = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.217965 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] use_syslog = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.218050 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] use_syslog = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.218205 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.218281 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 12:37:12.218463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.218543 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.218704 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.218790 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.218965 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.219045 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.219203 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.219278 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.219453 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.219537 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.219693 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.219776 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.219943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.220017 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.220177 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.220269 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.220425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.220500 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.220672 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.220746 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.220919 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.221001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.221155 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.221231 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.221399 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.221475 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.221661 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.221753 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.221909 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.221996 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.222156 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.222239 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.222392 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.222547 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.222647 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.222773 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.222902 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.222976 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.223144 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.223230 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.223383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.223457 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.223633 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.223715 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.223895 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.223982 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.224149 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.224229 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.224395 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.224476 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.224629 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.224711 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.224858 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.224933 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.225090 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.225170 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.225327 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.225415 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.225595 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.225674 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.225843 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.225918 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.226075 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.226153 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.226307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.226381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.226553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.226627 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.226799 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.226883 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.227036 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.227112 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.227285 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.227359 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.227514 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.227591 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.227751 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.227828 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.227988 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.228070 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.228214 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.228290 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.228445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.228527 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.228674 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.228749 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.228906 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.228982 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.229142 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.229223 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.229394 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.229469 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.229647 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.229734 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.229888 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.229970 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.230119 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.230194 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.230357 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.230444 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.230591 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.230667 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.230841 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.230916 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.231074 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.231184 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.231310 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.231419 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.231548 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.231679 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.231787 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.231881 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.232007 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.232087 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.232242 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.232318 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.232471 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.232547 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.232740 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.232824 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.232939 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.233020 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.233179 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.233274 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.233412 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.234093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.234225 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.234309 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.234473 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.234553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.234710 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.234824 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.234965 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.235039 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.235175 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.235292 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.235446 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.235525 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.235683 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.235758 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.235936 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.236070 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.236206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.236325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.236399 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.236513 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.236631 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.236849 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.236849 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.237035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.237109 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.237220 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.237335 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.237420 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.237596 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.237678 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.237843 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.237932 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.238084 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.238169 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.238323 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.238399 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.238560 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.238646 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.238797 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.239131 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.239285 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.239360 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.239549 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.239626 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.239792 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.239876 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.240033 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.240115 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.240274 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.240350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.240513 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.240667 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.240742 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.240811 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.240974 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.241051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.241211 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.241294 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.241441 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.241554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.241699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.241778 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.241932 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.242013 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.242167 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.242250 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.242397 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.242475 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.242638 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.242725 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.242871 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.242959 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.243120 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.243197 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.243358 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.243435 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.243612 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.243695 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.243874 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.243951 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.244115 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.244190 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.244349 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] auth.external = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.244426 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] auth.external = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.244578 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.244653 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.244875 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.244978 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.245129 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.245253 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.245339 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] auth.password = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.245411 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] auth.password = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.245599 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] auth.token = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.245680 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] auth.token = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.245843 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.245920 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.246083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.246165 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.246331 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.246407 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.246561 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.246642 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.246810 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.246888 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.247058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.247134 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.247288 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.247363 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.247525 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] credential.caching = True {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.247604 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] credential.caching = True {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.247774 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.247850 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.248029 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.248107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.248275 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.248353 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.248512 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.248589 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.248757 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.248833 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.248991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.249077 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.249334 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.250029 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.250115 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.250282 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.250376 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.250531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.250610 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.250790 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.250868 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.251080 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.251166 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.251333 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.251415 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.251601 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.251687 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.251848 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.251984 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.252091 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] federation.caching = True {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.252168 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.252334 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.252412 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] federation.caching = True {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.252571 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.252656 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.252821 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.252941 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.253056 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.253134 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.253293 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.253378 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.253558 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.253649 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.253812 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.253888 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.254051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.254139 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.254297 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.254375 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.254554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.254631 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.254791 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.254876 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.255050 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.255127 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] identity.caching = True {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.255291 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] identity.caching = True {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.255368 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.255541 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.255691 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.255767 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.255842 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.256011 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.256090 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.256255 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.256334 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.256489 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.256565 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.256725 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.256802 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.256964 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.257043 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.257216 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.257294 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.257451 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.257552 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.257716 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.257796 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.257945 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.258021 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.258182 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.258259 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.258428 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.258508 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.258678 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.258754 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.258922 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.258998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.259175 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.259252 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.259419 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.259496 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.259678 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.259754 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.259916 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.259993 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.260151 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.260227 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.260381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.260457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.260617 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.260696 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.260847 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.260923 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.261084 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.261167 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.261327 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.261404 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.261587 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.261670 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.261831 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.261907 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.262063 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.262142 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.262310 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.262389 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.262549 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.262631 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.262784 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.262862 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.263034 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.263156 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.263253 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.263346 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.263494 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.263600 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.263732 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.263836 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.263966 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.264070 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.264204 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.264309 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.264439 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.264541 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.264680 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.264841 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.265007 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.265108 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.265203 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.265337 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.265442 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.265648 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.265768 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.265900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.266003 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.266131 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.266236 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.266380 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.266493 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.266629 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.266740 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.266868 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.266973 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.267105 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.267224 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.267342 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.267446 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.267653 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.user = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.267757 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.user = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.267846 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.267919 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.268060 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.268138 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.268294 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.268380 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.268541 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.268620 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.268788 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.268865 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.269034 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.269121 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.269270 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.269348 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.269517 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.269597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.269755 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.269846 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.269991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.270070 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.270229 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.270307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.270460 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.270546 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.270708 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.270786 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.270953 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.271030 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.271197 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.271282 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.271564 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.271642 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.271813 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.271890 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.272047 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.272160 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.272296 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.272402 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.272537 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.272642 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.272777 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.272890 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.273016 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.273161 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.273257 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.273351 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.273504 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.273624 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.273766 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.273904 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.274005 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.274101 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.274246 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.274359 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.274477 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.274581 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.274723 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.274827 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.274960 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.275072 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.275196 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.275301 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.275435 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.275538 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.275683 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.275794 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.275926 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.276027 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.276143 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.276247 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.276382 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.276494 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.276625 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] resource.caching = True {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.276750 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] resource.caching = True {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.276876 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.276955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.277126 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.277212 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.277364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.277443 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.277639 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.277721 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.277890 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.277981 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.278134 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.278212 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.278379 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.278455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.278616 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.278766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.278841 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.278911 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.279079 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] role.caching = True {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.279202 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] role.caching = True {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.279328 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] role.driver = sql {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.279415 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] role.driver = sql {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.279559 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.279638 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.279806 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.279884 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.280052 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.280139 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.280300 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.280403 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.280583 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.280733 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.280831 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.281077 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.281156 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.281323 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.281403 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.281593 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.281690 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.281831 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.281909 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.282077 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.282155 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.282322 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.282408 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.282571 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.282650 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.282817 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.282895 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.283124 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.283244 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.283481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.283557 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.283734 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.283811 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.283983 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.284069 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.284231 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.284309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.284480 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.284557 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.284717 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.284804 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.284973 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.285051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.285226 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.285303 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.285465 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.285581 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.285721 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.285800 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.285955 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.286032 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.286187 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.286273 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.286426 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.286503 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.286680 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.286756 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.286929 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.287009 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.287169 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.287247 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.287407 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.287484 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.287639 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.287718 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.287875 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.287952 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] token.caching = True {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.288116 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.288192 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] token.caching = True {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.288360 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.288438 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.288595 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.288671 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.288848 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.288925 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.289092 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.289170 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.289329 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.289407 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.289595 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.289687 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.289840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.289919 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.290088 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.290164 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.290323 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.290399 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.290561 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.290639 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.290798 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.290875 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.291040 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.291116 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.291284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.291362 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.291515 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.291591 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.291758 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.291835 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.292008 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.292087 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.292297 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] database.connection = **** {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.292382 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.292542 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.292621 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] database.connection = **** {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.292790 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.292877 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.293028 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.293113 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.293271 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.293355 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.293547 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.293629 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.293762 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.293853 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.293998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.294083 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.294234 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.294313 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.294477 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.294562 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.294711 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.294788 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.294956 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.295033 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.295191 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.295279 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.295438 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.295514 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.295669 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.295745 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.295915 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.296516 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.296701 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.296833 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.296957 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.297083 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.297260 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.297392 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.297538 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 12:37:12.297662 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 12:37:12.297799 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 12:37:12.327366 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.327679 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.327909 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.329656 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.329902 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.330131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.336179 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.338756 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.367280 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.367504 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.367632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.367873 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.419449 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.419789 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.470399 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.470626 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.470762 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.470916 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.535385 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.535621 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.535776 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.535919 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.536076 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.536215 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.536343 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.536472 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.536598 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.536721 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.536876 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.537002 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.560199 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.560436 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.560522 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.560665 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.560750 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.560889 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.560972 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.561107 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.561199 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.561323 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.561405 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.561553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.561638 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.561792 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.572629 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.572730 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.585431 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.585564 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.585672 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.585771 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.585898 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.585980 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.586122 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.586204 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.586343 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.586426 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.586557 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.586638 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.586768 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.586849 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 03 12:37:12.603872 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.604080 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 03 12:37:12.604409 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.604491 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.604607 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 03 12:37:12.604705 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 03 12:37:12.604872 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.604955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.605130 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.605212 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 03 12:37:12.605385 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.605475 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.605657 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.605742 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.605928 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.606183 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.616189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.616461 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.616725 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.616815 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.617005 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.617096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.617309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.617624 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.623884 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:37:12.624602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:37:12.628824 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:37:12.629100 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.629324 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:37:12.629407 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.629634 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.629720 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.629920 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.630003 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.630178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.630259 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.630449 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.630539 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.630718 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.630800 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.630985 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.631063 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.631250 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.631338 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.631513 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.631594 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.631786 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.632057 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.654378 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.655019 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.656538 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:37:12.656822 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.657150 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:37:12.657442 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.661418 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:37:12.661717 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.661996 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.662125 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:37:12.662409 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.662695 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.668619 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:37:12.668902 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.669320 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:37:12.669672 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.673903 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:37:12.674186 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.674445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:37:12.674528 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.674731 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.674824 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.675001 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.675085 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.675276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.675358 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.675550 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.675637 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.675818 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.675898 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.676110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.676387 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.691835 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.692106 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.692510 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.692791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.696025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:37:12.696727 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:37:12.699171 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.699465 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.699914 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.700214 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.704339 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:37:12.705234 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:37:12.707560 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:37:12.708467 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:37:12.710727 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.711023 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.711304 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.711595 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.711736 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.711875 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.712038 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.712154 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.712324 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.712610 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.712887 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.713175 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.728519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:37:12.728800 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.729061 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.729330 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.729893 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:37:12.730180 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.730449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.730715 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.736222 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.737727 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.737911 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.738036 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.739545 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.739826 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.741079 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:37:12.741357 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.741679 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.741964 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.742249 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.742672 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:37:12.742955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.743260 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.743544 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.743835 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.753648 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:37:12.753924 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.754200 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.754474 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.754750 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.755022 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.755291 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.755466 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:37:12.755752 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.756036 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.756322 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.756608 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.756886 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.757168 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.771425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:37:12.773265 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:37:12.774400 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:37:12.776290 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:37:12.777332 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.779286 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.779757 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.782007 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:37:12.782290 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.782413 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.782572 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.784011 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:37:12.784301 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.784587 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.788984 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.790601 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:37:12.791104 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.792710 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:37:12.793528 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.793817 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.794093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.794368 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.795664 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.795985 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.796313 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.796567 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.802504 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:37:12.802790 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.803076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.804639 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:37:12.804928 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.805219 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.809896 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:37:12.810174 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.810451 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.810720 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.810986 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.811259 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.811535 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.811850 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.812156 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 03 12:37:12.812247 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.812437 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.812518 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.812718 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.812797 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.812996 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.813078 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.813273 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.813360 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.813564 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.813661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.813851 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.814123 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.814499 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.814792 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.815076 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.815354 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.815632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.815896 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 03 12:37:12.847667 dv-cinder-850836-4-smb devstack@keystone.service[91789]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c64ef5c9c0 pid: 91789 (default app) Aug 03 12:37:12.850546 dv-cinder-850836-4-smb devstack@keystone.service[91788]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c64ef5c9c0 pid: 91788 (default app) Aug 03 12:37:12.850934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c7794-e670-484d-8b1b-6fbf779cde92 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:12.851221 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c7794-e670-484d-8b1b-6fbf779cde92 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:12.851492 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c7794-e670-484d-8b1b-6fbf779cde92 None None] PATH_INFO: `/v3` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:12.855776 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 791 bytes} [Wed Aug 3 12:37:12 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:20.516041 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f3a3d-d145-4468-8c1d-85bd24dc2051 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:20.516606 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f3a3d-d145-4468-8c1d-85bd24dc2051 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:20.516606 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f3a3d-d145-4468-8c1d-85bd24dc2051 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:20.521099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1/2] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:37:20.526364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad649d-bebb-41cd-b5f5-244854da6adf None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:20.526775 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad649d-bebb-41cd-b5f5-244854da6adf None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:20.526914 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad649d-bebb-41cd-b5f5-244854da6adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:20.599304 dv-cinder-850836-4-smb devstack@keystone.service[91789]: INFO dbcounter [None req-bfad649d-bebb-41cd-b5f5-244854da6adf None None] Registered counter for database keystone Aug 03 12:37:20.619080 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG oslo_db.sqlalchemy.engines [None req-bfad649d-bebb-41cd-b5f5-244854da6adf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91789) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:37:20.626115 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writer thread running {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:37:20.806910 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG passlib.handlers.bcrypt [None req-bfad649d-bebb-41cd-b5f5-244854da6adf None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91789) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 03 12:37:20.807257 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG passlib.handlers.bcrypt [None req-bfad649d-bebb-41cd-b5f5-244854da6adf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91789) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 03 12:37:20.861772 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-bfad649d-bebb-41cd-b5f5-244854da6adf None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:20.863422 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-bfad649d-bebb-41cd-b5f5-244854da6adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:21.000528 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 2/3] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 03 12:37:21.145232 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f3a3d-d145-4468-8c1d-85bd24dc2051 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:21.215674 dv-cinder-850836-4-smb devstack@keystone.service[91788]: INFO dbcounter [None req-c67f3a3d-d145-4468-8c1d-85bd24dc2051 None None] Registered counter for database keystone Aug 03 12:37:21.237133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG oslo_db.sqlalchemy.engines [None req-c67f3a3d-d145-4468-8c1d-85bd24dc2051 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 12:37:21.243561 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writer thread running {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 12:37:21.361849 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f3a3d-d145-4468-8c1d-85bd24dc2051 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:21.366344 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0b08c-a391-41b6-9dae-7e69d82e8116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:21.366973 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0b08c-a391-41b6-9dae-7e69d82e8116 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:21.367253 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0b08c-a391-41b6-9dae-7e69d82e8116 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:21.367529 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0b08c-a391-41b6-9dae-7e69d82e8116 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:21.375760 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0b08c-a391-41b6-9dae-7e69d82e8116 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:21.427460 dv-cinder-850836-4-smb devstack@keystone.service[91788]: WARNING keystone.common.rbac_enforcer.enforcer [None req-09e0b08c-a391-41b6-9dae-7e69d82e8116 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 03 12:37:21.427751 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0b08c-a391-41b6-9dae-7e69d82e8116 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:21.437471 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 2/4] 10.222.0.46 () {58 vars in 1324 bytes} [Wed Aug 3 12:37:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 03 12:37:21.443370 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad649d-bebb-41cd-b5f5-244854da6adf None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:21.457874 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad649d-bebb-41cd-b5f5-244854da6adf None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:21.462721 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9582f4-23fb-4e4b-b18a-5f9dda522092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:21.463881 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9582f4-23fb-4e4b-b18a-5f9dda522092 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:21.464118 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9582f4-23fb-4e4b-b18a-5f9dda522092 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:21.464396 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9582f4-23fb-4e4b-b18a-5f9dda522092 admin admin] PATH_INFO: `/v3/projects/ef821f4e4aa44ffbb19f8f2890cba575` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:21.465927 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9582f4-23fb-4e4b-b18a-5f9dda522092 admin admin] RBAC: Authorizing `identity:get_project(project_id=ef821f4e4aa44ffbb19f8f2890cba575)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:21.515881 dv-cinder-850836-4-smb devstack@keystone.service[91789]: WARNING keystone.common.rbac_enforcer.enforcer [None req-eb9582f4-23fb-4e4b-b18a-5f9dda522092 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 03 12:37:21.516260 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9582f4-23fb-4e4b-b18a-5f9dda522092 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:21.520923 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 3/5] 10.222.0.46 () {56 vars in 1207 bytes} [Wed Aug 3 12:37:21 2022] GET /identity/v3/projects/ef821f4e4aa44ffbb19f8f2890cba575 => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:23.486089 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e44ef-fa74-4897-9364-864bc70d5691 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:23.486615 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e44ef-fa74-4897-9364-864bc70d5691 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:23.486615 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e44ef-fa74-4897-9364-864bc70d5691 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:23.491034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 3/6] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:37:23.496252 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f1885-5361-4682-b9f7-08e99c318b03 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:23.496674 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f1885-5361-4682-b9f7-08e99c318b03 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:23.496804 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f1885-5361-4682-b9f7-08e99c318b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:23.517004 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-524f1885-5361-4682-b9f7-08e99c318b03 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:23.518615 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-524f1885-5361-4682-b9f7-08e99c318b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:23.526387 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 4/7] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 03 12:37:23.548700 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e44ef-fa74-4897-9364-864bc70d5691 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:23.560576 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e44ef-fa74-4897-9364-864bc70d5691 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:23.565349 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5258571-8166-4348-848c-c2ecc7321988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:23.565991 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5258571-8166-4348-848c-c2ecc7321988 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:23.566282 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5258571-8166-4348-848c-c2ecc7321988 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:23.566560 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5258571-8166-4348-848c-c2ecc7321988 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:23.574149 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5258571-8166-4348-848c-c2ecc7321988 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:23.575922 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5258571-8166-4348-848c-c2ecc7321988 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:23.584608 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 4/8] 10.222.0.46 () {58 vars in 1324 bytes} [Wed Aug 3 12:37:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 12:37:23.590020 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f1885-5361-4682-b9f7-08e99c318b03 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:23.599611 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f1885-5361-4682-b9f7-08e99c318b03 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:23.604026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da630c6b-2392-4df7-9eaf-77b5f7867d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:23.604651 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da630c6b-2392-4df7-9eaf-77b5f7867d14 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:23.604934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da630c6b-2392-4df7-9eaf-77b5f7867d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:23.605209 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da630c6b-2392-4df7-9eaf-77b5f7867d14 admin admin] PATH_INFO: `/v3/users/813656e83c41478ab6f4c3340645651a` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:23.606616 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da630c6b-2392-4df7-9eaf-77b5f7867d14 admin admin] RBAC: Authorizing `identity:get_user(user_id=813656e83c41478ab6f4c3340645651a)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:23.609176 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da630c6b-2392-4df7-9eaf-77b5f7867d14 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:23.610762 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 5/9] 10.222.0.46 () {56 vars in 1198 bytes} [Wed Aug 3 12:37:23 2022] GET /identity/v3/users/813656e83c41478ab6f4c3340645651a => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:25.677912 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67dede-3c85-4c13-9d00-94b14060d9f4 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:25.678420 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67dede-3c85-4c13-9d00-94b14060d9f4 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:25.678420 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67dede-3c85-4c13-9d00-94b14060d9f4 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:25.679741 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 5/10] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:37:25.684875 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2cbd0-8bc9-4a60-ac5e-ecba3b82e722 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:25.685291 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2cbd0-8bc9-4a60-ac5e-ecba3b82e722 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:25.685430 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2cbd0-8bc9-4a60-ac5e-ecba3b82e722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:25.699686 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7479a0e-23d9-49f4-b730-5a6901fb0e9e None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:25.700200 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7479a0e-23d9-49f4-b730-5a6901fb0e9e None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:25.700474 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7479a0e-23d9-49f4-b730-5a6901fb0e9e None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:25.701866 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 6/11] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:37:25.705122 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-31a2cbd0-8bc9-4a60-ac5e-ecba3b82e722 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:25.706415 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-31a2cbd0-8bc9-4a60-ac5e-ecba3b82e722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:25.706749 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c128ec-4f95-4ef4-b1da-9e9a10b14771 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:25.707036 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c128ec-4f95-4ef4-b1da-9e9a10b14771 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:25.707314 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c128ec-4f95-4ef4-b1da-9e9a10b14771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:25.749955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG passlib.handlers.bcrypt [None req-e8c128ec-4f95-4ef4-b1da-9e9a10b14771 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91788) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 03 12:37:25.750360 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG passlib.handlers.bcrypt [None req-e8c128ec-4f95-4ef4-b1da-9e9a10b14771 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91788) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 03 12:37:25.791105 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 6/12] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:37:25.795068 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-e8c128ec-4f95-4ef4-b1da-9e9a10b14771 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:25.797200 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-e8c128ec-4f95-4ef4-b1da-9e9a10b14771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:25.815211 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2cbd0-8bc9-4a60-ac5e-ecba3b82e722 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:25.839147 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:25.899014 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 7/13] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:37:25.919800 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2cbd0-8bc9-4a60-ac5e-ecba3b82e722 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:25.922195 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c128ec-4f95-4ef4-b1da-9e9a10b14771 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:25.954225 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978c006-d75f-4b4a-86d6-e478d9337691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:25.954802 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978c006-d75f-4b4a-86d6-e478d9337691 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:25.955080 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978c006-d75f-4b4a-86d6-e478d9337691 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:25.955351 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978c006-d75f-4b4a-86d6-e478d9337691 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:25.966211 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4978c006-d75f-4b4a-86d6-e478d9337691 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:37:25.976213 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-4978c006-d75f-4b4a-86d6-e478d9337691 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:37:25.976213 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:37:25.976213 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:37:25.976213 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:37:25.976213 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:37:25.976213 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:37:25.976213 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:37:25.976213 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:37:25.976213 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:37:25.976213 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:37:25.976213 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:37:25.976213 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:37:25.976213 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:37:25.976213 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:37:25.976213 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:37:25.976213 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:37:25.977101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:37:25.977101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:37:25.977101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:37:25.977101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:37:25.977101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:37:25.977101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:37:25.977101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:37:25.977101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:37:25.977101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:37:25.977101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:37:25.977101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:37:25.977101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:37:25.977101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:37:25.977101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:37:25.977101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:37:25.977101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:37:25.978272 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:37:25.978272 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:37:25.978272 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:37:25.978272 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:37:25.978272 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:37:25.978272 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:37:25.978272 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:37:25.978272 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:37:25.978272 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:37:25.978272 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:37:25.978272 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:37:25.978272 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:37:25.978272 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 7/14] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 3 12:37:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:37:25.983939 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978c006-d75f-4b4a-86d6-e478d9337691 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:26.021909 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c128ec-4f95-4ef4-b1da-9e9a10b14771 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:26.024175 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:26.067200 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09a2d1-a012-4986-ae3b-a7fa26250cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:26.068198 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09a2d1-a012-4986-ae3b-a7fa26250cad None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:26.068598 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09a2d1-a012-4986-ae3b-a7fa26250cad None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:26.068886 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09a2d1-a012-4986-ae3b-a7fa26250cad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:26.069031 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:26.090654 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978c006-d75f-4b4a-86d6-e478d9337691 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:26.130705 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55fad0-290e-4512-a27f-1838abc9a4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:26.131393 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55fad0-290e-4512-a27f-1838abc9a4a1 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:26.131678 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55fad0-290e-4512-a27f-1838abc9a4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:26.131961 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55fad0-290e-4512-a27f-1838abc9a4a1 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:26.132699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55fad0-290e-4512-a27f-1838abc9a4a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:26.133006 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55fad0-290e-4512-a27f-1838abc9a4a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:26.134504 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55fad0-290e-4512-a27f-1838abc9a4a1 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:26.148376 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09a2d1-a012-4986-ae3b-a7fa26250cad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:26.150015 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09a2d1-a012-4986-ae3b-a7fa26250cad None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:26.151088 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 8/15] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:37:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:37:26.158505 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55fad0-290e-4512-a27f-1838abc9a4a1 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:26.282825 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55fad0-290e-4512-a27f-1838abc9a4a1 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:26.287034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 8/16] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:37:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 03 12:37:26.292957 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09a2d1-a012-4986-ae3b-a7fa26250cad None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:26.297023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:26.400697 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09a2d1-a012-4986-ae3b-a7fa26250cad None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:26.425074 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e689e7b-1e47-413d-a202-1fad919e31ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:26.425741 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e689e7b-1e47-413d-a202-1fad919e31ab None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:26.426019 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e689e7b-1e47-413d-a202-1fad919e31ab None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:26.426296 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e689e7b-1e47-413d-a202-1fad919e31ab None admin] PATH_INFO: `/v3/users/813656e83c41478ab6f4c3340645651a` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:26.427457 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e689e7b-1e47-413d-a202-1fad919e31ab None admin] RBAC: Authorizing `identity:get_user(user_id=813656e83c41478ab6f4c3340645651a)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:26.428930 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e689e7b-1e47-413d-a202-1fad919e31ab None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:26.430551 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 9/17] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:37:26 2022] GET /identity/v3/users/813656e83c41478ab6f4c3340645651a => generated 247 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:37:26.435211 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c964e-6fca-43cc-a6a4-31f9fe7dbaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:26.435909 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e689e7b-1e47-413d-a202-1fad919e31ab None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:26.436095 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c964e-6fca-43cc-a6a4-31f9fe7dbaa1 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:26.436653 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c964e-6fca-43cc-a6a4-31f9fe7dbaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:26.436936 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c964e-6fca-43cc-a6a4-31f9fe7dbaa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:26.450186 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:26.456064 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c964e-6fca-43cc-a6a4-31f9fe7dbaa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:26.457567 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c964e-6fca-43cc-a6a4-31f9fe7dbaa1 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:26.476470 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-527c964e-6fca-43cc-a6a4-31f9fe7dbaa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:37:26.476470 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:37:26.476470 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:37:26.476470 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:37:26.476470 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:37:26.476470 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:37:26.476470 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:37:26.476470 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:37:26.476470 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:37:26.476470 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:37:26.476470 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:37:26.476470 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:37:26.476470 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:37:26.476470 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:37:26.476470 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:37:26.477325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:37:26.477325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:37:26.477325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:37:26.477325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:37:26.477325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:37:26.477325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:37:26.477325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:37:26.477325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:37:26.477325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:37:26.477325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:37:26.477325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:37:26.477325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:37:26.477325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:37:26.477325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:37:26.477325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:37:26.477325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:37:26.477325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:37:26.478147 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:37:26.478147 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:37:26.478147 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:37:26.478147 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:37:26.478147 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 9/18] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:37:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:37:26.483956 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c964e-6fca-43cc-a6a4-31f9fe7dbaa1 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:26.536565 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e689e7b-1e47-413d-a202-1fad919e31ab None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:26.540631 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:26.571416 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33aae4-3012-4278-87d2-b60254a47e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:26.572064 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33aae4-3012-4278-87d2-b60254a47e8c None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:26.572349 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33aae4-3012-4278-87d2-b60254a47e8c None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:26.572627 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33aae4-3012-4278-87d2-b60254a47e8c None admin] PATH_INFO: `/v3/domains/default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:26.573832 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33aae4-3012-4278-87d2-b60254a47e8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:26.575283 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33aae4-3012-4278-87d2-b60254a47e8c None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:26.577747 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 10/19] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:37:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:37:26.583614 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33aae4-3012-4278-87d2-b60254a47e8c None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:26.586667 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c964e-6fca-43cc-a6a4-31f9fe7dbaa1 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:26.620266 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b419a1a-1c1d-4a03-8274-2537c4177a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:26.620884 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b419a1a-1c1d-4a03-8274-2537c4177a60 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:26.621171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b419a1a-1c1d-4a03-8274-2537c4177a60 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:26.621447 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b419a1a-1c1d-4a03-8274-2537c4177a60 None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:26.622186 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b419a1a-1c1d-4a03-8274-2537c4177a60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:26.622510 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b419a1a-1c1d-4a03-8274-2537c4177a60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:26.624586 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b419a1a-1c1d-4a03-8274-2537c4177a60 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:26.642444 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 10/20] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:37:26.665180 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:26.686007 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33aae4-3012-4278-87d2-b60254a47e8c None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:26.723723 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8b350-b929-4db9-a5d0-6735bc9f87bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:26.724357 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8b350-b929-4db9-a5d0-6735bc9f87bd None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:26.724637 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8b350-b929-4db9-a5d0-6735bc9f87bd None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:26.724908 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8b350-b929-4db9-a5d0-6735bc9f87bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:26.725744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e8b350-b929-4db9-a5d0-6735bc9f87bd None admin] RBAC: Adding query filter params (role.id=0e57d142f86c471883fc07a89fe66ec8, scope.domain.id=default, user.id=813656e83c41478ab6f4c3340645651a) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:26.726055 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e8b350-b929-4db9-a5d0-6735bc9f87bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:26.727509 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e8b350-b929-4db9-a5d0-6735bc9f87bd None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:26.735656 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 11/21] 10.222.0.46 () {56 vars in 1322 bytes} [Wed Aug 3 12:37:26 2022] GET /identity/v3/role_assignments?user.id=813656e83c41478ab6f4c3340645651a&scope.domain.id=default&role.id=0e57d142f86c471883fc07a89fe66ec8 => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:37:29.039128 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b29994-e33e-4daa-a1b7-f6eca9cd5084 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:29.039670 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b29994-e33e-4daa-a1b7-f6eca9cd5084 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:29.039670 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b29994-e33e-4daa-a1b7-f6eca9cd5084 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:29.041157 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 11/22] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:37:29.047752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aefeca-a5ea-4904-b536-b61521211b7d None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:29.048224 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aefeca-a5ea-4904-b536-b61521211b7d None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:29.048304 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aefeca-a5ea-4904-b536-b61521211b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:29.074497 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-32aefeca-a5ea-4904-b536-b61521211b7d None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:29.075712 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-32aefeca-a5ea-4904-b536-b61521211b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:29.159777 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 12/23] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:37:29.207587 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b29994-e33e-4daa-a1b7-f6eca9cd5084 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:29.213374 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cee202-f5f5-4a2c-be28-a17b4e6b99bd None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:29.213686 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cee202-f5f5-4a2c-be28-a17b4e6b99bd None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:29.214084 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cee202-f5f5-4a2c-be28-a17b4e6b99bd None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:29.215427 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 13/24] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:37:29.221587 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29971dc0-6327-4988-b9c4-dcb0d67f412e None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:29.221869 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29971dc0-6327-4988-b9c4-dcb0d67f412e None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:29.222149 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29971dc0-6327-4988-b9c4-dcb0d67f412e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:29.241448 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-29971dc0-6327-4988-b9c4-dcb0d67f412e None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:29.242699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-29971dc0-6327-4988-b9c4-dcb0d67f412e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:29.335512 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 14/25] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:37:29.343673 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15dbf3-0492-43ed-ba64-18010f54b881 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:29.344121 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15dbf3-0492-43ed-ba64-18010f54b881 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:29.344566 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15dbf3-0492-43ed-ba64-18010f54b881 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:29.346109 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 15/26] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:29 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:37:29.351579 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f1414-a64e-4f17-8b5b-e956e6b0406b None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:29.352045 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f1414-a64e-4f17-8b5b-e956e6b0406b None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:29.352464 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f1414-a64e-4f17-8b5b-e956e6b0406b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:29.368648 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:29.394567 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-9d1f1414-a64e-4f17-8b5b-e956e6b0406b None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:29.395802 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-9d1f1414-a64e-4f17-8b5b-e956e6b0406b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:29.415540 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b29994-e33e-4daa-a1b7-f6eca9cd5084 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:29.435292 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:29.462844 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704a2b2-05b9-472d-aa80-b6e40266f1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:29.463976 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704a2b2-05b9-472d-aa80-b6e40266f1e2 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:29.464501 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704a2b2-05b9-472d-aa80-b6e40266f1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:29.464933 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704a2b2-05b9-472d-aa80-b6e40266f1e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:29.480307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704a2b2-05b9-472d-aa80-b6e40266f1e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:29.482127 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704a2b2-05b9-472d-aa80-b6e40266f1e2 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:29.499597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-a704a2b2-05b9-472d-aa80-b6e40266f1e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:37:29.499597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:37:29.499597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:37:29.499597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:37:29.499597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:37:29.499597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:37:29.499597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:37:29.499597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:37:29.499597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:37:29.499597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:37:29.499597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:37:29.499597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:37:29.499597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:37:29.499597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:37:29.499597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:37:29.500414 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:37:29.500414 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:37:29.500414 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:37:29.500414 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:37:29.500414 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:37:29.500414 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:37:29.500414 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:37:29.500414 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:37:29.500414 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:37:29.500414 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:37:29.500414 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:37:29.500414 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:37:29.500414 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:37:29.500414 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:37:29.500414 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:37:29.500414 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:37:29.500414 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:37:29.501203 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:37:29.501203 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:37:29.501203 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:37:29.501203 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:37:29.503162 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 12/27] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:37:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:37:29.508797 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704a2b2-05b9-472d-aa80-b6e40266f1e2 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:29.511798 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 16/28] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:37:29.513327 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c71e4d-7cc2-4b90-b23a-0972c9c89676 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:29.513856 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c71e4d-7cc2-4b90-b23a-0972c9c89676 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:29.514940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c71e4d-7cc2-4b90-b23a-0972c9c89676 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:29.522826 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 17/29] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:37:29.524299 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c71e4d-7cc2-4b90-b23a-0972c9c89676 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:29.661477 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c71e4d-7cc2-4b90-b23a-0972c9c89676 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:29.701116 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972d06f-35b1-4d7c-89b6-9f079b8b6b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:29.703298 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972d06f-35b1-4d7c-89b6-9f079b8b6b44 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:29.703789 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972d06f-35b1-4d7c-89b6-9f079b8b6b44 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:29.704286 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972d06f-35b1-4d7c-89b6-9f079b8b6b44 None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:29.705292 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972d06f-35b1-4d7c-89b6-9f079b8b6b44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:29.705855 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972d06f-35b1-4d7c-89b6-9f079b8b6b44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:29.707451 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972d06f-35b1-4d7c-89b6-9f079b8b6b44 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:29.709434 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:29.727747 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 18/30] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:29.729311 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6b87a-d131-4ef1-80bd-e675420dd631 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:29.729833 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6b87a-d131-4ef1-80bd-e675420dd631 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:29.730341 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6b87a-d131-4ef1-80bd-e675420dd631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:29.750485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-0ca6b87a-d131-4ef1-80bd-e675420dd631 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:29.752055 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-0ca6b87a-d131-4ef1-80bd-e675420dd631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:29.755067 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704a2b2-05b9-472d-aa80-b6e40266f1e2 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:29.791645 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11524900-c9f2-4fdd-8c0d-6d0c64baa273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:29.792289 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11524900-c9f2-4fdd-8c0d-6d0c64baa273 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:29.792575 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11524900-c9f2-4fdd-8c0d-6d0c64baa273 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:29.792856 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11524900-c9f2-4fdd-8c0d-6d0c64baa273 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:29.804895 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11524900-c9f2-4fdd-8c0d-6d0c64baa273 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:37:29.812001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-11524900-c9f2-4fdd-8c0d-6d0c64baa273 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:37:29.812001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:37:29.812001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:37:29.812001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:37:29.812001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:37:29.812001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:37:29.812001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:37:29.812001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:37:29.812001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:37:29.812001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:37:29.812001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:37:29.812001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:37:29.812001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:37:29.812001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:37:29.812001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:37:29.812001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:37:29.812871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:37:29.812871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:37:29.812871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:37:29.812871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:37:29.812871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:37:29.812871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:37:29.812871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:37:29.812871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:37:29.812871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:37:29.812871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:37:29.812871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:37:29.812871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:37:29.812871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:37:29.812871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:37:29.812871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:37:29.812871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:37:29.813748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:37:29.813748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:37:29.813748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:37:29.813748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:37:29.813748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:37:29.813748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:37:29.813748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:37:29.813748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:37:29.813748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:37:29.813748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:37:29.813748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:37:29.813748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:37:29.813748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 13/31] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 3 12:37:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:37:29.818379 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11524900-c9f2-4fdd-8c0d-6d0c64baa273 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:29.833312 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 19/32] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:37:29.834515 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6b87a-d131-4ef1-80bd-e675420dd631 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:29.849407 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:29.924016 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11524900-c9f2-4fdd-8c0d-6d0c64baa273 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:29.942918 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6b87a-d131-4ef1-80bd-e675420dd631 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:29.960236 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a206ea5-f936-4b32-b722-a4042ae4061d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:29.961074 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a206ea5-f936-4b32-b722-a4042ae4061d None admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:29.961529 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a206ea5-f936-4b32-b722-a4042ae4061d None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:29.961988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a206ea5-f936-4b32-b722-a4042ae4061d None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:29.962910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a206ea5-f936-4b32-b722-a4042ae4061d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:29.964472 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a206ea5-f936-4b32-b722-a4042ae4061d None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:29.969634 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:29.987856 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a083c6-4216-4243-b727-63dd9fb05810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:29.988588 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a083c6-4216-4243-b727-63dd9fb05810 None admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:29.989211 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a083c6-4216-4243-b727-63dd9fb05810 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:29.989597 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a083c6-4216-4243-b727-63dd9fb05810 None admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:29.990411 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a083c6-4216-4243-b727-63dd9fb05810 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:29.992010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a083c6-4216-4243-b727-63dd9fb05810 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:30.106428 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 14/33] 10.222.0.46 () {60 vars in 1131 bytes} [Wed Aug 3 12:37:29 2022] POST /identity/v3/roles => generated 219 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:37:30.108103 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a206ea5-f936-4b32-b722-a4042ae4061d None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:30.181701 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 20/34] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Aug 3 12:37:29 2022] POST /identity/v3/projects => generated 301 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:37:30.190529 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a083c6-4216-4243-b727-63dd9fb05810 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:30.323312 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:30.338321 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a206ea5-f936-4b32-b722-a4042ae4061d None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:30.362729 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a083c6-4216-4243-b727-63dd9fb05810 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:30.377956 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6346a8-d901-4ea6-9066-83377e519eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:30.378949 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6346a8-d901-4ea6-9066-83377e519eb9 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:30.379430 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6346a8-d901-4ea6-9066-83377e519eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:30.379925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6346a8-d901-4ea6-9066-83377e519eb9 None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:30.380874 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6346a8-d901-4ea6-9066-83377e519eb9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:30.381378 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6346a8-d901-4ea6-9066-83377e519eb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:30.383322 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6346a8-d901-4ea6-9066-83377e519eb9 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:30.397564 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 15/35] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:37:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:30.405213 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6346a8-d901-4ea6-9066-83377e519eb9 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:30.408378 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7615f-bcf0-4b22-8808-c227e268ddc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:30.409101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7615f-bcf0-4b22-8808-c227e268ddc7 None admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:30.409398 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7615f-bcf0-4b22-8808-c227e268ddc7 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:30.410286 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7615f-bcf0-4b22-8808-c227e268ddc7 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:30.411033 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd7615f-bcf0-4b22-8808-c227e268ddc7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:30.412597 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd7615f-bcf0-4b22-8808-c227e268ddc7 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:30.443722 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 21/36] 10.222.0.46 () {60 vars in 1131 bytes} [Wed Aug 3 12:37:30 2022] POST /identity/v3/roles => generated 225 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:37:30.557807 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6346a8-d901-4ea6-9066-83377e519eb9 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:30.599045 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682115be-8156-4145-95b2-7ebb733c39c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:30.599736 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682115be-8156-4145-95b2-7ebb733c39c6 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:30.600026 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682115be-8156-4145-95b2-7ebb733c39c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:30.600311 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682115be-8156-4145-95b2-7ebb733c39c6 None admin] PATH_INFO: `/v3/users/813656e83c41478ab6f4c3340645651a` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:30.602113 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682115be-8156-4145-95b2-7ebb733c39c6 None admin] RBAC: Authorizing `identity:get_user(user_id=813656e83c41478ab6f4c3340645651a)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:30.603958 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682115be-8156-4145-95b2-7ebb733c39c6 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:30.605660 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ac4f8-d2dc-40f7-bd14-b1017eacb855 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:30.605954 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ac4f8-d2dc-40f7-bd14-b1017eacb855 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:30.606251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ac4f8-d2dc-40f7-bd14-b1017eacb855 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:30.607947 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 22/37] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:37:30.609872 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 16/38] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:37:30 2022] GET /identity/v3/users/813656e83c41478ab6f4c3340645651a => generated 247 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:37:30.614146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeda22a-5bd5-4753-9301-41d648320107 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:30.614537 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeda22a-5bd5-4753-9301-41d648320107 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:30.614871 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeda22a-5bd5-4753-9301-41d648320107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:30.615788 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682115be-8156-4145-95b2-7ebb733c39c6 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:30.637941 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:30.641121 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-2eeda22a-5bd5-4753-9301-41d648320107 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:30.643127 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-2eeda22a-5bd5-4753-9301-41d648320107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:30.685836 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:30.734889 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 23/39] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:37:30.736092 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e14236-97db-41ff-9785-1f540e2b25e4 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:30.736378 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e14236-97db-41ff-9785-1f540e2b25e4 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:30.736654 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e14236-97db-41ff-9785-1f540e2b25e4 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:30.737960 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 24/40] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:37:30.743318 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b5e36-9e72-40d7-9d3d-346fb9c873e4 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:30.743608 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b5e36-9e72-40d7-9d3d-346fb9c873e4 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:30.743890 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b5e36-9e72-40d7-9d3d-346fb9c873e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:30.745818 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682115be-8156-4145-95b2-7ebb733c39c6 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:30.762538 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-951b5e36-9e72-40d7-9d3d-346fb9c873e4 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:30.763718 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-951b5e36-9e72-40d7-9d3d-346fb9c873e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:30.786946 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5008a-f9e1-4d61-9c9b-f165e85a222d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:30.787746 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5008a-f9e1-4d61-9c9b-f165e85a222d None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:30.788035 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5008a-f9e1-4d61-9c9b-f165e85a222d None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:30.788314 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5008a-f9e1-4d61-9c9b-f165e85a222d None admin] PATH_INFO: `/v3/domains/default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:30.789596 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5008a-f9e1-4d61-9c9b-f165e85a222d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:30.791057 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5008a-f9e1-4d61-9c9b-f165e85a222d None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:30.792822 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 17/41] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:37:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:30.793394 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5008a-f9e1-4d61-9c9b-f165e85a222d None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:30.836549 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 25/42] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:37:30.837444 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b5e36-9e72-40d7-9d3d-346fb9c873e4 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:30.880378 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:30.895958 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5008a-f9e1-4d61-9c9b-f165e85a222d None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:30.929864 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77770f45-89da-4395-b9be-453daeb0ceb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:30.930492 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77770f45-89da-4395-b9be-453daeb0ceb9 None admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:30.930775 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77770f45-89da-4395-b9be-453daeb0ceb9 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:30.931056 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77770f45-89da-4395-b9be-453daeb0ceb9 None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:30.931764 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77770f45-89da-4395-b9be-453daeb0ceb9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:30.932936 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:30.933145 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77770f45-89da-4395-b9be-453daeb0ceb9 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:30.939825 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b5e36-9e72-40d7-9d3d-346fb9c873e4 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:30.947948 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 18/43] 10.222.0.46 () {60 vars in 1131 bytes} [Wed Aug 3 12:37:30 2022] POST /identity/v3/roles => generated 223 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:37:30.948758 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77770f45-89da-4395-b9be-453daeb0ceb9 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:30.985725 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545ab85-ac53-42e0-8562-b871a667caa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:30.986338 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545ab85-ac53-42e0-8562-b871a667caa2 None admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:30.986623 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545ab85-ac53-42e0-8562-b871a667caa2 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:30.986905 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545ab85-ac53-42e0-8562-b871a667caa2 None admin] PATH_INFO: `/v3/domains/default/users/813656e83c41478ab6f4c3340645651a/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:30.989221 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545ab85-ac53-42e0-8562-b871a667caa2 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=813656e83c41478ab6f4c3340645651a, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:30.990754 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545ab85-ac53-42e0-8562-b871a667caa2 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:31.007419 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 26/44] 10.222.0.46 () {58 vars in 1361 bytes} [Wed Aug 3 12:37:30 2022] PUT /identity/v3/domains/default/users/813656e83c41478ab6f4c3340645651a/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:37:31.082020 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77770f45-89da-4395-b9be-453daeb0ceb9 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:31.124163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c6d7a-1b98-4a1c-b878-01a4542b9db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:31.124841 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c6d7a-1b98-4a1c-b878-01a4542b9db1 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:31.125129 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c6d7a-1b98-4a1c-b878-01a4542b9db1 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:31.125415 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c6d7a-1b98-4a1c-b878-01a4542b9db1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:31.126702 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c6d7a-1b98-4a1c-b878-01a4542b9db1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:31.128213 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c6d7a-1b98-4a1c-b878-01a4542b9db1 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:31.130172 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 19/45] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:37:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:31.135772 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545ab85-ac53-42e0-8562-b871a667caa2 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:31.244831 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545ab85-ac53-42e0-8562-b871a667caa2 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:31.278075 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfc90d-a48f-472a-ac20-9abd8a1f4649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:31.278702 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfc90d-a48f-472a-ac20-9abd8a1f4649 None admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:31.278990 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfc90d-a48f-472a-ac20-9abd8a1f4649 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:31.279266 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfc90d-a48f-472a-ac20-9abd8a1f4649 None admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:31.280544 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdfc90d-a48f-472a-ac20-9abd8a1f4649 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:31.282374 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdfc90d-a48f-472a-ac20-9abd8a1f4649 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:31.308967 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 27/46] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Aug 3 12:37:31 2022] POST /identity/v3/projects => generated 312 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:37:33.026343 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d155a13-87e7-4a2b-ac68-2739a26d398b None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:33.026895 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d155a13-87e7-4a2b-ac68-2739a26d398b None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:33.026895 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d155a13-87e7-4a2b-ac68-2739a26d398b None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:33.028248 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 20/47] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:37:33.033653 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d8627-fb95-438d-bf7e-a562a2764832 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:33.034030 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d8627-fb95-438d-bf7e-a562a2764832 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:33.034218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d8627-fb95-438d-bf7e-a562a2764832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:33.053131 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-b77d8627-fb95-438d-bf7e-a562a2764832 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:33.054364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-b77d8627-fb95-438d-bf7e-a562a2764832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:33.056372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:33.122110 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 28/48] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:37:33.145085 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d155a13-87e7-4a2b-ac68-2739a26d398b None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:33.161014 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:33.247336 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d155a13-87e7-4a2b-ac68-2739a26d398b None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:33.282230 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a45429-f6d5-42ba-ac1f-732e8b6158cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:33.282817 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a45429-f6d5-42ba-ac1f-732e8b6158cf None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:33.283104 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a45429-f6d5-42ba-ac1f-732e8b6158cf None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:33.283386 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a45429-f6d5-42ba-ac1f-732e8b6158cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:33.293402 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a45429-f6d5-42ba-ac1f-732e8b6158cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:37:33.299004 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-b5a45429-f6d5-42ba-ac1f-732e8b6158cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:37:33.299004 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:37:33.299004 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:37:33.299004 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:37:33.299004 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:37:33.299004 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:37:33.299004 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:37:33.299004 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:37:33.299004 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:37:33.299004 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:37:33.299004 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:37:33.299004 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:37:33.299004 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:37:33.299004 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:37:33.299004 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:37:33.299004 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:37:33.299832 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:37:33.299832 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:37:33.299832 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:37:33.299832 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:37:33.299832 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:37:33.299832 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:37:33.299832 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:37:33.299832 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:37:33.299832 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:37:33.299832 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:37:33.299832 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:37:33.299832 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:37:33.299832 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:37:33.299832 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:37:33.299832 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:37:33.299832 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:37:33.300655 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:37:33.300655 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:37:33.300655 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:37:33.300655 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:37:33.300655 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:37:33.300655 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:37:33.300655 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:37:33.300655 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:37:33.300655 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:37:33.300655 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:37:33.300655 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:37:33.300655 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:37:33.300655 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 21/49] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 3 12:37:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:37:33.306175 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d8627-fb95-438d-bf7e-a562a2764832 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:33.326030 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d34de-f539-47ac-9d67-9b08867db869 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:33.326320 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d34de-f539-47ac-9d67-9b08867db869 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:33.326646 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d34de-f539-47ac-9d67-9b08867db869 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:33.328006 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 22/50] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:37:33.332946 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64d93e-d817-4f56-a360-f7114d7b2a98 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:33.333237 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64d93e-d817-4f56-a360-f7114d7b2a98 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:33.333541 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64d93e-d817-4f56-a360-f7114d7b2a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:33.351917 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-cf64d93e-d817-4f56-a360-f7114d7b2a98 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:33.353457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-cf64d93e-d817-4f56-a360-f7114d7b2a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:33.408406 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d8627-fb95-438d-bf7e-a562a2764832 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:33.422215 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 23/51] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:37:33.441771 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66549d-1378-4b0c-8788-32cc8300a341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:33.442389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66549d-1378-4b0c-8788-32cc8300a341 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:33.442670 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66549d-1378-4b0c-8788-32cc8300a341 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:33.442944 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66549d-1378-4b0c-8788-32cc8300a341 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:33.443661 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66549d-1378-4b0c-8788-32cc8300a341 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:33.443962 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66549d-1378-4b0c-8788-32cc8300a341 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:33.445149 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64d93e-d817-4f56-a360-f7114d7b2a98 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:33.445349 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66549d-1378-4b0c-8788-32cc8300a341 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:33.448116 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:33.450641 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:33.455270 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 29/52] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:37:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:33.460630 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66549d-1378-4b0c-8788-32cc8300a341 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:33.545999 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64d93e-d817-4f56-a360-f7114d7b2a98 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:33.558366 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66549d-1378-4b0c-8788-32cc8300a341 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:33.579343 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4635a5f-62bd-4204-9c40-71c3b735995d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:33.579990 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4635a5f-62bd-4204-9c40-71c3b735995d None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:33.580280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4635a5f-62bd-4204-9c40-71c3b735995d None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:33.580639 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4635a5f-62bd-4204-9c40-71c3b735995d None admin] PATH_INFO: `/v3/domains/default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:33.581860 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4635a5f-62bd-4204-9c40-71c3b735995d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:33.583322 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4635a5f-62bd-4204-9c40-71c3b735995d None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:33.584961 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 24/53] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:37:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:37:33.590392 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4635a5f-62bd-4204-9c40-71c3b735995d None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:33.592407 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee7535-b996-4153-bd71-17aa2c021ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:33.593053 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee7535-b996-4153-bd71-17aa2c021ff6 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:33.593338 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee7535-b996-4153-bd71-17aa2c021ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:33.593648 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee7535-b996-4153-bd71-17aa2c021ff6 None admin] PATH_INFO: `/v3/users/813656e83c41478ab6f4c3340645651a` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:33.594828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee7535-b996-4153-bd71-17aa2c021ff6 None admin] RBAC: Authorizing `identity:get_user(user_id=813656e83c41478ab6f4c3340645651a)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:33.596262 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee7535-b996-4153-bd71-17aa2c021ff6 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:33.597896 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 30/54] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:37:33 2022] GET /identity/v3/users/813656e83c41478ab6f4c3340645651a => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:37:33.603106 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee7535-b996-4153-bd71-17aa2c021ff6 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:33.663141 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:33.668059 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:33.694597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4635a5f-62bd-4204-9c40-71c3b735995d None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:33.702899 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee7535-b996-4153-bd71-17aa2c021ff6 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:33.729094 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f162e-890a-45ac-a290-50e728fe29de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:33.729951 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f162e-890a-45ac-a290-50e728fe29de None admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:33.730247 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f162e-890a-45ac-a290-50e728fe29de None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:33.730534 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f162e-890a-45ac-a290-50e728fe29de None admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:33.731224 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f162e-890a-45ac-a290-50e728fe29de None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:33.732681 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f162e-890a-45ac-a290-50e728fe29de None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:33.735725 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8891ad-7f87-4315-a1d3-998cf4aa0745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:33.736356 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8891ad-7f87-4315-a1d3-998cf4aa0745 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:33.736638 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8891ad-7f87-4315-a1d3-998cf4aa0745 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:33.736913 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8891ad-7f87-4315-a1d3-998cf4aa0745 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:33.738087 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8891ad-7f87-4315-a1d3-998cf4aa0745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:33.739759 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8891ad-7f87-4315-a1d3-998cf4aa0745 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:33.741340 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 31/55] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:37:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:37:33.746994 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8891ad-7f87-4315-a1d3-998cf4aa0745 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:33.761182 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 25/56] 10.222.0.46 () {60 vars in 1140 bytes} [Wed Aug 3 12:37:33 2022] POST /identity/v3/projects => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:37:33.854047 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8891ad-7f87-4315-a1d3-998cf4aa0745 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:33.889948 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab3ccc-dbe0-45fb-a1df-7ba5db01cff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:33.890848 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab3ccc-dbe0-45fb-a1df-7ba5db01cff4 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:33.891133 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab3ccc-dbe0-45fb-a1df-7ba5db01cff4 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:33.891409 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab3ccc-dbe0-45fb-a1df-7ba5db01cff4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:33.892225 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab3ccc-dbe0-45fb-a1df-7ba5db01cff4 None admin] RBAC: Adding query filter params (role.id=0e57d142f86c471883fc07a89fe66ec8, scope.domain.id=default, user.id=813656e83c41478ab6f4c3340645651a) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:33.892534 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab3ccc-dbe0-45fb-a1df-7ba5db01cff4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:33.894050 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab3ccc-dbe0-45fb-a1df-7ba5db01cff4 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:33.897305 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:33.901543 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 32/57] 10.222.0.46 () {56 vars in 1322 bytes} [Wed Aug 3 12:37:33 2022] GET /identity/v3/role_assignments?user.id=813656e83c41478ab6f4c3340645651a&scope.domain.id=default&role.id=0e57d142f86c471883fc07a89fe66ec8 => generated 530 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:37:35.768811 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd40ea-0eaa-4cbb-ae7f-a4551fe5cad3 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:35.769303 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd40ea-0eaa-4cbb-ae7f-a4551fe5cad3 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:35.769385 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd40ea-0eaa-4cbb-ae7f-a4551fe5cad3 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:35.770798 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 26/58] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:37:35.775876 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc11375-2747-497f-a4bd-31dd85b07ada None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:35.776256 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc11375-2747-497f-a4bd-31dd85b07ada None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:35.776433 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc11375-2747-497f-a4bd-31dd85b07ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:35.794332 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-ddc11375-2747-497f-a4bd-31dd85b07ada None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:35.795548 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-ddc11375-2747-497f-a4bd-31dd85b07ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:35.860469 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 33/59] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:37:35.884791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd40ea-0eaa-4cbb-ae7f-a4551fe5cad3 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:35.983882 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd40ea-0eaa-4cbb-ae7f-a4551fe5cad3 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:36.006823 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:36.017630 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20df78-7600-45c6-88f6-21f18d8de50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:36.018266 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20df78-7600-45c6-88f6-21f18d8de50d None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:36.018551 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20df78-7600-45c6-88f6-21f18d8de50d None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:36.018874 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20df78-7600-45c6-88f6-21f18d8de50d None admin] PATH_INFO: `/v3/domains/default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:36.019976 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20df78-7600-45c6-88f6-21f18d8de50d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:36.021415 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20df78-7600-45c6-88f6-21f18d8de50d None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:36.023024 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 27/60] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:37:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:36.028449 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc11375-2747-497f-a4bd-31dd85b07ada None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:36.125910 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc11375-2747-497f-a4bd-31dd85b07ada None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:36.152834 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:36.159061 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05e1a3-4f2f-4615-9441-701dbc73d6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:36.159671 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05e1a3-4f2f-4615-9441-701dbc73d6d3 None admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:36.159952 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05e1a3-4f2f-4615-9441-701dbc73d6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:36.160227 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05e1a3-4f2f-4615-9441-701dbc73d6d3 None admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:36.160914 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a05e1a3-4f2f-4615-9441-701dbc73d6d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:36.162389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a05e1a3-4f2f-4615-9441-701dbc73d6d3 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:36.188748 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 34/61] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Aug 3 12:37:36 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:37:39.350160 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea19b8a-0ecb-45c8-bf55-83971cb57292 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:39.350659 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea19b8a-0ecb-45c8-bf55-83971cb57292 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:39.350761 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea19b8a-0ecb-45c8-bf55-83971cb57292 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:39.352104 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 28/62] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:37:39.367826 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a4625-2906-46bc-86c5-9d7d6772e74d None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:39.368739 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a4625-2906-46bc-86c5-9d7d6772e74d None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:39.369297 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a4625-2906-46bc-86c5-9d7d6772e74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:39.398634 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-039a4625-2906-46bc-86c5-9d7d6772e74d None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:39.400185 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-039a4625-2906-46bc-86c5-9d7d6772e74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:39.490374 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 35/63] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:37:39.505019 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56047c4d-9288-464a-aecb-1c009f43276a None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:39.505708 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56047c4d-9288-464a-aecb-1c009f43276a None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:39.506218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56047c4d-9288-464a-aecb-1c009f43276a None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:39.507833 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 29/64] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:37:39.513126 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac194d3-063f-423d-9fb9-88f3eb4019aa None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:39.513670 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac194d3-063f-423d-9fb9-88f3eb4019aa None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:39.515949 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac194d3-063f-423d-9fb9-88f3eb4019aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:39.525780 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56047c4d-9288-464a-aecb-1c009f43276a None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:39.564607 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-5ac194d3-063f-423d-9fb9-88f3eb4019aa None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:39.574630 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-5ac194d3-063f-423d-9fb9-88f3eb4019aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:39.718906 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 36/65] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:37:39.720499 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a49ee4-a3a5-4b75-9db5-c04416633364 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:39.720954 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a49ee4-a3a5-4b75-9db5-c04416633364 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:39.721380 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a49ee4-a3a5-4b75-9db5-c04416633364 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:39.722812 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 37/66] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:37:39.725330 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2341f-9c37-4489-8c8b-79c372019ba7 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:39.725783 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2341f-9c37-4489-8c8b-79c372019ba7 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:39.726210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2341f-9c37-4489-8c8b-79c372019ba7 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:39.727604 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 38/67] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:37:39.737545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62a877-8f89-4ac9-9a2b-12ca3061da99 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:39.737545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62a877-8f89-4ac9-9a2b-12ca3061da99 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:39.737545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62a877-8f89-4ac9-9a2b-12ca3061da99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:39.741731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56047c4d-9288-464a-aecb-1c009f43276a None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:39.757535 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-0f62a877-8f89-4ac9-9a2b-12ca3061da99 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:39.759207 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-0f62a877-8f89-4ac9-9a2b-12ca3061da99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:39.786826 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c003f8-f16c-471d-a4a0-d629f07c980f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:39.787645 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c003f8-f16c-471d-a4a0-d629f07c980f None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:39.788167 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c003f8-f16c-471d-a4a0-d629f07c980f None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:39.788638 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c003f8-f16c-471d-a4a0-d629f07c980f None admin] PATH_INFO: `/v3/roles/member` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:39.801536 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c003f8-f16c-471d-a4a0-d629f07c980f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:37:39.808073 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-84c003f8-f16c-471d-a4a0-d629f07c980f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:37:39.808073 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:37:39.808073 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:37:39.808073 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:37:39.808073 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:37:39.808073 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:37:39.808073 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:37:39.808073 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:37:39.808073 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:37:39.808073 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:37:39.808073 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:37:39.808073 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:37:39.808073 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:37:39.808073 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:37:39.808073 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:37:39.808073 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:37:39.809034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:37:39.809034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:37:39.809034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:37:39.809034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:37:39.809034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:37:39.809034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:37:39.809034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:37:39.809034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:37:39.809034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:37:39.809034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:37:39.809034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:37:39.809034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:37:39.809034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:37:39.809034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:37:39.809034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:37:39.809034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:37:39.809851 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:37:39.809851 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:37:39.809851 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:37:39.809851 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:37:39.809851 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:37:39.809851 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:37:39.809851 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:37:39.809851 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:37:39.809851 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:37:39.809851 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:37:39.809851 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:37:39.809851 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:37:39.813012 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 30/68] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:37:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:37:39.814788 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:39.816395 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca1f84-41b8-4c3a-acf4-613a1f40958d None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:39.817224 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca1f84-41b8-4c3a-acf4-613a1f40958d None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:39.819002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca1f84-41b8-4c3a-acf4-613a1f40958d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:39.840185 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-d4ca1f84-41b8-4c3a-acf4-613a1f40958d None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:39.842628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-d4ca1f84-41b8-4c3a-acf4-613a1f40958d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:39.861946 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 39/69] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:37:39.862951 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62a877-8f89-4ac9-9a2b-12ca3061da99 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:39.902914 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:39.940173 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 31/70] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:37:39.941436 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca1f84-41b8-4c3a-acf4-613a1f40958d None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:40.034371 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62a877-8f89-4ac9-9a2b-12ca3061da99 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:40.077089 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952b4a6-053c-48da-881c-636f3377d7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:40.077700 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952b4a6-053c-48da-881c-636f3377d7a7 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:40.077990 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952b4a6-053c-48da-881c-636f3377d7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:40.078267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952b4a6-053c-48da-881c-636f3377d7a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:40.085972 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca1f84-41b8-4c3a-acf4-613a1f40958d None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:40.092861 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9952b4a6-053c-48da-881c-636f3377d7a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:37:40.098206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-9952b4a6-053c-48da-881c-636f3377d7a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:37:40.098206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:37:40.098206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:37:40.098206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:37:40.098206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:37:40.098206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:37:40.098206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:37:40.098206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:37:40.098206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:37:40.098206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:37:40.098206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:37:40.098206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:37:40.098206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:37:40.098206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:37:40.098206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:37:40.098206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:37:40.099208 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:37:40.099208 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:37:40.099208 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:37:40.099208 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:37:40.099208 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:37:40.099208 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:37:40.099208 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:37:40.099208 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:37:40.099208 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:37:40.099208 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:37:40.099208 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:37:40.099208 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:37:40.099208 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:37:40.099208 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:37:40.099208 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:37:40.099208 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:37:40.099998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:37:40.099998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:37:40.099998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:37:40.099998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:37:40.099998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:37:40.099998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:37:40.099998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:37:40.099998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:37:40.099998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:37:40.099998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:37:40.099998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:37:40.099998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:37:40.099998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 40/71] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 3 12:37:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:37:40.100637 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952b4a6-053c-48da-881c-636f3377d7a7 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:40.129067 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3eb8b0-bbf9-4f0a-b5c6-033580f2d102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:40.129714 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3eb8b0-bbf9-4f0a-b5c6-033580f2d102 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:40.129998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3eb8b0-bbf9-4f0a-b5c6-033580f2d102 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:40.130274 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3eb8b0-bbf9-4f0a-b5c6-033580f2d102 None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:40.130999 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3eb8b0-bbf9-4f0a-b5c6-033580f2d102 None admin] RBAC: Adding query filter params (name=member) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:40.131302 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3eb8b0-bbf9-4f0a-b5c6-033580f2d102 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:40.133408 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3eb8b0-bbf9-4f0a-b5c6-033580f2d102 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:40.141920 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:40.142997 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 32/72] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 3 12:37:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:40.143953 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3eb8b0-bbf9-4f0a-b5c6-033580f2d102 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:40.197467 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:40.222220 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952b4a6-053c-48da-881c-636f3377d7a7 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:40.258645 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b37c3-c0e5-41f6-962f-e4e9011776ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:40.258856 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3eb8b0-bbf9-4f0a-b5c6-033580f2d102 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:40.259298 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b37c3-c0e5-41f6-962f-e4e9011776ad None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:40.259588 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b37c3-c0e5-41f6-962f-e4e9011776ad None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:40.259872 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b37c3-c0e5-41f6-962f-e4e9011776ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:40.272080 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b37c3-c0e5-41f6-962f-e4e9011776ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:37:40.278276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-600b37c3-c0e5-41f6-962f-e4e9011776ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:37:40.278276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:37:40.278276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:37:40.278276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:37:40.278276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:37:40.278276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:37:40.278276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:37:40.278276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:37:40.278276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:37:40.278276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:37:40.278276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:37:40.278276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:37:40.278276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:37:40.278276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:37:40.278276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:37:40.278276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:37:40.279152 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:37:40.279152 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:37:40.279152 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:37:40.279152 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:37:40.279152 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:37:40.279152 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:37:40.279152 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:37:40.279152 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:37:40.279152 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:37:40.279152 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:37:40.279152 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:37:40.279152 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:37:40.279152 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:37:40.279152 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:37:40.279152 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:37:40.279152 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:37:40.280531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:37:40.280531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:37:40.280531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:37:40.280531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:37:40.280531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:37:40.280531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:37:40.280531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:37:40.280531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:37:40.280531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:37:40.280531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:37:40.280531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:37:40.280531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:37:40.280531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 41/73] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:37:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:37:40.281665 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080aab2b-4be7-4d7b-9f1e-c69abd46d423 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:40.281665 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080aab2b-4be7-4d7b-9f1e-c69abd46d423 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:40.282002 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080aab2b-4be7-4d7b-9f1e-c69abd46d423 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:40.283285 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 42/74] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:37:40.284668 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080aab2b-4be7-4d7b-9f1e-c69abd46d423 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:40.300324 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81766a48-a43f-4f9e-b6bf-ad5c54c620d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:40.300982 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81766a48-a43f-4f9e-b6bf-ad5c54c620d7 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:40.301265 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81766a48-a43f-4f9e-b6bf-ad5c54c620d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:40.301721 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81766a48-a43f-4f9e-b6bf-ad5c54c620d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:40.313035 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81766a48-a43f-4f9e-b6bf-ad5c54c620d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:37:40.320222 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-81766a48-a43f-4f9e-b6bf-ad5c54c620d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:37:40.320222 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:37:40.320222 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:37:40.320222 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:37:40.320222 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:37:40.320222 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:37:40.320222 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:37:40.320222 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:37:40.320222 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:37:40.320222 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:37:40.320222 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:37:40.320222 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:37:40.320222 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:37:40.320222 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:37:40.320222 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:37:40.320222 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:37:40.322096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:37:40.322096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:37:40.322096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:37:40.322096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:37:40.322096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:37:40.322096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:37:40.322096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:37:40.322096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:37:40.322096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:37:40.322096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:37:40.322096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:37:40.322096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:37:40.322096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:37:40.322096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:37:40.322096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:37:40.322096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:37:40.323255 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:37:40.323255 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:37:40.323255 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:37:40.323255 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:37:40.323255 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:37:40.323255 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:37:40.323255 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:37:40.323255 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:37:40.323255 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:37:40.323255 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:37:40.323255 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:37:40.323255 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:37:40.323255 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 33/75] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 3 12:37:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:37:40.324176 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81766a48-a43f-4f9e-b6bf-ad5c54c620d7 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:40.403991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:40.411644 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080aab2b-4be7-4d7b-9f1e-c69abd46d423 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:40.432371 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81766a48-a43f-4f9e-b6bf-ad5c54c620d7 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:40.434769 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:40.445568 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3e44f-e157-449a-ac6d-0adf6dea70de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:40.446193 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3e44f-e157-449a-ac6d-0adf6dea70de None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:40.446481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3e44f-e157-449a-ac6d-0adf6dea70de None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:40.446760 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3e44f-e157-449a-ac6d-0adf6dea70de None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:40.447490 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3e44f-e157-449a-ac6d-0adf6dea70de None admin] RBAC: Adding query filter params (name=admin) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:40.447804 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3e44f-e157-449a-ac6d-0adf6dea70de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:40.449214 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3e44f-e157-449a-ac6d-0adf6dea70de None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:40.457957 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 43/76] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:37:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:40.458942 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3e44f-e157-449a-ac6d-0adf6dea70de None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:40.469638 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1da80e-f955-49de-b44d-7c3a6018f055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:40.470296 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1da80e-f955-49de-b44d-7c3a6018f055 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:40.470583 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1da80e-f955-49de-b44d-7c3a6018f055 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:40.470862 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1da80e-f955-49de-b44d-7c3a6018f055 None admin] PATH_INFO: `/v3/users/354f0ccac1cc4be991872072a6c781a0` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:40.486346 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1da80e-f955-49de-b44d-7c3a6018f055 None admin] RBAC: Authorizing `identity:get_user(user_id=354f0ccac1cc4be991872072a6c781a0)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:40.487809 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1da80e-f955-49de-b44d-7c3a6018f055 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:40.489784 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 34/77] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:37:40 2022] GET /identity/v3/users/354f0ccac1cc4be991872072a6c781a0 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:40.490941 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5ef1d-76f5-4bb5-8ae0-da4770a84229 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:40.491229 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5ef1d-76f5-4bb5-8ae0-da4770a84229 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:40.491509 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5ef1d-76f5-4bb5-8ae0-da4770a84229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:40.508779 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-5df5ef1d-76f5-4bb5-8ae0-da4770a84229 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:40.510023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-5df5ef1d-76f5-4bb5-8ae0-da4770a84229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:40.565382 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3e44f-e157-449a-ac6d-0adf6dea70de None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:40.576999 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 35/78] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:37:40.577887 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5ef1d-76f5-4bb5-8ae0-da4770a84229 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:40.601459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5bf1b-a8a8-484f-bfad-11ac8f8254cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:40.602247 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5bf1b-a8a8-484f-bfad-11ac8f8254cf None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:40.602535 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5bf1b-a8a8-484f-bfad-11ac8f8254cf None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:40.602813 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5bf1b-a8a8-484f-bfad-11ac8f8254cf None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:40.603540 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5bf1b-a8a8-484f-bfad-11ac8f8254cf None admin] RBAC: Adding query filter params (name=member) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:40.603845 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5bf1b-a8a8-484f-bfad-11ac8f8254cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:40.605240 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5bf1b-a8a8-484f-bfad-11ac8f8254cf None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:40.613609 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 44/79] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 3 12:37:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:40.614806 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5bf1b-a8a8-484f-bfad-11ac8f8254cf None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:40.636067 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:40.678788 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:40.688003 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5ef1d-76f5-4bb5-8ae0-da4770a84229 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:40.714326 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5bf1b-a8a8-484f-bfad-11ac8f8254cf None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:40.721675 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8a602-43e4-47d5-b30a-dda867922991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:40.722306 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8a602-43e4-47d5-b30a-dda867922991 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:40.722595 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8a602-43e4-47d5-b30a-dda867922991 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:40.722876 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8a602-43e4-47d5-b30a-dda867922991 None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:40.723647 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8a602-43e4-47d5-b30a-dda867922991 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:40.723961 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8a602-43e4-47d5-b30a-dda867922991 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:40.725354 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8a602-43e4-47d5-b30a-dda867922991 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:40.734123 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 36/80] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:37:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:40.735704 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8a602-43e4-47d5-b30a-dda867922991 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:40.750023 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5421a0af-0458-419f-a1f7-c3ef240abff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:40.750688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5421a0af-0458-419f-a1f7-c3ef240abff1 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:40.750975 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5421a0af-0458-419f-a1f7-c3ef240abff1 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:40.751255 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5421a0af-0458-419f-a1f7-c3ef240abff1 None admin] PATH_INFO: `/v3/users/813656e83c41478ab6f4c3340645651a` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:40.752430 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5421a0af-0458-419f-a1f7-c3ef240abff1 None admin] RBAC: Authorizing `identity:get_user(user_id=813656e83c41478ab6f4c3340645651a)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:40.753936 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5421a0af-0458-419f-a1f7-c3ef240abff1 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:40.755557 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 45/81] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:37:40 2022] GET /identity/v3/users/813656e83c41478ab6f4c3340645651a => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:40.756321 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5421a0af-0458-419f-a1f7-c3ef240abff1 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:40.837943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8a602-43e4-47d5-b30a-dda867922991 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:40.843680 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:40.856482 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5421a0af-0458-419f-a1f7-c3ef240abff1 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:40.870877 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1fbe8-38dc-4843-aa25-a8761c8d8eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:40.871500 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1fbe8-38dc-4843-aa25-a8761c8d8eda None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:40.871784 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1fbe8-38dc-4843-aa25-a8761c8d8eda None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:40.872064 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1fbe8-38dc-4843-aa25-a8761c8d8eda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:40.891168 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607432d-a57c-4807-9b95-239c3e2b33eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:40.891808 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607432d-a57c-4807-9b95-239c3e2b33eb None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:40.892093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607432d-a57c-4807-9b95-239c3e2b33eb None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:40.892371 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607432d-a57c-4807-9b95-239c3e2b33eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:40.893546 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2607432d-a57c-4807-9b95-239c3e2b33eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:40.895013 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2607432d-a57c-4807-9b95-239c3e2b33eb None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:40.896456 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:40.896632 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 46/82] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:37:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:40.897384 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607432d-a57c-4807-9b95-239c3e2b33eb None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:40.945192 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1fbe8-38dc-4843-aa25-a8761c8d8eda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:40.946640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1fbe8-38dc-4843-aa25-a8761c8d8eda None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:40.994712 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607432d-a57c-4807-9b95-239c3e2b33eb None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:41.028144 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca198690-20ee-42e6-8eb1-8755f31d0dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:41.028866 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca198690-20ee-42e6-8eb1-8755f31d0dc0 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:41.029159 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca198690-20ee-42e6-8eb1-8755f31d0dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:41.029483 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca198690-20ee-42e6-8eb1-8755f31d0dc0 None admin] PATH_INFO: `/v3/users/354f0ccac1cc4be991872072a6c781a0` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:41.030696 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca198690-20ee-42e6-8eb1-8755f31d0dc0 None admin] RBAC: Authorizing `identity:get_user(user_id=354f0ccac1cc4be991872072a6c781a0)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:41.032156 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca198690-20ee-42e6-8eb1-8755f31d0dc0 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:41.033833 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 47/83] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:37:40 2022] GET /identity/v3/users/354f0ccac1cc4be991872072a6c781a0 => generated 275 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:41.034596 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca198690-20ee-42e6-8eb1-8755f31d0dc0 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:41.050739 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 37/84] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:37:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:37:41.051868 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1fbe8-38dc-4843-aa25-a8761c8d8eda None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:41.059309 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:41.106731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:41.137075 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca198690-20ee-42e6-8eb1-8755f31d0dc0 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:41.153553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1fbe8-38dc-4843-aa25-a8761c8d8eda None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:41.171625 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986488c-a464-4f6f-8c84-a75eb04b023c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:41.172264 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986488c-a464-4f6f-8c84-a75eb04b023c None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:41.172551 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986488c-a464-4f6f-8c84-a75eb04b023c None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:41.172834 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986488c-a464-4f6f-8c84-a75eb04b023c None admin] PATH_INFO: `/v3/users/354f0ccac1cc4be991872072a6c781a0` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:41.174418 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986488c-a464-4f6f-8c84-a75eb04b023c None admin] RBAC: Authorizing `identity:get_user(user_id=354f0ccac1cc4be991872072a6c781a0)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:41.175868 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986488c-a464-4f6f-8c84-a75eb04b023c None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:41.177480 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 48/85] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:37:41 2022] GET /identity/v3/users/354f0ccac1cc4be991872072a6c781a0 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:41.178318 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986488c-a464-4f6f-8c84-a75eb04b023c None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:41.192044 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33bef4-189f-4083-9baf-45840600d8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:41.192669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33bef4-189f-4083-9baf-45840600d8bd None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:41.192961 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33bef4-189f-4083-9baf-45840600d8bd None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:41.193241 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33bef4-189f-4083-9baf-45840600d8bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:41.261637 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab33bef4-189f-4083-9baf-45840600d8bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:41.263112 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab33bef4-189f-4083-9baf-45840600d8bd None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:41.268594 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:41.281003 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986488c-a464-4f6f-8c84-a75eb04b023c None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:41.314848 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd3ffe-044c-4b15-bdc4-d686a9c3da05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:41.315499 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd3ffe-044c-4b15-bdc4-d686a9c3da05 None admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:41.315758 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd3ffe-044c-4b15-bdc4-d686a9c3da05 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:41.316041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd3ffe-044c-4b15-bdc4-d686a9c3da05 None admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:41.316736 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd3ffe-044c-4b15-bdc4-d686a9c3da05 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:41.318231 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd3ffe-044c-4b15-bdc4-d686a9c3da05 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:41.321855 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:41.339686 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 49/86] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Aug 3 12:37:41 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:37:41.340519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd3ffe-044c-4b15-bdc4-d686a9c3da05 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:41.371909 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 38/87] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:37:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:37:41.373867 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33bef4-189f-4083-9baf-45840600d8bd None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:41.467834 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd3ffe-044c-4b15-bdc4-d686a9c3da05 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:41.495307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33bef4-189f-4083-9baf-45840600d8bd None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:41.506248 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954fc01-a76e-4254-8ffc-24336d9c5a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:41.506634 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954fc01-a76e-4254-8ffc-24336d9c5a42 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:41.507353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954fc01-a76e-4254-8ffc-24336d9c5a42 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:41.507353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954fc01-a76e-4254-8ffc-24336d9c5a42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:41.527233 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:41.535773 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce426008-d700-4615-b8c2-3aeae0de24dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:41.535773 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce426008-d700-4615-b8c2-3aeae0de24dc None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:41.535773 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce426008-d700-4615-b8c2-3aeae0de24dc None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:41.536046 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce426008-d700-4615-b8c2-3aeae0de24dc None admin] PATH_INFO: `/v3/projects/7ca4d22998dd43599a48acb9cb75b454` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:41.538490 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce426008-d700-4615-b8c2-3aeae0de24dc None admin] RBAC: Authorizing `identity:get_project(project_id=7ca4d22998dd43599a48acb9cb75b454)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:41.539682 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce426008-d700-4615-b8c2-3aeae0de24dc None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:41.540619 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 39/88] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:37:41 2022] GET /identity/v3/projects/7ca4d22998dd43599a48acb9cb75b454 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:41.541220 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce426008-d700-4615-b8c2-3aeae0de24dc None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:41.573364 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:41.592985 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954fc01-a76e-4254-8ffc-24336d9c5a42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:41.594618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954fc01-a76e-4254-8ffc-24336d9c5a42 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:41.675233 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce426008-d700-4615-b8c2-3aeae0de24dc None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:41.723814 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16db22-f317-4270-95ee-d4ba44e2612c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:41.724781 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16db22-f317-4270-95ee-d4ba44e2612c None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:41.725477 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16db22-f317-4270-95ee-d4ba44e2612c None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:41.728205 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 50/89] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:37:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:37:41.728768 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16db22-f317-4270-95ee-d4ba44e2612c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:41.730544 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954fc01-a76e-4254-8ffc-24336d9c5a42 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:41.786284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:41.821368 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c16db22-f317-4270-95ee-d4ba44e2612c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:41.822921 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c16db22-f317-4270-95ee-d4ba44e2612c None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:41.843790 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954fc01-a76e-4254-8ffc-24336d9c5a42 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:41.849971 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:41.881642 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1fa353-e11e-49f4-a77f-d1e99cd06949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:41.882692 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1fa353-e11e-49f4-a77f-d1e99cd06949 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:41.883205 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1fa353-e11e-49f4-a77f-d1e99cd06949 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:41.883700 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1fa353-e11e-49f4-a77f-d1e99cd06949 None admin] PATH_INFO: `/v3/projects/7ca4d22998dd43599a48acb9cb75b454` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:41.885117 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1fa353-e11e-49f4-a77f-d1e99cd06949 None admin] RBAC: Authorizing `identity:get_project(project_id=7ca4d22998dd43599a48acb9cb75b454)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:41.886886 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1fa353-e11e-49f4-a77f-d1e99cd06949 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:41.888815 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 51/90] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:37:41 2022] GET /identity/v3/projects/7ca4d22998dd43599a48acb9cb75b454 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:41.890413 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1fa353-e11e-49f4-a77f-d1e99cd06949 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:41.951183 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 40/91] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:37:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:37:41.953573 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16db22-f317-4270-95ee-d4ba44e2612c None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:42.026383 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1fa353-e11e-49f4-a77f-d1e99cd06949 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:42.049734 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:42.075667 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ca93c-0c22-4f56-b709-a99cde182cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:42.076550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ca93c-0c22-4f56-b709-a99cde182cc0 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:42.076921 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ca93c-0c22-4f56-b709-a99cde182cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:42.077339 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ca93c-0c22-4f56-b709-a99cde182cc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:42.078300 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ca93c-0c22-4f56-b709-a99cde182cc0 None admin] RBAC: Adding query filter params (role.id=e1c6e31e9e944b23bc9ba6b0099d3376, scope.project.id=7ca4d22998dd43599a48acb9cb75b454, user.id=354f0ccac1cc4be991872072a6c781a0) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:42.078687 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ca93c-0c22-4f56-b709-a99cde182cc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:42.080253 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ca93c-0c22-4f56-b709-a99cde182cc0 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:42.083588 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16db22-f317-4270-95ee-d4ba44e2612c None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:42.086643 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 52/92] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:37:41 2022] GET /identity/v3/role_assignments?user.id=354f0ccac1cc4be991872072a6c781a0&scope.project.id=7ca4d22998dd43599a48acb9cb75b454&role.id=e1c6e31e9e944b23bc9ba6b0099d3376 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:42.087668 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ca93c-0c22-4f56-b709-a99cde182cc0 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:42.110959 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:42.126765 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d7f1b-6fb2-4cf7-94cb-0790e4d3eb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:42.127527 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d7f1b-6fb2-4cf7-94cb-0790e4d3eb96 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:42.127816 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d7f1b-6fb2-4cf7-94cb-0790e4d3eb96 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:42.128202 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d7f1b-6fb2-4cf7-94cb-0790e4d3eb96 None admin] PATH_INFO: `/v3/projects/e0bd6d9a1b9340338db00adb65d81b83` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:42.129378 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d7f1b-6fb2-4cf7-94cb-0790e4d3eb96 None admin] RBAC: Authorizing `identity:get_project(project_id=e0bd6d9a1b9340338db00adb65d81b83)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:42.130875 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d7f1b-6fb2-4cf7-94cb-0790e4d3eb96 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:42.132555 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 41/93] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:37:41 2022] GET /identity/v3/projects/e0bd6d9a1b9340338db00adb65d81b83 => generated 312 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:42.133436 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d7f1b-6fb2-4cf7-94cb-0790e4d3eb96 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:42.200706 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ca93c-0c22-4f56-b709-a99cde182cc0 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:42.240098 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e2dc3-f88f-4bb1-9d78-2c7f4d6ea43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:42.240803 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e2dc3-f88f-4bb1-9d78-2c7f4d6ea43d None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:42.241098 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e2dc3-f88f-4bb1-9d78-2c7f4d6ea43d None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:42.241381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e2dc3-f88f-4bb1-9d78-2c7f4d6ea43d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:42.242291 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e2dc3-f88f-4bb1-9d78-2c7f4d6ea43d None admin] RBAC: Adding query filter params (role.id=0e57d142f86c471883fc07a89fe66ec8, scope.project.id=7ca4d22998dd43599a48acb9cb75b454, user.id=813656e83c41478ab6f4c3340645651a) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:42.242608 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e2dc3-f88f-4bb1-9d78-2c7f4d6ea43d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:42.244158 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e2dc3-f88f-4bb1-9d78-2c7f4d6ea43d None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:42.251216 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 53/94] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:37:42 2022] GET /identity/v3/role_assignments?user.id=813656e83c41478ab6f4c3340645651a&scope.project.id=7ca4d22998dd43599a48acb9cb75b454&role.id=0e57d142f86c471883fc07a89fe66ec8 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:42.252095 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e2dc3-f88f-4bb1-9d78-2c7f4d6ea43d None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:42.253281 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d7f1b-6fb2-4cf7-94cb-0790e4d3eb96 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:42.315730 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:42.320555 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4f50c-2607-496a-9b5b-7cd537daf337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:42.321225 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4f50c-2607-496a-9b5b-7cd537daf337 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:42.321524 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4f50c-2607-496a-9b5b-7cd537daf337 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:42.321823 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4f50c-2607-496a-9b5b-7cd537daf337 None admin] PATH_INFO: `/v3/projects/7ca4d22998dd43599a48acb9cb75b454` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:42.323020 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4f50c-2607-496a-9b5b-7cd537daf337 None admin] RBAC: Authorizing `identity:get_project(project_id=7ca4d22998dd43599a48acb9cb75b454)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:42.324673 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4f50c-2607-496a-9b5b-7cd537daf337 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:42.336270 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 42/95] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:37:42 2022] GET /identity/v3/projects/7ca4d22998dd43599a48acb9cb75b454 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:42.353629 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4f50c-2607-496a-9b5b-7cd537daf337 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:42.397600 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e2dc3-f88f-4bb1-9d78-2c7f4d6ea43d None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:42.435197 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4df635-7bf5-441b-b3b0-f16c00839fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:42.436490 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4df635-7bf5-441b-b3b0-f16c00839fa0 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:42.436865 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4df635-7bf5-441b-b3b0-f16c00839fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:42.437269 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4df635-7bf5-441b-b3b0-f16c00839fa0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:42.438181 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4df635-7bf5-441b-b3b0-f16c00839fa0 None admin] RBAC: Adding query filter params (role.id=e1c6e31e9e944b23bc9ba6b0099d3376, scope.project.id=e0bd6d9a1b9340338db00adb65d81b83, user.id=354f0ccac1cc4be991872072a6c781a0) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:42.438503 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4df635-7bf5-441b-b3b0-f16c00839fa0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:42.439964 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4df635-7bf5-441b-b3b0-f16c00839fa0 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:42.446158 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 54/96] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:37:42 2022] GET /identity/v3/role_assignments?user.id=354f0ccac1cc4be991872072a6c781a0&scope.project.id=e0bd6d9a1b9340338db00adb65d81b83&role.id=e1c6e31e9e944b23bc9ba6b0099d3376 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:42.457920 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:42.509048 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4f50c-2607-496a-9b5b-7cd537daf337 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:42.549032 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8531c052-747d-4419-873c-d55a169d3d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:42.549754 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531c052-747d-4419-873c-d55a169d3d7d None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:42.550043 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531c052-747d-4419-873c-d55a169d3d7d None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:42.550324 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531c052-747d-4419-873c-d55a169d3d7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:42.551146 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8531c052-747d-4419-873c-d55a169d3d7d None admin] RBAC: Adding query filter params (role.id=1f3ee786628740418d65c827bc64a9b5, scope.project.id=7ca4d22998dd43599a48acb9cb75b454, user.id=354f0ccac1cc4be991872072a6c781a0) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:42.551461 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8531c052-747d-4419-873c-d55a169d3d7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:42.553047 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8531c052-747d-4419-873c-d55a169d3d7d None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:42.563868 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 43/97] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:37:42 2022] GET /identity/v3/role_assignments?user.id=354f0ccac1cc4be991872072a6c781a0&scope.project.id=7ca4d22998dd43599a48acb9cb75b454&role.id=1f3ee786628740418d65c827bc64a9b5 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:37:44.396541 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1070b-a7e0-47d3-9716-818066280ed5 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:44.397220 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1070b-a7e0-47d3-9716-818066280ed5 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:44.397220 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1070b-a7e0-47d3-9716-818066280ed5 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:44.398579 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 55/98] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:37:44.403811 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbec3a-bf18-47c6-b59c-69e7656013f9 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:44.404369 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbec3a-bf18-47c6-b59c-69e7656013f9 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:44.405052 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbec3a-bf18-47c6-b59c-69e7656013f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:44.424335 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-d6bbec3a-bf18-47c6-b59c-69e7656013f9 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:44.425581 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-d6bbec3a-bf18-47c6-b59c-69e7656013f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:44.498333 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 44/99] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:37:44.521303 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1070b-a7e0-47d3-9716-818066280ed5 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:44.636097 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1070b-a7e0-47d3-9716-818066280ed5 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:44.644434 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5256642-4fa1-4eda-be92-a9daa22db067 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:44.644724 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5256642-4fa1-4eda-be92-a9daa22db067 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:44.645004 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5256642-4fa1-4eda-be92-a9daa22db067 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:44.646643 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 45/100] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:37:44.653622 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:44.660588 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878909c-566f-4e84-8315-f63a6465d9d5 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:44.660875 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878909c-566f-4e84-8315-f63a6465d9d5 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:44.661134 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878909c-566f-4e84-8315-f63a6465d9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:44.692591 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-7878909c-566f-4e84-8315-f63a6465d9d5 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:44.693841 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-7878909c-566f-4e84-8315-f63a6465d9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:44.713758 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c38705-030c-4a9b-b21e-978627f4c17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:44.714415 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c38705-030c-4a9b-b21e-978627f4c17e None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:44.714703 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c38705-030c-4a9b-b21e-978627f4c17e None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:44.714980 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c38705-030c-4a9b-b21e-978627f4c17e None admin] PATH_INFO: `/v3/domains/default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:44.719101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c38705-030c-4a9b-b21e-978627f4c17e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:44.720564 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c38705-030c-4a9b-b21e-978627f4c17e None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:44.727013 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 56/101] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:37:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:44.752241 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c38705-030c-4a9b-b21e-978627f4c17e None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:44.795802 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:44.820720 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 46/102] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 03 12:37:44.845520 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878909c-566f-4e84-8315-f63a6465d9d5 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:44.913160 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c38705-030c-4a9b-b21e-978627f4c17e None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:44.955474 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878909c-566f-4e84-8315-f63a6465d9d5 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:44.965178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b2199-28bf-4b94-a7a4-5935b4f8fe2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:44.966180 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b2199-28bf-4b94-a7a4-5935b4f8fe2f None admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:44.966666 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b2199-28bf-4b94-a7a4-5935b4f8fe2f None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:44.967382 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b2199-28bf-4b94-a7a4-5935b4f8fe2f None admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:44.968292 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b2199-28bf-4b94-a7a4-5935b4f8fe2f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:44.969982 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b2199-28bf-4b94-a7a4-5935b4f8fe2f None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:44.993675 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a3dcd-15b8-4731-8f95-0e50b6551894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:44.994328 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a3dcd-15b8-4731-8f95-0e50b6551894 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:44.994615 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a3dcd-15b8-4731-8f95-0e50b6551894 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:44.994892 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a3dcd-15b8-4731-8f95-0e50b6551894 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:45.007780 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a3dcd-15b8-4731-8f95-0e50b6551894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:37:45.014306 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-884a3dcd-15b8-4731-8f95-0e50b6551894 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:37:45.014306 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:37:45.014306 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:37:45.014306 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:37:45.014306 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:37:45.014306 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:37:45.014306 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:37:45.014306 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:37:45.014306 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:37:45.014306 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:37:45.014306 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:37:45.014306 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:37:45.014306 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:37:45.014306 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:37:45.014306 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:37:45.014306 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:37:45.015267 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:37:45.015267 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:37:45.015267 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:37:45.015267 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:37:45.015267 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:37:45.015267 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:37:45.015267 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:37:45.015267 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:37:45.015267 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:37:45.015267 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:37:45.015267 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:37:45.015267 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:37:45.015267 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:37:45.015267 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:37:45.015267 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:37:45.015267 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:37:45.016427 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:37:45.016427 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:37:45.016427 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:37:45.016427 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:37:45.016427 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:37:45.016427 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:37:45.016427 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:37:45.016427 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:37:45.016427 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:37:45.016427 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:37:45.016427 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:37:45.016427 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:37:45.016427 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 47/103] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:37:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:37:45.021971 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a3dcd-15b8-4731-8f95-0e50b6551894 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:45.024078 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 57/104] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Aug 3 12:37:44 2022] POST /identity/v3/projects => generated 302 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:37:45.074868 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:45.096671 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c3645-e80e-4b7f-a4d7-4c1e800847bf None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:45.097288 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c3645-e80e-4b7f-a4d7-4c1e800847bf None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:45.097812 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c3645-e80e-4b7f-a4d7-4c1e800847bf None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:45.100833 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 58/105] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:37:45.110978 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136ebe1-de66-400d-bf33-726cb87f149a None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:45.111609 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136ebe1-de66-400d-bf33-726cb87f149a None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:45.112083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136ebe1-de66-400d-bf33-726cb87f149a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:45.143379 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a3dcd-15b8-4731-8f95-0e50b6551894 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:45.149956 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-0136ebe1-de66-400d-bf33-726cb87f149a None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:45.151200 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-0136ebe1-de66-400d-bf33-726cb87f149a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:45.183672 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3e191-20d5-4d52-a8e9-977b48ff97ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:45.184352 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3e191-20d5-4d52-a8e9-977b48ff97ca None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:45.184641 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3e191-20d5-4d52-a8e9-977b48ff97ca None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:45.184925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3e191-20d5-4d52-a8e9-977b48ff97ca None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:45.185949 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af3e191-20d5-4d52-a8e9-977b48ff97ca None admin] RBAC: Adding query filter params (name=reader) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:45.186406 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af3e191-20d5-4d52-a8e9-977b48ff97ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:45.187834 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af3e191-20d5-4d52-a8e9-977b48ff97ca None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:45.197423 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 48/106] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 3 12:37:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:37:45.203349 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6657158-6b4f-4385-a09e-0a16866f8954 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:45.203654 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6657158-6b4f-4385-a09e-0a16866f8954 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:45.203925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6657158-6b4f-4385-a09e-0a16866f8954 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:45.205403 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 49/107] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:37:45.207360 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6657158-6b4f-4385-a09e-0a16866f8954 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:45.208680 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:45.297895 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 59/108] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:37:45.299623 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67287a65-4ad3-436f-a4cd-53c554c24bf3 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:45.300110 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67287a65-4ad3-436f-a4cd-53c554c24bf3 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:45.300625 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67287a65-4ad3-436f-a4cd-53c554c24bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:45.320337 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-67287a65-4ad3-436f-a4cd-53c554c24bf3 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:45.321886 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-67287a65-4ad3-436f-a4cd-53c554c24bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:45.322882 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6657158-6b4f-4385-a09e-0a16866f8954 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:45.325660 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:45.360577 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bba8f-c522-47fb-83b1-1fac99c009cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:45.361594 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bba8f-c522-47fb-83b1-1fac99c009cb None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:45.362145 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bba8f-c522-47fb-83b1-1fac99c009cb None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:45.362683 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bba8f-c522-47fb-83b1-1fac99c009cb None admin] PATH_INFO: `/v3/users/3b8f2921e1d6477ab8cc516667e9c309` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:45.378029 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595bba8f-c522-47fb-83b1-1fac99c009cb None admin] RBAC: Authorizing `identity:get_user(user_id=3b8f2921e1d6477ab8cc516667e9c309)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:45.379724 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595bba8f-c522-47fb-83b1-1fac99c009cb None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:45.381691 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 50/109] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:37:45 2022] GET /identity/v3/users/3b8f2921e1d6477ab8cc516667e9c309 => generated 289 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:37:45.382693 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bba8f-c522-47fb-83b1-1fac99c009cb None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:45.409192 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 60/110] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:37:45.410879 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67287a65-4ad3-436f-a4cd-53c554c24bf3 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:45.492853 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bba8f-c522-47fb-83b1-1fac99c009cb None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:45.512472 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:45.528440 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67287a65-4ad3-436f-a4cd-53c554c24bf3 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:45.540067 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0770b0-120a-4686-b748-45a091ccded5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:45.541255 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0770b0-120a-4686-b748-45a091ccded5 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:45.541672 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0770b0-120a-4686-b748-45a091ccded5 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:45.542068 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0770b0-120a-4686-b748-45a091ccded5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:45.556472 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0770b0-120a-4686-b748-45a091ccded5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:37:45.564803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-4a0770b0-120a-4686-b748-45a091ccded5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:37:45.564803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:37:45.564803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:37:45.564803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:37:45.564803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:37:45.564803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:37:45.564803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:37:45.564803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:37:45.564803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:37:45.564803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:37:45.564803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:37:45.564803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:37:45.564803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:37:45.564803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:37:45.564803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:37:45.564803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:37:45.565713 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:37:45.565713 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:37:45.565713 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:37:45.565713 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:37:45.565713 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:37:45.565713 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:37:45.565713 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:37:45.565713 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:37:45.565713 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:37:45.565713 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:37:45.565713 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:37:45.565713 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:37:45.565713 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:37:45.565713 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:37:45.565713 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:37:45.565713 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:37:45.566475 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:37:45.566475 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:37:45.566475 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:37:45.566475 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:37:45.566475 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:37:45.566475 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:37:45.566475 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:37:45.566475 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:37:45.566475 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:37:45.566475 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:37:45.566475 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:37:45.566475 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:37:45.566475 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 51/111] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:37:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:37:45.567110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0770b0-120a-4686-b748-45a091ccded5 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:45.570373 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8065e3-a8e5-4835-8119-75fcaebed4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:45.571228 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8065e3-a8e5-4835-8119-75fcaebed4b2 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:45.571689 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8065e3-a8e5-4835-8119-75fcaebed4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:45.572162 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8065e3-a8e5-4835-8119-75fcaebed4b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:45.595051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:45.663529 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8065e3-a8e5-4835-8119-75fcaebed4b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:45.665271 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8065e3-a8e5-4835-8119-75fcaebed4b2 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:45.697549 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0770b0-120a-4686-b748-45a091ccded5 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:45.735406 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8e3cf-782e-4703-9f91-b72fa391ec44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:45.736228 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8e3cf-782e-4703-9f91-b72fa391ec44 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:45.736619 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8e3cf-782e-4703-9f91-b72fa391ec44 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:45.737124 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8e3cf-782e-4703-9f91-b72fa391ec44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:45.749692 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8e3cf-782e-4703-9f91-b72fa391ec44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:37:45.754669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-b1e8e3cf-782e-4703-9f91-b72fa391ec44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:37:45.754669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:37:45.754669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:37:45.754669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:37:45.754669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:37:45.754669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:37:45.754669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:37:45.754669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:37:45.754669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:37:45.754669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:37:45.754669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:37:45.754669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:37:45.754669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:37:45.754669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:37:45.754669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:37:45.754669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:37:45.755689 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:37:45.755689 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:37:45.755689 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:37:45.755689 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:37:45.755689 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:37:45.755689 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:37:45.755689 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:37:45.755689 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:37:45.755689 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:37:45.755689 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:37:45.755689 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:37:45.755689 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:37:45.755689 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:37:45.755689 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:37:45.755689 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:37:45.755689 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:37:45.756477 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:37:45.756477 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:37:45.756477 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:37:45.756477 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:37:45.756477 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:37:45.756477 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:37:45.756477 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:37:45.756477 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:37:45.756477 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:37:45.756477 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:37:45.756477 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:37:45.756477 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:37:45.756477 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 52/112] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 3 12:37:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:37:45.757132 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40179225-214e-4668-91d6-ffc0273f2eeb None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:45.757373 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40179225-214e-4668-91d6-ffc0273f2eeb None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:45.757686 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40179225-214e-4668-91d6-ffc0273f2eeb None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:45.758949 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 53/113] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:37:45.759642 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40179225-214e-4668-91d6-ffc0273f2eeb None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:45.790449 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:45.805867 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 61/114] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:37:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:37:45.812063 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5916bb1-1075-4cff-91fd-e88c80b788bc None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:45.812359 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5916bb1-1075-4cff-91fd-e88c80b788bc None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:45.812788 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5916bb1-1075-4cff-91fd-e88c80b788bc None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:45.814318 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 62/115] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:37:45.815024 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5916bb1-1075-4cff-91fd-e88c80b788bc None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:45.849047 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:45.869607 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40179225-214e-4668-91d6-ffc0273f2eeb None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:45.906822 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010c81c-4885-4c4b-9b83-217f99496c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:45.907487 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010c81c-4885-4c4b-9b83-217f99496c47 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:45.907758 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010c81c-4885-4c4b-9b83-217f99496c47 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:45.908037 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010c81c-4885-4c4b-9b83-217f99496c47 None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:45.908759 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010c81c-4885-4c4b-9b83-217f99496c47 None admin] RBAC: Adding query filter params (name=member) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:45.909072 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010c81c-4885-4c4b-9b83-217f99496c47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:45.910510 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010c81c-4885-4c4b-9b83-217f99496c47 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:45.919209 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 54/116] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 3 12:37:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:45.920844 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932b87c-e190-43d2-ab70-8bc80982f829 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:45.921138 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932b87c-e190-43d2-ab70-8bc80982f829 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:45.921421 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932b87c-e190-43d2-ab70-8bc80982f829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:45.932445 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5916bb1-1075-4cff-91fd-e88c80b788bc None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:45.939892 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-4932b87c-e190-43d2-ab70-8bc80982f829 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:45.941110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-4932b87c-e190-43d2-ab70-8bc80982f829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:45.968663 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18cc58-a9d0-47c9-99a9-40a5f919a1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:45.969281 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18cc58-a9d0-47c9-99a9-40a5f919a1f5 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:45.969594 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18cc58-a9d0-47c9-99a9-40a5f919a1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:45.969870 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18cc58-a9d0-47c9-99a9-40a5f919a1f5 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:45.970596 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18cc58-a9d0-47c9-99a9-40a5f919a1f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:45.970901 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18cc58-a9d0-47c9-99a9-40a5f919a1f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:45.972310 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18cc58-a9d0-47c9-99a9-40a5f919a1f5 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:45.987480 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 63/117] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:37:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:45.987480 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18cc58-a9d0-47c9-99a9-40a5f919a1f5 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:46.017917 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 55/118] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:37:46.031376 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31979beb-28f0-4229-8fb4-0943ba70b713 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:46.031540 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31979beb-28f0-4229-8fb4-0943ba70b713 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:46.031812 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31979beb-28f0-4229-8fb4-0943ba70b713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:46.038886 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:46.057201 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-31979beb-28f0-4229-8fb4-0943ba70b713 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:46.058726 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-31979beb-28f0-4229-8fb4-0943ba70b713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:46.095971 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18cc58-a9d0-47c9-99a9-40a5f919a1f5 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:46.129674 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c47d1-217c-49eb-89ec-4fe5ce4bd357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:46.130244 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c47d1-217c-49eb-89ec-4fe5ce4bd357 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:46.130528 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c47d1-217c-49eb-89ec-4fe5ce4bd357 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:46.130808 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c47d1-217c-49eb-89ec-4fe5ce4bd357 None admin] PATH_INFO: `/v3/projects/7ca4d22998dd43599a48acb9cb75b454` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:46.131990 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c47d1-217c-49eb-89ec-4fe5ce4bd357 None admin] RBAC: Authorizing `identity:get_project(project_id=7ca4d22998dd43599a48acb9cb75b454)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:46.133479 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c47d1-217c-49eb-89ec-4fe5ce4bd357 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:46.140740 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 64/119] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:37:45 2022] GET /identity/v3/projects/7ca4d22998dd43599a48acb9cb75b454 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:46.140740 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c47d1-217c-49eb-89ec-4fe5ce4bd357 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:46.140950 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 56/120] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:37:46.140950 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31979beb-28f0-4229-8fb4-0943ba70b713 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:46.146589 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:46.251370 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c47d1-217c-49eb-89ec-4fe5ce4bd357 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:46.257537 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31979beb-28f0-4229-8fb4-0943ba70b713 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:46.271499 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:46.291706 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9124d3b-a645-4bd7-b3c2-507df9b9fd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:46.292448 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9124d3b-a645-4bd7-b3c2-507df9b9fd1c None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:46.292803 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9124d3b-a645-4bd7-b3c2-507df9b9fd1c None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:46.293150 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9124d3b-a645-4bd7-b3c2-507df9b9fd1c None admin] PATH_INFO: `/v3/users/354f0ccac1cc4be991872072a6c781a0` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:46.294462 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9124d3b-a645-4bd7-b3c2-507df9b9fd1c None admin] RBAC: Authorizing `identity:get_user(user_id=354f0ccac1cc4be991872072a6c781a0)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:46.296570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9124d3b-a645-4bd7-b3c2-507df9b9fd1c None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:46.302683 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 65/121] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:37:46 2022] GET /identity/v3/users/354f0ccac1cc4be991872072a6c781a0 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:46.302683 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9124d3b-a645-4bd7-b3c2-507df9b9fd1c None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:46.305952 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5db1dd-c787-40c1-bd16-712d73b27abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:46.306922 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5db1dd-c787-40c1-bd16-712d73b27abb None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:46.307026 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5db1dd-c787-40c1-bd16-712d73b27abb None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:46.307310 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5db1dd-c787-40c1-bd16-712d73b27abb None admin] PATH_INFO: `/v3/users/813656e83c41478ab6f4c3340645651a` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:46.308551 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5db1dd-c787-40c1-bd16-712d73b27abb None admin] RBAC: Authorizing `identity:get_user(user_id=813656e83c41478ab6f4c3340645651a)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:46.310058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5db1dd-c787-40c1-bd16-712d73b27abb None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:46.313006 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 57/122] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:37:46 2022] GET /identity/v3/users/813656e83c41478ab6f4c3340645651a => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:46.314115 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5db1dd-c787-40c1-bd16-712d73b27abb None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:46.390423 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:46.419204 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9124d3b-a645-4bd7-b3c2-507df9b9fd1c None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:46.424616 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5db1dd-c787-40c1-bd16-712d73b27abb None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:46.462443 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dfb3c9-3780-4342-9db3-0735c9e8a7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:46.462777 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a446a-002d-46d6-92c7-1e82af987052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:46.463122 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfb3c9-3780-4342-9db3-0735c9e8a7cf None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:46.463325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a446a-002d-46d6-92c7-1e82af987052 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:46.463417 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfb3c9-3780-4342-9db3-0735c9e8a7cf None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:46.463609 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a446a-002d-46d6-92c7-1e82af987052 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:46.463700 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfb3c9-3780-4342-9db3-0735c9e8a7cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:46.463886 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a446a-002d-46d6-92c7-1e82af987052 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:46.464697 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a446a-002d-46d6-92c7-1e82af987052 None admin] RBAC: Adding query filter params (role.id=88752d25daad459b9cc7232c4818bb30, scope.project.id=7ca4d22998dd43599a48acb9cb75b454, user.id=3b8f2921e1d6477ab8cc516667e9c309) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:46.465014 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a446a-002d-46d6-92c7-1e82af987052 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:46.466495 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a446a-002d-46d6-92c7-1e82af987052 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:46.472487 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 58/123] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:37:46 2022] GET /identity/v3/role_assignments?user.id=3b8f2921e1d6477ab8cc516667e9c309&scope.project.id=7ca4d22998dd43599a48acb9cb75b454&role.id=88752d25daad459b9cc7232c4818bb30 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:46.473293 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a446a-002d-46d6-92c7-1e82af987052 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:46.488661 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dfb3c9-3780-4342-9db3-0735c9e8a7cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:37:46.497088 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-24dfb3c9-3780-4342-9db3-0735c9e8a7cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:37:46.497088 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:37:46.497088 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:37:46.497088 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:37:46.497088 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:37:46.497088 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:37:46.497088 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:37:46.497088 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:37:46.497088 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:37:46.497088 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:37:46.497088 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:37:46.497088 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:37:46.497088 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:37:46.497088 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:37:46.497088 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:37:46.497088 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:37:46.498881 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:37:46.498881 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:37:46.498881 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:37:46.498881 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:37:46.498881 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:37:46.498881 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:37:46.498881 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:37:46.498881 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:37:46.498881 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:37:46.498881 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:37:46.498881 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:37:46.498881 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:37:46.498881 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:37:46.498881 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:37:46.498881 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:37:46.498881 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:37:46.499664 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:37:46.499664 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:37:46.499664 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:37:46.499664 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:37:46.499664 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:37:46.499664 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:37:46.499664 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:37:46.499664 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:37:46.499664 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:37:46.499664 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:37:46.499664 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:37:46.499664 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:37:46.503151 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 66/124] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:37:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:37:46.504341 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dfb3c9-3780-4342-9db3-0735c9e8a7cf None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:46.578427 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:46.623795 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a446a-002d-46d6-92c7-1e82af987052 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:46.649801 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dfb3c9-3780-4342-9db3-0735c9e8a7cf None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:46.670790 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a82737-6583-47ff-9603-172da29d0c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:46.671646 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a82737-6583-47ff-9603-172da29d0c1a None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:46.672042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a82737-6583-47ff-9603-172da29d0c1a None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:46.672825 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a82737-6583-47ff-9603-172da29d0c1a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:46.675482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:46.684764 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a82737-6583-47ff-9603-172da29d0c1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:37:46.689329 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604fb18-b603-480b-a4b0-2ac17c228f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:46.690173 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604fb18-b603-480b-a4b0-2ac17c228f3b None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:46.690599 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604fb18-b603-480b-a4b0-2ac17c228f3b None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:46.691044 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604fb18-b603-480b-a4b0-2ac17c228f3b None admin] PATH_INFO: `/v3/projects/e0bd6d9a1b9340338db00adb65d81b83` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:46.691490 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-52a82737-6583-47ff-9603-172da29d0c1a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:37:46.691490 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:37:46.691490 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:37:46.691490 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:37:46.691490 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:37:46.691490 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:37:46.691490 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:37:46.691490 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:37:46.691490 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:37:46.691490 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:37:46.691490 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:37:46.691490 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:37:46.691490 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:37:46.691490 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:37:46.691490 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:37:46.691490 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:37:46.692497 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:37:46.692497 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:37:46.692497 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:37:46.692497 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:37:46.692497 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:37:46.692497 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:37:46.692497 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:37:46.692497 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:37:46.692497 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:37:46.692497 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:37:46.692497 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:37:46.692497 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:37:46.692497 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:37:46.692497 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:37:46.692497 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:37:46.692497 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:37:46.693318 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:37:46.693318 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:37:46.693318 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:37:46.693318 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:37:46.693318 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:37:46.693318 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:37:46.693318 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:37:46.693318 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:37:46.693318 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:37:46.693318 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:37:46.693318 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:37:46.693318 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:37:46.694514 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 59/125] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 3 12:37:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:37:46.695334 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604fb18-b603-480b-a4b0-2ac17c228f3b None admin] RBAC: Authorizing `identity:get_project(project_id=e0bd6d9a1b9340338db00adb65d81b83)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:46.695621 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a82737-6583-47ff-9603-172da29d0c1a None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:46.697248 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604fb18-b603-480b-a4b0-2ac17c228f3b None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:46.699298 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 67/126] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:37:46 2022] GET /identity/v3/projects/e0bd6d9a1b9340338db00adb65d81b83 => generated 312 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:46.700349 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604fb18-b603-480b-a4b0-2ac17c228f3b None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:46.806469 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a82737-6583-47ff-9603-172da29d0c1a None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:46.811733 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604fb18-b603-480b-a4b0-2ac17c228f3b None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:46.827454 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:46.847148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35578b-1200-4a09-acf9-322571e80d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:46.848141 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35578b-1200-4a09-acf9-322571e80d8d None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:46.848565 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35578b-1200-4a09-acf9-322571e80d8d None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:46.848982 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35578b-1200-4a09-acf9-322571e80d8d None admin] PATH_INFO: `/v3/projects/7ca4d22998dd43599a48acb9cb75b454` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:46.850322 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35578b-1200-4a09-acf9-322571e80d8d None admin] RBAC: Authorizing `identity:get_project(project_id=7ca4d22998dd43599a48acb9cb75b454)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:46.851919 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35578b-1200-4a09-acf9-322571e80d8d None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:46.852584 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aebd3b5-c210-458a-b0a6-7e1c766a8007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:46.853392 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebd3b5-c210-458a-b0a6-7e1c766a8007 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:46.853812 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebd3b5-c210-458a-b0a6-7e1c766a8007 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:46.854200 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebd3b5-c210-458a-b0a6-7e1c766a8007 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:46.854440 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 60/127] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:37:46 2022] GET /identity/v3/projects/7ca4d22998dd43599a48acb9cb75b454 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:46.855102 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aebd3b5-c210-458a-b0a6-7e1c766a8007 None admin] RBAC: Adding query filter params (name=member) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:46.855511 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aebd3b5-c210-458a-b0a6-7e1c766a8007 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:46.855811 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35578b-1200-4a09-acf9-322571e80d8d None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:46.857176 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aebd3b5-c210-458a-b0a6-7e1c766a8007 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:46.871739 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 68/128] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 3 12:37:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:46.871739 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aebd3b5-c210-458a-b0a6-7e1c766a8007 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:46.932427 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:46.974463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35578b-1200-4a09-acf9-322571e80d8d None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:46.981538 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aebd3b5-c210-458a-b0a6-7e1c766a8007 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:47.011560 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58948b90-04e0-4e49-a9f3-f0dd94ea87f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:47.012172 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58948b90-04e0-4e49-a9f3-f0dd94ea87f3 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:47.012523 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58948b90-04e0-4e49-a9f3-f0dd94ea87f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:47.012804 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58948b90-04e0-4e49-a9f3-f0dd94ea87f3 None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:47.013669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58948b90-04e0-4e49-a9f3-f0dd94ea87f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:47.013983 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58948b90-04e0-4e49-a9f3-f0dd94ea87f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:47.015645 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58948b90-04e0-4e49-a9f3-f0dd94ea87f3 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:47.020350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2fd36-be6b-43b8-8f0f-75c14001022d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:47.021371 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2fd36-be6b-43b8-8f0f-75c14001022d None admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:47.021880 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2fd36-be6b-43b8-8f0f-75c14001022d None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:47.022350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2fd36-be6b-43b8-8f0f-75c14001022d None admin] PATH_INFO: `/v3/projects/e0bd6d9a1b9340338db00adb65d81b83/users/354f0ccac1cc4be991872072a6c781a0/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:47.024152 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 61/129] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:37:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:47.024759 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2fd36-be6b-43b8-8f0f-75c14001022d None admin] RBAC: Authorizing `identity:create_grant(project_id=e0bd6d9a1b9340338db00adb65d81b83, user_id=354f0ccac1cc4be991872072a6c781a0, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:47.025027 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58948b90-04e0-4e49-a9f3-f0dd94ea87f3 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:47.026750 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2fd36-be6b-43b8-8f0f-75c14001022d None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:47.042619 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 69/130] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 3 12:37:46 2022] PUT /identity/v3/projects/e0bd6d9a1b9340338db00adb65d81b83/users/354f0ccac1cc4be991872072a6c781a0/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:37:47.043959 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2fd36-be6b-43b8-8f0f-75c14001022d None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:47.124463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:47.145613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58948b90-04e0-4e49-a9f3-f0dd94ea87f3 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:47.197955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:47.210652 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b369eea-6e48-471c-818e-1c808e6c29bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:47.211766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b369eea-6e48-471c-818e-1c808e6c29bd None admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:47.212220 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b369eea-6e48-471c-818e-1c808e6c29bd None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:47.212664 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b369eea-6e48-471c-818e-1c808e6c29bd None admin] PATH_INFO: `/v3/projects/7ca4d22998dd43599a48acb9cb75b454/users/813656e83c41478ab6f4c3340645651a/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:47.215028 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b369eea-6e48-471c-818e-1c808e6c29bd None admin] RBAC: Authorizing `identity:create_grant(project_id=7ca4d22998dd43599a48acb9cb75b454, user_id=813656e83c41478ab6f4c3340645651a, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:47.216839 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b369eea-6e48-471c-818e-1c808e6c29bd None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:47.237422 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 62/131] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 3 12:37:47 2022] PUT /identity/v3/projects/7ca4d22998dd43599a48acb9cb75b454/users/813656e83c41478ab6f4c3340645651a/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:37:47.239566 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b369eea-6e48-471c-818e-1c808e6c29bd None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:47.245219 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2fd36-be6b-43b8-8f0f-75c14001022d None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:47.309452 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d680454-fb80-40db-b58b-036514b15d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:47.310301 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d680454-fb80-40db-b58b-036514b15d64 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:47.311627 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d680454-fb80-40db-b58b-036514b15d64 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:47.312016 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d680454-fb80-40db-b58b-036514b15d64 None admin] PATH_INFO: `/v3/users/354f0ccac1cc4be991872072a6c781a0` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:47.313692 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d680454-fb80-40db-b58b-036514b15d64 None admin] RBAC: Authorizing `identity:get_user(user_id=354f0ccac1cc4be991872072a6c781a0)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:47.315780 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d680454-fb80-40db-b58b-036514b15d64 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:47.317864 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 70/132] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:37:47 2022] GET /identity/v3/users/354f0ccac1cc4be991872072a6c781a0 => generated 275 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:47.323750 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d680454-fb80-40db-b58b-036514b15d64 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:47.380976 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b369eea-6e48-471c-818e-1c808e6c29bd None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:47.418643 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e2d61-169f-447c-8b3a-697b203bb7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:47.419578 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e2d61-169f-447c-8b3a-697b203bb7b6 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:47.420633 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e2d61-169f-447c-8b3a-697b203bb7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:47.421389 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e2d61-169f-447c-8b3a-697b203bb7b6 None admin] PATH_INFO: `/v3/users/354f0ccac1cc4be991872072a6c781a0` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:47.422890 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e2d61-169f-447c-8b3a-697b203bb7b6 None admin] RBAC: Authorizing `identity:get_user(user_id=354f0ccac1cc4be991872072a6c781a0)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:47.424600 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e2d61-169f-447c-8b3a-697b203bb7b6 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:47.426498 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 63/133] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:37:47 2022] GET /identity/v3/users/354f0ccac1cc4be991872072a6c781a0 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:47.434482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e2d61-169f-447c-8b3a-697b203bb7b6 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:47.515277 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d680454-fb80-40db-b58b-036514b15d64 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:47.519265 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:47.535386 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:47.562911 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe2ae5-025e-435e-85f6-13ce5597b1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:47.563584 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe2ae5-025e-435e-85f6-13ce5597b1c1 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:47.563873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe2ae5-025e-435e-85f6-13ce5597b1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:47.564564 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe2ae5-025e-435e-85f6-13ce5597b1c1 None admin] PATH_INFO: `/v3/projects/7ca4d22998dd43599a48acb9cb75b454` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:47.566140 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe2ae5-025e-435e-85f6-13ce5597b1c1 None admin] RBAC: Authorizing `identity:get_project(project_id=7ca4d22998dd43599a48acb9cb75b454)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:47.567604 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe2ae5-025e-435e-85f6-13ce5597b1c1 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:47.570106 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 71/134] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:37:47 2022] GET /identity/v3/projects/7ca4d22998dd43599a48acb9cb75b454 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:37:47.574731 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709659c3-ec63-4401-a921-82f83952459b None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:47.575249 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709659c3-ec63-4401-a921-82f83952459b None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:47.575538 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709659c3-ec63-4401-a921-82f83952459b None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:47.578604 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 72/135] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:37:47.579346 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709659c3-ec63-4401-a921-82f83952459b None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:47.603007 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e2d61-169f-447c-8b3a-697b203bb7b6 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:47.647978 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b1c1e-7ade-44a2-80b0-4bbba34d2a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:47.649744 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b1c1e-7ade-44a2-80b0-4bbba34d2a9a None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:47.650177 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b1c1e-7ade-44a2-80b0-4bbba34d2a9a None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:47.650843 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b1c1e-7ade-44a2-80b0-4bbba34d2a9a None admin] PATH_INFO: `/v3/projects/7ca4d22998dd43599a48acb9cb75b454` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:47.652192 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b1c1e-7ade-44a2-80b0-4bbba34d2a9a None admin] RBAC: Authorizing `identity:get_project(project_id=7ca4d22998dd43599a48acb9cb75b454)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:47.653979 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b1c1e-7ade-44a2-80b0-4bbba34d2a9a None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:47.657140 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 64/136] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:37:47 2022] GET /identity/v3/projects/7ca4d22998dd43599a48acb9cb75b454 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:47.658732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be7799-7567-48d3-a859-8b8f1d1961f8 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:47.659286 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be7799-7567-48d3-a859-8b8f1d1961f8 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:47.659746 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be7799-7567-48d3-a859-8b8f1d1961f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:47.682875 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-d3be7799-7567-48d3-a859-8b8f1d1961f8 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:47.684362 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-d3be7799-7567-48d3-a859-8b8f1d1961f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:47.698130 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709659c3-ec63-4401-a921-82f83952459b None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:47.738831 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0f232-7d07-449d-81b2-ce5ed67d4ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:47.739964 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0f232-7d07-449d-81b2-ce5ed67d4ef0 None admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:47.740729 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0f232-7d07-449d-81b2-ce5ed67d4ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:47.741088 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0f232-7d07-449d-81b2-ce5ed67d4ef0 None admin] PATH_INFO: `/v3/projects/7ca4d22998dd43599a48acb9cb75b454/users/354f0ccac1cc4be991872072a6c781a0/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:47.744276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0f232-7d07-449d-81b2-ce5ed67d4ef0 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ca4d22998dd43599a48acb9cb75b454, user_id=354f0ccac1cc4be991872072a6c781a0, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:47.753527 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0f232-7d07-449d-81b2-ce5ed67d4ef0 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:47.761443 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 73/137] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 3 12:37:47 2022] PUT /identity/v3/projects/7ca4d22998dd43599a48acb9cb75b454/users/354f0ccac1cc4be991872072a6c781a0/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:37:47.762545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0f232-7d07-449d-81b2-ce5ed67d4ef0 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:47.785399 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 65/138] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:37:47.806461 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:47.852396 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be7799-7567-48d3-a859-8b8f1d1961f8 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:47.905050 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0f232-7d07-449d-81b2-ce5ed67d4ef0 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:47.949670 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b8d155-6903-4b34-87cb-2dfaa84fb004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:47.950381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8d155-6903-4b34-87cb-2dfaa84fb004 None admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:47.950667 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8d155-6903-4b34-87cb-2dfaa84fb004 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:47.950945 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8d155-6903-4b34-87cb-2dfaa84fb004 None admin] PATH_INFO: `/v3/projects/7ca4d22998dd43599a48acb9cb75b454/users/354f0ccac1cc4be991872072a6c781a0/roles/1f3ee786628740418d65c827bc64a9b5` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:47.954121 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b8d155-6903-4b34-87cb-2dfaa84fb004 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ca4d22998dd43599a48acb9cb75b454, user_id=354f0ccac1cc4be991872072a6c781a0, role_id=1f3ee786628740418d65c827bc64a9b5)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:47.955601 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b8d155-6903-4b34-87cb-2dfaa84fb004 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:47.980410 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 74/139] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 3 12:37:47 2022] PUT /identity/v3/projects/7ca4d22998dd43599a48acb9cb75b454/users/354f0ccac1cc4be991872072a6c781a0/roles/1f3ee786628740418d65c827bc64a9b5 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:37:47.993440 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:48.081706 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be7799-7567-48d3-a859-8b8f1d1961f8 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:48.136626 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199446a-b47e-4171-b8ed-d789e1089e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:48.137673 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199446a-b47e-4171-b8ed-d789e1089e59 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:48.138160 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199446a-b47e-4171-b8ed-d789e1089e59 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:48.139170 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199446a-b47e-4171-b8ed-d789e1089e59 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:48.146427 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199446a-b47e-4171-b8ed-d789e1089e59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:48.148292 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199446a-b47e-4171-b8ed-d789e1089e59 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:48.150765 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 66/140] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:37:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:48.156689 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b8d155-6903-4b34-87cb-2dfaa84fb004 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:48.269816 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:48.276447 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b8d155-6903-4b34-87cb-2dfaa84fb004 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:48.313311 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8eef64-879a-4965-981c-cb6b1492d5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:48.313973 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8eef64-879a-4965-981c-cb6b1492d5dd None admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:48.314255 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8eef64-879a-4965-981c-cb6b1492d5dd None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:48.314534 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8eef64-879a-4965-981c-cb6b1492d5dd None admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:48.315234 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8eef64-879a-4965-981c-cb6b1492d5dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:48.316707 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8eef64-879a-4965-981c-cb6b1492d5dd None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:48.339994 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 75/141] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Aug 3 12:37:48 2022] POST /identity/v3/users => generated 283 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:37:49.241630 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262df5dd-ebd4-4aec-b580-f196468284f9 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:49.242713 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262df5dd-ebd4-4aec-b580-f196468284f9 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:49.243212 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262df5dd-ebd4-4aec-b580-f196468284f9 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:49.244796 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 67/142] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:37:49.250500 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84509a0c-9a37-4f64-90ac-d866185c2dc2 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:49.250965 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84509a0c-9a37-4f64-90ac-d866185c2dc2 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:49.251045 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84509a0c-9a37-4f64-90ac-d866185c2dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:49.274736 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-84509a0c-9a37-4f64-90ac-d866185c2dc2 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:49.275251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-84509a0c-9a37-4f64-90ac-d866185c2dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:49.356400 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 76/143] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:37:49.389181 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262df5dd-ebd4-4aec-b580-f196468284f9 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:49.507609 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262df5dd-ebd4-4aec-b580-f196468284f9 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:49.531175 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:49.547433 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a89bbb-3b34-4d66-a986-c85f5d3a72ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:49.548326 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a89bbb-3b34-4d66-a986-c85f5d3a72ac None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:49.548808 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a89bbb-3b34-4d66-a986-c85f5d3a72ac None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:49.549238 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a89bbb-3b34-4d66-a986-c85f5d3a72ac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:49.560789 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a89bbb-3b34-4d66-a986-c85f5d3a72ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:37:49.566105 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-a2a89bbb-3b34-4d66-a986-c85f5d3a72ac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:37:49.566105 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:37:49.566105 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:37:49.566105 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:37:49.566105 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:37:49.566105 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:37:49.566105 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:37:49.566105 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:37:49.566105 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:37:49.566105 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:37:49.566105 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:37:49.566105 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:37:49.566105 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:37:49.566105 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:37:49.566105 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:37:49.566105 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:37:49.567178 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:37:49.567178 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:37:49.567178 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:37:49.567178 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:37:49.567178 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:37:49.567178 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:37:49.567178 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:37:49.567178 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:37:49.567178 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:37:49.567178 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:37:49.567178 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:37:49.567178 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:37:49.567178 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:37:49.567178 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:37:49.567178 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:37:49.567178 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:37:49.568149 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:37:49.568149 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:37:49.568149 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:37:49.568149 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:37:49.568149 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:37:49.568149 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:37:49.568149 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:37:49.568149 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:37:49.568149 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:37:49.568149 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:37:49.568149 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:37:49.568149 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:37:49.570282 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 68/144] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:37:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:37:49.577095 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84509a0c-9a37-4f64-90ac-d866185c2dc2 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:49.680491 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:49.708851 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84509a0c-9a37-4f64-90ac-d866185c2dc2 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:49.755665 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eebbf2-c6cf-4a25-b586-db91310ba7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:49.756327 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eebbf2-c6cf-4a25-b586-db91310ba7d5 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:49.756601 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eebbf2-c6cf-4a25-b586-db91310ba7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:49.756881 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eebbf2-c6cf-4a25-b586-db91310ba7d5 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:49.757713 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eebbf2-c6cf-4a25-b586-db91310ba7d5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:49.758051 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eebbf2-c6cf-4a25-b586-db91310ba7d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:49.759465 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eebbf2-c6cf-4a25-b586-db91310ba7d5 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:49.769559 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 77/145] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 3 12:37:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:49.774994 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a89bbb-3b34-4d66-a986-c85f5d3a72ac None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:49.916155 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a89bbb-3b34-4d66-a986-c85f5d3a72ac None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:49.942738 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418609d2-a8c1-443f-ac9a-0943ef0f28de None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:49.943053 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418609d2-a8c1-443f-ac9a-0943ef0f28de None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:49.943311 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418609d2-a8c1-443f-ac9a-0943ef0f28de None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:49.945082 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 78/146] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:37:49.952207 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3553c-6e7e-49af-940a-5a0de78dc4c1 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:49.952487 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3553c-6e7e-49af-940a-5a0de78dc4c1 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:49.952772 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3553c-6e7e-49af-940a-5a0de78dc4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:49.967857 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13778252-c373-4a30-a3b4-01e80c06be0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:49.968994 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13778252-c373-4a30-a3b4-01e80c06be0a None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:49.969634 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13778252-c373-4a30-a3b4-01e80c06be0a None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:49.970122 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13778252-c373-4a30-a3b4-01e80c06be0a None admin] PATH_INFO: `/v3/users/3b8f2921e1d6477ab8cc516667e9c309` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:49.971598 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13778252-c373-4a30-a3b4-01e80c06be0a None admin] RBAC: Authorizing `identity:get_user(user_id=3b8f2921e1d6477ab8cc516667e9c309)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:49.973276 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13778252-c373-4a30-a3b4-01e80c06be0a None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:49.979573 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 69/147] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:37:49 2022] GET /identity/v3/users/3b8f2921e1d6477ab8cc516667e9c309 => generated 289 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:49.980717 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13778252-c373-4a30-a3b4-01e80c06be0a None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:49.990381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-e1e3553c-6e7e-49af-940a-5a0de78dc4c1 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:49.996427 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-e1e3553c-6e7e-49af-940a-5a0de78dc4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:50.124719 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:50.155593 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 79/148] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:37:50.156893 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a453a60-ddcd-410b-9f7e-e27494fcc95a None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:50.157181 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a453a60-ddcd-410b-9f7e-e27494fcc95a None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:50.157460 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a453a60-ddcd-410b-9f7e-e27494fcc95a None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:50.159685 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 80/149] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:37:50.168400 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ee690-d9c1-40d3-8e4e-43cffc9f324f None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:50.168687 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ee690-d9c1-40d3-8e4e-43cffc9f324f None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:50.168967 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ee690-d9c1-40d3-8e4e-43cffc9f324f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:50.210631 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-fe7ee690-d9c1-40d3-8e4e-43cffc9f324f None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:50.210631 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-fe7ee690-d9c1-40d3-8e4e-43cffc9f324f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:50.230242 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13778252-c373-4a30-a3b4-01e80c06be0a None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:50.315239 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cde18-5885-4644-981f-d13f3b57b6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:50.316692 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cde18-5885-4644-981f-d13f3b57b6ea None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:50.317201 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cde18-5885-4644-981f-d13f3b57b6ea None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:50.317709 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cde18-5885-4644-981f-d13f3b57b6ea None admin] PATH_INFO: `/v3/projects/7ca4d22998dd43599a48acb9cb75b454` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:50.319246 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98cde18-5885-4644-981f-d13f3b57b6ea None admin] RBAC: Authorizing `identity:get_project(project_id=7ca4d22998dd43599a48acb9cb75b454)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:50.321067 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98cde18-5885-4644-981f-d13f3b57b6ea None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:50.323140 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 70/150] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:37:49 2022] GET /identity/v3/projects/7ca4d22998dd43599a48acb9cb75b454 => generated 298 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:50.330080 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:50.332277 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cde18-5885-4644-981f-d13f3b57b6ea None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:50.339518 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 81/151] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:37:50.340401 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ee690-d9c1-40d3-8e4e-43cffc9f324f None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:50.517997 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ee690-d9c1-40d3-8e4e-43cffc9f324f None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:50.571611 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cde18-5885-4644-981f-d13f3b57b6ea None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:50.575075 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a4dd9-7059-4dcc-be04-20f70c975ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:50.581646 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a4dd9-7059-4dcc-be04-20f70c975ea2 None admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:50.581646 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a4dd9-7059-4dcc-be04-20f70c975ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:50.581646 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a4dd9-7059-4dcc-be04-20f70c975ea2 None admin] PATH_INFO: `/v3/projects/7ca4d22998dd43599a48acb9cb75b454/users/3b8f2921e1d6477ab8cc516667e9c309/roles/88752d25daad459b9cc7232c4818bb30` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:50.581646 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a4dd9-7059-4dcc-be04-20f70c975ea2 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ca4d22998dd43599a48acb9cb75b454, user_id=3b8f2921e1d6477ab8cc516667e9c309, role_id=88752d25daad459b9cc7232c4818bb30)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:50.581646 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a4dd9-7059-4dcc-be04-20f70c975ea2 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:50.605520 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:50.611456 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 82/152] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 3 12:37:50 2022] PUT /identity/v3/projects/7ca4d22998dd43599a48acb9cb75b454/users/3b8f2921e1d6477ab8cc516667e9c309/roles/88752d25daad459b9cc7232c4818bb30 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:37:50.613113 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a4dd9-7059-4dcc-be04-20f70c975ea2 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:50.633390 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a9d18-eb2e-4cc0-8edf-b6f0770f5059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:50.634469 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a9d18-eb2e-4cc0-8edf-b6f0770f5059 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:50.635030 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a9d18-eb2e-4cc0-8edf-b6f0770f5059 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:50.635507 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a9d18-eb2e-4cc0-8edf-b6f0770f5059 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:50.651766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a9d18-eb2e-4cc0-8edf-b6f0770f5059 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:37:50.658682 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-5a2a9d18-eb2e-4cc0-8edf-b6f0770f5059 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:37:50.658682 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:37:50.658682 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:37:50.658682 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:37:50.658682 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:37:50.658682 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:37:50.658682 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:37:50.658682 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:37:50.658682 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:37:50.658682 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:37:50.658682 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:37:50.658682 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:37:50.658682 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:37:50.658682 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:37:50.658682 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:37:50.658682 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:37:50.659619 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:37:50.659619 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:37:50.659619 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:37:50.659619 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:37:50.659619 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:37:50.659619 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:37:50.659619 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:37:50.659619 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:37:50.659619 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:37:50.659619 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:37:50.659619 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:37:50.659619 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:37:50.659619 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:37:50.659619 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:37:50.659619 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:37:50.659619 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:37:50.660378 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:37:50.660378 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:37:50.660378 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:37:50.660378 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:37:50.660378 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:37:50.660378 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:37:50.660378 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:37:50.660378 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:37:50.660378 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:37:50.660378 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:37:50.660378 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:37:50.660378 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:37:50.667161 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 71/153] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:37:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:37:50.673904 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a9d18-eb2e-4cc0-8edf-b6f0770f5059 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:50.728216 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:50.780295 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a4dd9-7059-4dcc-be04-20f70c975ea2 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:50.834618 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a9d18-eb2e-4cc0-8edf-b6f0770f5059 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:50.839975 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01c6a3-a756-4ead-9fac-5c43df24f3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:50.840641 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01c6a3-a756-4ead-9fac-5c43df24f3fc None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:50.840920 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01c6a3-a756-4ead-9fac-5c43df24f3fc None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:50.841191 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01c6a3-a756-4ead-9fac-5c43df24f3fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:50.859094 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01c6a3-a756-4ead-9fac-5c43df24f3fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:37:50.874276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-bf01c6a3-a756-4ead-9fac-5c43df24f3fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:37:50.874276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:37:50.874276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:37:50.874276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:37:50.874276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:37:50.874276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:37:50.874276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:37:50.874276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:37:50.874276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:37:50.874276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:37:50.874276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:37:50.874276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:37:50.874276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:37:50.874276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:37:50.874276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:37:50.874276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:37:50.875388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:37:50.875388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:37:50.875388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:37:50.875388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:37:50.875388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:37:50.875388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:37:50.875388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:37:50.875388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:37:50.875388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:37:50.875388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:37:50.875388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:37:50.875388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:37:50.875388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:37:50.875388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:37:50.875388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:37:50.875388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:37:50.876310 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:37:50.876310 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:37:50.876310 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:37:50.876310 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:37:50.876310 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:37:50.876310 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:37:50.876310 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:37:50.876310 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:37:50.876310 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:37:50.876310 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:37:50.876310 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:37:50.876310 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:37:50.880993 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 83/154] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 3 12:37:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:37:50.888106 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01c6a3-a756-4ead-9fac-5c43df24f3fc None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:50.903500 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bdaf33-895f-4922-9700-6c5370a03edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:50.904952 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdaf33-895f-4922-9700-6c5370a03edf None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:50.905429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdaf33-895f-4922-9700-6c5370a03edf None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:50.905873 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdaf33-895f-4922-9700-6c5370a03edf None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:50.906767 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bdaf33-895f-4922-9700-6c5370a03edf None admin] RBAC: Adding query filter params (name=member) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:50.907234 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bdaf33-895f-4922-9700-6c5370a03edf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:50.908782 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bdaf33-895f-4922-9700-6c5370a03edf None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:50.929784 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 72/155] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 3 12:37:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:50.934480 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bdaf33-895f-4922-9700-6c5370a03edf None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:50.999206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:51.087609 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bdaf33-895f-4922-9700-6c5370a03edf None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:51.098566 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01c6a3-a756-4ead-9fac-5c43df24f3fc None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:51.132694 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:51.140899 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce20da-7b57-468c-8165-a5e2a1879bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:51.141785 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce20da-7b57-468c-8165-a5e2a1879bfa None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:51.142232 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce20da-7b57-468c-8165-a5e2a1879bfa None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:51.142652 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce20da-7b57-468c-8165-a5e2a1879bfa None admin] PATH_INFO: `/v3/users/354f0ccac1cc4be991872072a6c781a0` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:51.144014 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce20da-7b57-468c-8165-a5e2a1879bfa None admin] RBAC: Authorizing `identity:get_user(user_id=354f0ccac1cc4be991872072a6c781a0)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:51.145706 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce20da-7b57-468c-8165-a5e2a1879bfa None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:51.147496 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 73/156] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:37:50 2022] GET /identity/v3/users/354f0ccac1cc4be991872072a6c781a0 => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:51.155988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce20da-7b57-468c-8165-a5e2a1879bfa None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:51.156683 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017290c-f55f-4a04-b22e-b8efc35839f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:51.157313 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017290c-f55f-4a04-b22e-b8efc35839f5 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:51.157624 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017290c-f55f-4a04-b22e-b8efc35839f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:51.157901 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017290c-f55f-4a04-b22e-b8efc35839f5 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:51.158640 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017290c-f55f-4a04-b22e-b8efc35839f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:51.158942 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017290c-f55f-4a04-b22e-b8efc35839f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:51.160463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017290c-f55f-4a04-b22e-b8efc35839f5 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:51.173539 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 84/157] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:37:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:51.178594 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017290c-f55f-4a04-b22e-b8efc35839f5 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:51.300784 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce20da-7b57-468c-8165-a5e2a1879bfa None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:51.321303 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017290c-f55f-4a04-b22e-b8efc35839f5 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:51.321895 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:51.365345 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74adfb3d-d186-48dc-8a10-67fdcf97a773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:51.365932 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adfb3d-d186-48dc-8a10-67fdcf97a773 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:51.366217 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adfb3d-d186-48dc-8a10-67fdcf97a773 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:51.366495 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adfb3d-d186-48dc-8a10-67fdcf97a773 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:51.386258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5784953-2472-4a28-ad97-aea190095945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:51.386915 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5784953-2472-4a28-ad97-aea190095945 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:51.387210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5784953-2472-4a28-ad97-aea190095945 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:51.387488 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5784953-2472-4a28-ad97-aea190095945 None admin] PATH_INFO: `/v3/users/813656e83c41478ab6f4c3340645651a` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:51.388791 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5784953-2472-4a28-ad97-aea190095945 None admin] RBAC: Authorizing `identity:get_user(user_id=813656e83c41478ab6f4c3340645651a)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:51.390296 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5784953-2472-4a28-ad97-aea190095945 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:51.391944 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 85/158] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:37:51 2022] GET /identity/v3/users/813656e83c41478ab6f4c3340645651a => generated 247 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:37:51.402444 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5784953-2472-4a28-ad97-aea190095945 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:51.465928 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74adfb3d-d186-48dc-8a10-67fdcf97a773 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:51.468036 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74adfb3d-d186-48dc-8a10-67fdcf97a773 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:51.486150 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:51.554523 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5784953-2472-4a28-ad97-aea190095945 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:51.620338 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 74/159] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:37:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:37:51.621397 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74adfb3d-d186-48dc-8a10-67fdcf97a773 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:51.626243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301c5a5-b79a-4525-9ea9-c31ff8d81cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:51.626882 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301c5a5-b79a-4525-9ea9-c31ff8d81cde None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:51.627169 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301c5a5-b79a-4525-9ea9-c31ff8d81cde None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:51.627449 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301c5a5-b79a-4525-9ea9-c31ff8d81cde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:51.638047 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:51.765455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74adfb3d-d186-48dc-8a10-67fdcf97a773 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:51.814048 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9eec83-eff3-4f37-a60d-4f2186f6f4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:51.814663 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9eec83-eff3-4f37-a60d-4f2186f6f4e5 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:51.814949 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9eec83-eff3-4f37-a60d-4f2186f6f4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:51.815227 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9eec83-eff3-4f37-a60d-4f2186f6f4e5 None admin] PATH_INFO: `/v3/projects/e0bd6d9a1b9340338db00adb65d81b83` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:51.815768 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301c5a5-b79a-4525-9ea9-c31ff8d81cde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:51.817465 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301c5a5-b79a-4525-9ea9-c31ff8d81cde None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:51.818200 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9eec83-eff3-4f37-a60d-4f2186f6f4e5 None admin] RBAC: Authorizing `identity:get_project(project_id=e0bd6d9a1b9340338db00adb65d81b83)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:51.819688 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9eec83-eff3-4f37-a60d-4f2186f6f4e5 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:51.825572 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 75/160] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:37:51 2022] GET /identity/v3/projects/e0bd6d9a1b9340338db00adb65d81b83 => generated 312 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:37:51.825572 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be2f5c-9116-4f63-b341-898feb271b28 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:51.825572 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be2f5c-9116-4f63-b341-898feb271b28 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:51.825572 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be2f5c-9116-4f63-b341-898feb271b28 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:51.825572 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 76/161] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:37:51.827798 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be2f5c-9116-4f63-b341-898feb271b28 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:51.913597 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:51.955944 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:51.984784 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 86/162] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:37:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:37:51.986487 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79579f31-1561-4e1b-a9c9-d8c244c4f0b5 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:51.986992 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79579f31-1561-4e1b-a9c9-d8c244c4f0b5 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:51.987465 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79579f31-1561-4e1b-a9c9-d8c244c4f0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:52.002228 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be2f5c-9116-4f63-b341-898feb271b28 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:52.019813 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-79579f31-1561-4e1b-a9c9-d8c244c4f0b5 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:52.021333 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-79579f31-1561-4e1b-a9c9-d8c244c4f0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:52.078773 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7e10f-14bc-41f4-9845-a10dbcb6bbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:52.079402 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7e10f-14bc-41f4-9845-a10dbcb6bbb5 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:52.079683 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7e10f-14bc-41f4-9845-a10dbcb6bbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:52.079964 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7e10f-14bc-41f4-9845-a10dbcb6bbb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:52.080844 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7e10f-14bc-41f4-9845-a10dbcb6bbb5 None admin] RBAC: Adding query filter params (role.id=e1c6e31e9e944b23bc9ba6b0099d3376, scope.project.id=e0bd6d9a1b9340338db00adb65d81b83, user.id=354f0ccac1cc4be991872072a6c781a0) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:52.081161 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7e10f-14bc-41f4-9845-a10dbcb6bbb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:52.082880 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7e10f-14bc-41f4-9845-a10dbcb6bbb5 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:52.096429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 77/163] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:37:51 2022] GET /identity/v3/role_assignments?user.id=354f0ccac1cc4be991872072a6c781a0&scope.project.id=e0bd6d9a1b9340338db00adb65d81b83&role.id=e1c6e31e9e944b23bc9ba6b0099d3376 => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:52.097529 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7e10f-14bc-41f4-9845-a10dbcb6bbb5 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:52.153231 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 87/164] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:37:52.199520 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79579f31-1561-4e1b-a9c9-d8c244c4f0b5 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:52.299175 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7e10f-14bc-41f4-9845-a10dbcb6bbb5 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:52.356331 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:52.384835 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c05b2-f893-49ef-af9d-ea601ab76afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:52.385534 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c05b2-f893-49ef-af9d-ea601ab76afd None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:52.385802 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c05b2-f893-49ef-af9d-ea601ab76afd None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:52.386078 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c05b2-f893-49ef-af9d-ea601ab76afd None admin] PATH_INFO: `/v3/projects/7ca4d22998dd43599a48acb9cb75b454` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:52.387316 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c05b2-f893-49ef-af9d-ea601ab76afd None admin] RBAC: Authorizing `identity:get_project(project_id=7ca4d22998dd43599a48acb9cb75b454)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:52.389346 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c05b2-f893-49ef-af9d-ea601ab76afd None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:52.393348 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 78/165] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:37:52 2022] GET /identity/v3/projects/7ca4d22998dd43599a48acb9cb75b454 => generated 298 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:52.393472 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79579f31-1561-4e1b-a9c9-d8c244c4f0b5 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:52.394676 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17480a56-4eca-4e74-8505-fcbfe9d38ebd None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:52.394962 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17480a56-4eca-4e74-8505-fcbfe9d38ebd None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:52.395240 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17480a56-4eca-4e74-8505-fcbfe9d38ebd None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:52.396974 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 79/166] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:37:52.406990 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad876ab2-61c0-4afd-b648-68cf3cbafffc None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:52.407265 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad876ab2-61c0-4afd-b648-68cf3cbafffc None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:52.407544 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad876ab2-61c0-4afd-b648-68cf3cbafffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:52.426837 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:52.438422 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-ad876ab2-61c0-4afd-b648-68cf3cbafffc None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:52.440318 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-ad876ab2-61c0-4afd-b648-68cf3cbafffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:52.460307 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8a4f6-180b-4122-ab07-6a3861d95466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:52.460887 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8a4f6-180b-4122-ab07-6a3861d95466 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:52.461163 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8a4f6-180b-4122-ab07-6a3861d95466 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:52.461431 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8a4f6-180b-4122-ab07-6a3861d95466 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:52.488673 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b8a4f6-180b-4122-ab07-6a3861d95466 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:37:52.500347 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-53b8a4f6-180b-4122-ab07-6a3861d95466 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:37:52.500347 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:37:52.500347 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:37:52.500347 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:37:52.500347 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:37:52.500347 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:37:52.500347 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:37:52.500347 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:37:52.500347 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:37:52.500347 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:37:52.500347 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:37:52.500347 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:37:52.500347 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:37:52.500347 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:37:52.500347 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:37:52.500347 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:37:52.501226 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:37:52.501226 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:37:52.501226 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:37:52.501226 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:37:52.501226 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:37:52.501226 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:37:52.501226 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:37:52.501226 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:37:52.501226 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:37:52.501226 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:37:52.501226 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:37:52.501226 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:37:52.501226 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:37:52.501226 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:37:52.501226 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:37:52.501226 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:37:52.502267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:37:52.502267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:37:52.502267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:37:52.502267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:37:52.502267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:37:52.502267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:37:52.502267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:37:52.502267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:37:52.502267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:37:52.502267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:37:52.502267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:37:52.502267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:37:52.502267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 88/167] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:37:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:37:52.502911 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8a4f6-180b-4122-ab07-6a3861d95466 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:52.577831 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 80/168] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:37:52.578702 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad876ab2-61c0-4afd-b648-68cf3cbafffc None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:52.702332 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8a4f6-180b-4122-ab07-6a3861d95466 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:52.743262 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a824451-555c-493b-8627-40d34dc03df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:52.744248 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a824451-555c-493b-8627-40d34dc03df2 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:52.744722 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a824451-555c-493b-8627-40d34dc03df2 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:52.745185 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a824451-555c-493b-8627-40d34dc03df2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:52.746203 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a824451-555c-493b-8627-40d34dc03df2 None admin] RBAC: Adding query filter params (role.id=0e57d142f86c471883fc07a89fe66ec8, scope.project.id=7ca4d22998dd43599a48acb9cb75b454, user.id=813656e83c41478ab6f4c3340645651a) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:52.746727 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a824451-555c-493b-8627-40d34dc03df2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:52.749143 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a824451-555c-493b-8627-40d34dc03df2 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:52.751361 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad876ab2-61c0-4afd-b648-68cf3cbafffc None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:52.759966 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 89/169] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:37:52 2022] GET /identity/v3/role_assignments?user.id=813656e83c41478ab6f4c3340645651a&scope.project.id=7ca4d22998dd43599a48acb9cb75b454&role.id=0e57d142f86c471883fc07a89fe66ec8 => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:52.760914 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a824451-555c-493b-8627-40d34dc03df2 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:52.772774 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:52.801412 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6466d43-04e8-476f-9e06-4ee61e243797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:52.802323 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6466d43-04e8-476f-9e06-4ee61e243797 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:52.802792 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6466d43-04e8-476f-9e06-4ee61e243797 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:52.803199 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6466d43-04e8-476f-9e06-4ee61e243797 None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:52.804070 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6466d43-04e8-476f-9e06-4ee61e243797 None admin] RBAC: Adding query filter params (name=member) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:52.804597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6466d43-04e8-476f-9e06-4ee61e243797 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:52.806244 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6466d43-04e8-476f-9e06-4ee61e243797 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:52.809515 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:52.826422 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 81/170] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 3 12:37:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:52.832700 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6466d43-04e8-476f-9e06-4ee61e243797 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:52.951284 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6466d43-04e8-476f-9e06-4ee61e243797 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:52.996537 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a824451-555c-493b-8627-40d34dc03df2 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:52.996866 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56724f47-f677-4768-8b86-f3ee13d5b756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:52.997700 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56724f47-f677-4768-8b86-f3ee13d5b756 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:52.998484 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56724f47-f677-4768-8b86-f3ee13d5b756 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:52.998917 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56724f47-f677-4768-8b86-f3ee13d5b756 None admin] PATH_INFO: `/v3/users/354f0ccac1cc4be991872072a6c781a0` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:53.001298 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56724f47-f677-4768-8b86-f3ee13d5b756 None admin] RBAC: Authorizing `identity:get_user(user_id=354f0ccac1cc4be991872072a6c781a0)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:53.002973 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56724f47-f677-4768-8b86-f3ee13d5b756 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:53.005177 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 82/171] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:37:52 2022] GET /identity/v3/users/354f0ccac1cc4be991872072a6c781a0 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:53.010989 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56724f47-f677-4768-8b86-f3ee13d5b756 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:53.090336 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fae42e-84c4-4503-b05c-d870b20c32f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:53.091020 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fae42e-84c4-4503-b05c-d870b20c32f6 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:53.091301 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fae42e-84c4-4503-b05c-d870b20c32f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:53.091629 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fae42e-84c4-4503-b05c-d870b20c32f6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:53.117958 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fae42e-84c4-4503-b05c-d870b20c32f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:37:53.124372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-56fae42e-84c4-4503-b05c-d870b20c32f6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:37:53.124372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:37:53.124372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:37:53.124372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:37:53.124372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:37:53.124372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:37:53.124372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:37:53.124372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:37:53.124372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:37:53.124372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:37:53.124372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:37:53.124372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:37:53.124372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:37:53.124372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:37:53.124372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:37:53.124372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:37:53.125321 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:37:53.125321 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:37:53.125321 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:37:53.125321 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:37:53.125321 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:37:53.125321 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:37:53.125321 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:37:53.125321 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:37:53.125321 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:37:53.125321 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:37:53.125321 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:37:53.125321 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:37:53.125321 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:37:53.125321 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:37:53.125321 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:37:53.125321 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:37:53.126267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:37:53.126267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:37:53.126267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:37:53.126267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:37:53.126267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:37:53.126267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:37:53.126267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:37:53.126267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:37:53.126267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:37:53.126267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:37:53.126267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:37:53.126267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:37:53.126267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 90/172] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 3 12:37:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:37:53.131553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fae42e-84c4-4503-b05c-d870b20c32f6 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:53.153712 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:53.196213 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56724f47-f677-4768-8b86-f3ee13d5b756 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:53.237108 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c580e-2361-4643-8329-695a4c78c0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:53.237785 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c580e-2361-4643-8329-695a4c78c0ff None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:53.238075 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c580e-2361-4643-8329-695a4c78c0ff None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:53.238350 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c580e-2361-4643-8329-695a4c78c0ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:53.294580 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:53.322236 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c580e-2361-4643-8329-695a4c78c0ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:53.323705 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c580e-2361-4643-8329-695a4c78c0ff None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:53.386986 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fae42e-84c4-4503-b05c-d870b20c32f6 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:53.427574 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:53.438993 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25cc9fd-1a70-4c78-b034-c499af2201df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:53.439628 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25cc9fd-1a70-4c78-b034-c499af2201df None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:53.439914 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25cc9fd-1a70-4c78-b034-c499af2201df None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:53.440190 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25cc9fd-1a70-4c78-b034-c499af2201df None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:53.440932 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25cc9fd-1a70-4c78-b034-c499af2201df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:53.441242 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25cc9fd-1a70-4c78-b034-c499af2201df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:53.442665 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25cc9fd-1a70-4c78-b034-c499af2201df None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:53.455688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 91/173] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:37:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:37:53.456900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a16daa-35c7-47a1-917c-c92be47e19e7 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:53.457256 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a16daa-35c7-47a1-917c-c92be47e19e7 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:53.457562 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a16daa-35c7-47a1-917c-c92be47e19e7 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:53.458914 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 92/174] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:37:53.463485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a16daa-35c7-47a1-917c-c92be47e19e7 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:53.494817 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 83/175] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:37:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 03 12:37:53.496250 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5fe24-0669-4d9d-ab02-113d10633f89 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:53.496628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5fe24-0669-4d9d-ab02-113d10633f89 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:53.496919 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5fe24-0669-4d9d-ab02-113d10633f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:53.519727 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-eeb5fe24-0669-4d9d-ab02-113d10633f89 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:53.521092 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-eeb5fe24-0669-4d9d-ab02-113d10633f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:53.618453 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 84/176] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:37:53.619686 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5fe24-0669-4d9d-ab02-113d10633f89 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:53.623536 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a16daa-35c7-47a1-917c-c92be47e19e7 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:53.651200 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:53.661952 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8cbf33-ff1b-4a18-8c12-ed676737b91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:53.662950 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cbf33-ff1b-4a18-8c12-ed676737b91e None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:53.663465 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cbf33-ff1b-4a18-8c12-ed676737b91e None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:53.663933 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cbf33-ff1b-4a18-8c12-ed676737b91e None admin] PATH_INFO: `/v3/users/354f0ccac1cc4be991872072a6c781a0` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:53.665306 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8cbf33-ff1b-4a18-8c12-ed676737b91e None admin] RBAC: Authorizing `identity:get_user(user_id=354f0ccac1cc4be991872072a6c781a0)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:53.668213 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8cbf33-ff1b-4a18-8c12-ed676737b91e None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:53.671276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 93/177] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:37:53 2022] GET /identity/v3/users/354f0ccac1cc4be991872072a6c781a0 => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:53.672701 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9eea3-ecd8-4aa8-8e54-421604029a15 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:53.673196 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9eea3-ecd8-4aa8-8e54-421604029a15 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:53.673725 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9eea3-ecd8-4aa8-8e54-421604029a15 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:53.675183 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 94/178] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:37:53.676138 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9eea3-ecd8-4aa8-8e54-421604029a15 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:53.726418 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:53.734966 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5fe24-0669-4d9d-ab02-113d10633f89 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:53.771699 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fab406-be67-4ae7-baac-700d4c1a150c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:53.772296 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fab406-be67-4ae7-baac-700d4c1a150c None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:53.772576 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fab406-be67-4ae7-baac-700d4c1a150c None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:53.772846 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fab406-be67-4ae7-baac-700d4c1a150c None admin] PATH_INFO: `/v3/projects/7ca4d22998dd43599a48acb9cb75b454` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:53.774049 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fab406-be67-4ae7-baac-700d4c1a150c None admin] RBAC: Authorizing `identity:get_project(project_id=7ca4d22998dd43599a48acb9cb75b454)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:53.775483 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fab406-be67-4ae7-baac-700d4c1a150c None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:53.777333 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 85/179] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:37:53 2022] GET /identity/v3/projects/7ca4d22998dd43599a48acb9cb75b454 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:53.777971 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fab406-be67-4ae7-baac-700d4c1a150c None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:53.790376 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9eea3-ecd8-4aa8-8e54-421604029a15 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:53.826924 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4001c9-6f95-4c58-ba01-b02387adcbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:53.827564 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4001c9-6f95-4c58-ba01-b02387adcbf6 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:53.827842 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4001c9-6f95-4c58-ba01-b02387adcbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:53.828114 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4001c9-6f95-4c58-ba01-b02387adcbf6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:53.838788 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4001c9-6f95-4c58-ba01-b02387adcbf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:37:53.844788 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-6a4001c9-6f95-4c58-ba01-b02387adcbf6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:37:53.844788 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:37:53.844788 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:37:53.844788 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:37:53.844788 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:37:53.844788 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:37:53.844788 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:37:53.844788 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:37:53.844788 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:37:53.844788 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:37:53.844788 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:37:53.844788 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:37:53.844788 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:37:53.844788 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:37:53.844788 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:37:53.844788 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:37:53.845672 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:37:53.845672 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:37:53.845672 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:37:53.845672 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:37:53.845672 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:37:53.845672 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:37:53.845672 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:37:53.845672 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:37:53.845672 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:37:53.845672 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:37:53.845672 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:37:53.845672 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:37:53.845672 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:37:53.845672 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:37:53.845672 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:37:53.845672 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:37:53.846467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:37:53.846467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:37:53.846467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:37:53.846467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:37:53.846467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:37:53.846467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:37:53.846467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:37:53.846467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:37:53.846467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:37:53.846467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:37:53.846467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:37:53.846467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:37:53.846467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 95/180] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 3 12:37:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:37:53.847457 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fabc14-174a-4860-b085-4a264a9a74f7 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:53.847457 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fabc14-174a-4860-b085-4a264a9a74f7 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:53.847688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fabc14-174a-4860-b085-4a264a9a74f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:53.874772 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-70fabc14-174a-4860-b085-4a264a9a74f7 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:53.876636 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-70fabc14-174a-4860-b085-4a264a9a74f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:53.891483 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fab406-be67-4ae7-baac-700d4c1a150c None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:53.931617 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6204a-ff5e-4e2c-bbf3-af30fa372929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:53.932245 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6204a-ff5e-4e2c-bbf3-af30fa372929 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:53.932562 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6204a-ff5e-4e2c-bbf3-af30fa372929 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:53.932798 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6204a-ff5e-4e2c-bbf3-af30fa372929 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:53.936237 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:53.965518 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 96/181] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:37:53.965518 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fabc14-174a-4860-b085-4a264a9a74f7 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:53.980851 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:54.024592 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6204a-ff5e-4e2c-bbf3-af30fa372929 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:54.026642 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6204a-ff5e-4e2c-bbf3-af30fa372929 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:54.063380 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fabc14-174a-4860-b085-4a264a9a74f7 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:54.098591 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241a034-bb44-4462-a22e-e3cd82d92b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:54.099209 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241a034-bb44-4462-a22e-e3cd82d92b44 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:54.099492 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241a034-bb44-4462-a22e-e3cd82d92b44 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:54.099767 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241a034-bb44-4462-a22e-e3cd82d92b44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:54.100566 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241a034-bb44-4462-a22e-e3cd82d92b44 None admin] RBAC: Adding query filter params (role.id=e1c6e31e9e944b23bc9ba6b0099d3376, scope.project.id=7ca4d22998dd43599a48acb9cb75b454, user.id=354f0ccac1cc4be991872072a6c781a0) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:54.100877 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241a034-bb44-4462-a22e-e3cd82d92b44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:54.102342 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241a034-bb44-4462-a22e-e3cd82d92b44 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:54.116618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 97/182] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:37:53 2022] GET /identity/v3/role_assignments?user.id=354f0ccac1cc4be991872072a6c781a0&scope.project.id=7ca4d22998dd43599a48acb9cb75b454&role.id=e1c6e31e9e944b23bc9ba6b0099d3376 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:54.116618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692feef1-a0dd-4a38-b9c7-0cecaed50eef None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:54.116618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692feef1-a0dd-4a38-b9c7-0cecaed50eef None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:54.116618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692feef1-a0dd-4a38-b9c7-0cecaed50eef None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:54.116618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 98/183] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:37:54.116618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692feef1-a0dd-4a38-b9c7-0cecaed50eef None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:54.146219 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 86/184] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:37:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:37:54.147206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6204a-ff5e-4e2c-bbf3-af30fa372929 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:54.180548 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:54.227029 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:54.252605 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692feef1-a0dd-4a38-b9c7-0cecaed50eef None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:54.271181 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6204a-ff5e-4e2c-bbf3-af30fa372929 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:54.303672 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d25e7-f605-4727-835e-62b89d8a9dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:54.304220 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d25e7-f605-4727-835e-62b89d8a9dc1 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:54.304505 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d25e7-f605-4727-835e-62b89d8a9dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:54.304782 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d25e7-f605-4727-835e-62b89d8a9dc1 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:54.305563 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d25e7-f605-4727-835e-62b89d8a9dc1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:54.305878 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d25e7-f605-4727-835e-62b89d8a9dc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:54.307266 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d25e7-f605-4727-835e-62b89d8a9dc1 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:54.316415 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408193e0-f382-4482-a7ae-ccba92c327e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:54.318114 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 99/185] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:37:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:54.318228 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408193e0-f382-4482-a7ae-ccba92c327e7 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:54.318228 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408193e0-f382-4482-a7ae-ccba92c327e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:54.318228 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408193e0-f382-4482-a7ae-ccba92c327e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:54.318616 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60483747-00f5-484b-bce1-5e39722c4d7d None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:54.318911 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60483747-00f5-484b-bce1-5e39722c4d7d None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:54.319189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60483747-00f5-484b-bce1-5e39722c4d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:54.331717 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408193e0-f382-4482-a7ae-ccba92c327e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:37:54.336802 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-408193e0-f382-4482-a7ae-ccba92c327e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:37:54.336802 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:37:54.336802 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:37:54.336802 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:37:54.336802 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:37:54.336802 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:37:54.336802 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:37:54.336802 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:37:54.336802 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:37:54.336802 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:37:54.336802 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:37:54.336802 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:37:54.336802 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:37:54.336802 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:37:54.336802 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:37:54.336802 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:37:54.337671 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:37:54.337671 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:37:54.337671 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:37:54.337671 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:37:54.337671 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:37:54.337671 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:37:54.337671 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:37:54.337671 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:37:54.337671 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:37:54.337671 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:37:54.337671 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:37:54.337671 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:37:54.337671 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:37:54.337671 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:37:54.337671 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:37:54.337671 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:37:54.338441 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:37:54.338441 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:37:54.338441 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:37:54.338441 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:37:54.338441 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:37:54.338441 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:37:54.338441 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:37:54.338441 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:37:54.338441 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:37:54.338441 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:37:54.338441 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:37:54.338441 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:37:54.339017 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-60483747-00f5-484b-bce1-5e39722c4d7d None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:54.339643 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 87/186] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 3 12:37:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:37:54.339740 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-60483747-00f5-484b-bce1-5e39722c4d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:54.340248 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408193e0-f382-4482-a7ae-ccba92c327e7 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:54.414907 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 100/187] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:37:54.416153 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e0dcb-0f06-497c-b59d-a393eff0dd5e None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:54.416441 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e0dcb-0f06-497c-b59d-a393eff0dd5e None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:54.416719 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e0dcb-0f06-497c-b59d-a393eff0dd5e None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:54.418164 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 101/188] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:37:54.418700 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e0dcb-0f06-497c-b59d-a393eff0dd5e None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:54.461462 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408193e0-f382-4482-a7ae-ccba92c327e7 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:54.475734 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:54.486469 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:54.498291 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ce8f5-fe36-4a79-a07d-a64cd5111f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:54.498932 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ce8f5-fe36-4a79-a07d-a64cd5111f80 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:54.499207 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ce8f5-fe36-4a79-a07d-a64cd5111f80 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:54.499485 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ce8f5-fe36-4a79-a07d-a64cd5111f80 None admin] PATH_INFO: `/v3/projects/7ca4d22998dd43599a48acb9cb75b454` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:54.500624 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ce8f5-fe36-4a79-a07d-a64cd5111f80 None admin] RBAC: Authorizing `identity:get_project(project_id=7ca4d22998dd43599a48acb9cb75b454)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:54.502114 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ce8f5-fe36-4a79-a07d-a64cd5111f80 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:54.508574 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 88/189] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:37:54 2022] GET /identity/v3/projects/7ca4d22998dd43599a48acb9cb75b454 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:54.508574 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ce8f5-fe36-4a79-a07d-a64cd5111f80 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:54.536960 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e0dcb-0f06-497c-b59d-a393eff0dd5e None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:54.569995 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db3a8f-1191-4ddf-85f0-d8777e3d1104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:54.570566 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db3a8f-1191-4ddf-85f0-d8777e3d1104 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:54.570853 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db3a8f-1191-4ddf-85f0-d8777e3d1104 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:54.571126 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db3a8f-1191-4ddf-85f0-d8777e3d1104 None admin] PATH_INFO: `/v3/users/c685eef3eb3d4efd849dc73e0452e140` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:54.584755 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db3a8f-1191-4ddf-85f0-d8777e3d1104 None admin] RBAC: Authorizing `identity:get_user(user_id=c685eef3eb3d4efd849dc73e0452e140)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:54.586238 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db3a8f-1191-4ddf-85f0-d8777e3d1104 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:54.588042 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 102/190] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:37:54 2022] GET /identity/v3/users/c685eef3eb3d4efd849dc73e0452e140 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:54.589076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b6f31-9bd0-41f7-bcd4-42ef62849fe1 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:54.589363 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b6f31-9bd0-41f7-bcd4-42ef62849fe1 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:54.589663 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b6f31-9bd0-41f7-bcd4-42ef62849fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:54.604383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ce8f5-fe36-4a79-a07d-a64cd5111f80 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:54.607006 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-ee3b6f31-9bd0-41f7-bcd4-42ef62849fe1 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:54.608254 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-ee3b6f31-9bd0-41f7-bcd4-42ef62849fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:54.638133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0017a-e2e6-4f4b-99a9-8b749ae51a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:54.639375 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0017a-e2e6-4f4b-99a9-8b749ae51a89 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:54.639662 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0017a-e2e6-4f4b-99a9-8b749ae51a89 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:54.639937 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0017a-e2e6-4f4b-99a9-8b749ae51a89 None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:54.640666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0017a-e2e6-4f4b-99a9-8b749ae51a89 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:54.640971 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0017a-e2e6-4f4b-99a9-8b749ae51a89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:54.642368 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0017a-e2e6-4f4b-99a9-8b749ae51a89 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:54.651590 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 89/191] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:37:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:54.652234 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0017a-e2e6-4f4b-99a9-8b749ae51a89 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:54.674250 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 103/192] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:37:54.674250 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b6f31-9bd0-41f7-bcd4-42ef62849fe1 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:54.703086 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:54.719313 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:54.763737 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0017a-e2e6-4f4b-99a9-8b749ae51a89 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:54.776190 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b6f31-9bd0-41f7-bcd4-42ef62849fe1 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:54.796557 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec1bcb-4606-4b2b-a534-af49c2b8f267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:54.797197 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec1bcb-4606-4b2b-a534-af49c2b8f267 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:54.797480 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec1bcb-4606-4b2b-a534-af49c2b8f267 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:54.797781 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec1bcb-4606-4b2b-a534-af49c2b8f267 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:54.798910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec1bcb-4606-4b2b-a534-af49c2b8f267 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:54.800340 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec1bcb-4606-4b2b-a534-af49c2b8f267 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:54.801963 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 90/193] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:37:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:54.802737 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec1bcb-4606-4b2b-a534-af49c2b8f267 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:54.810937 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de646f34-9a89-4be1-904e-dfb9224a158e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:54.811557 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de646f34-9a89-4be1-904e-dfb9224a158e None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:54.811833 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de646f34-9a89-4be1-904e-dfb9224a158e None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:54.812105 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de646f34-9a89-4be1-904e-dfb9224a158e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:54.812894 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de646f34-9a89-4be1-904e-dfb9224a158e None admin] RBAC: Adding query filter params (role.id=1f3ee786628740418d65c827bc64a9b5, scope.project.id=7ca4d22998dd43599a48acb9cb75b454, user.id=354f0ccac1cc4be991872072a6c781a0) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:54.813202 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de646f34-9a89-4be1-904e-dfb9224a158e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:54.814681 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de646f34-9a89-4be1-904e-dfb9224a158e None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:54.833611 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 104/194] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:37:54 2022] GET /identity/v3/role_assignments?user.id=354f0ccac1cc4be991872072a6c781a0&scope.project.id=7ca4d22998dd43599a48acb9cb75b454&role.id=1f3ee786628740418d65c827bc64a9b5 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:54.833611 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de646f34-9a89-4be1-904e-dfb9224a158e None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:54.916615 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec1bcb-4606-4b2b-a534-af49c2b8f267 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:54.922307 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:54.933190 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de646f34-9a89-4be1-904e-dfb9224a158e None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:54.945099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:54.958128 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6084f3a-3913-49fd-a8bc-011d502fe536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:54.958792 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6084f3a-3913-49fd-a8bc-011d502fe536 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:54.959075 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6084f3a-3913-49fd-a8bc-011d502fe536 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:54.959351 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6084f3a-3913-49fd-a8bc-011d502fe536 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:54.972817 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b034d-4e36-4d90-8565-69381bc89cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:54.973470 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b034d-4e36-4d90-8565-69381bc89cbd None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:54.973785 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b034d-4e36-4d90-8565-69381bc89cbd None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:54.974067 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b034d-4e36-4d90-8565-69381bc89cbd None admin] PATH_INFO: `/v3/users/c685eef3eb3d4efd849dc73e0452e140` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:54.975272 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b034d-4e36-4d90-8565-69381bc89cbd None admin] RBAC: Authorizing `identity:get_user(user_id=c685eef3eb3d4efd849dc73e0452e140)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:54.976720 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b034d-4e36-4d90-8565-69381bc89cbd None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:54.981591 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 105/195] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:37:54 2022] GET /identity/v3/users/c685eef3eb3d4efd849dc73e0452e140 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:54.981591 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b034d-4e36-4d90-8565-69381bc89cbd None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:55.044576 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6084f3a-3913-49fd-a8bc-011d502fe536 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:55.046794 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6084f3a-3913-49fd-a8bc-011d502fe536 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:55.088894 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b034d-4e36-4d90-8565-69381bc89cbd None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:55.123279 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3eb18c-3335-4d9e-aff4-0fe7e00c11c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:55.124002 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3eb18c-3335-4d9e-aff4-0fe7e00c11c7 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:55.124294 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3eb18c-3335-4d9e-aff4-0fe7e00c11c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:55.124571 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3eb18c-3335-4d9e-aff4-0fe7e00c11c7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:55.134770 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3eb18c-3335-4d9e-aff4-0fe7e00c11c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:37:55.140193 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-9a3eb18c-3335-4d9e-aff4-0fe7e00c11c7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:37:55.140193 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:37:55.140193 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:37:55.140193 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:37:55.140193 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:37:55.140193 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:37:55.140193 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:37:55.140193 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:37:55.140193 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:37:55.140193 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:37:55.140193 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:37:55.140193 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:37:55.140193 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:37:55.140193 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:37:55.140193 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:37:55.140193 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:37:55.141267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:37:55.141267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:37:55.141267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:37:55.141267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:37:55.141267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:37:55.141267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:37:55.141267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:37:55.141267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:37:55.141267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:37:55.141267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:37:55.141267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:37:55.141267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:37:55.141267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:37:55.141267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:37:55.141267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:37:55.141267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:37:55.146998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:37:55.146998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:37:55.146998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:37:55.146998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:37:55.146998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:37:55.146998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:37:55.146998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:37:55.146998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:37:55.146998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:37:55.146998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:37:55.146998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:37:55.146998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:37:55.146998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 106/196] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:37:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:37:55.146998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3eb18c-3335-4d9e-aff4-0fe7e00c11c7 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:55.152483 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 91/197] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:37:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:37:55.152483 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6084f3a-3913-49fd-a8bc-011d502fe536 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:55.164145 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:55.175227 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:55.241682 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3eb18c-3335-4d9e-aff4-0fe7e00c11c7 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:55.249955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6084f3a-3913-49fd-a8bc-011d502fe536 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:55.280946 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0ae91-049d-4b39-9005-f59c17b4f7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:55.281735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0ae91-049d-4b39-9005-f59c17b4f7e1 None admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:55.282122 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0ae91-049d-4b39-9005-f59c17b4f7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:55.282493 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0ae91-049d-4b39-9005-f59c17b4f7e1 None admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:55.283288 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a0ae91-049d-4b39-9005-f59c17b4f7e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:55.284821 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a0ae91-049d-4b39-9005-f59c17b4f7e1 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:55.287395 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d246b-1411-4c24-b036-1d4a68baf2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:55.288017 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d246b-1411-4c24-b036-1d4a68baf2e5 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:55.288302 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d246b-1411-4c24-b036-1d4a68baf2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:55.288577 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d246b-1411-4c24-b036-1d4a68baf2e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:55.306294 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 107/198] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Aug 3 12:37:55 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:37:55.307236 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0ae91-049d-4b39-9005-f59c17b4f7e1 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:55.367063 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d246b-1411-4c24-b036-1d4a68baf2e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:55.368576 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d246b-1411-4c24-b036-1d4a68baf2e5 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:55.397654 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:55.400507 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:55.430026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0ae91-049d-4b39-9005-f59c17b4f7e1 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:55.471014 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488345f-c17e-44b0-94f1-df5397548930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:55.471650 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488345f-c17e-44b0-94f1-df5397548930 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:55.472570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488345f-c17e-44b0-94f1-df5397548930 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:55.472570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488345f-c17e-44b0-94f1-df5397548930 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:55.472901 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488345f-c17e-44b0-94f1-df5397548930 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:55.473211 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488345f-c17e-44b0-94f1-df5397548930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:55.474906 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488345f-c17e-44b0-94f1-df5397548930 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:55.486347 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 108/199] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 3 12:37:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:55.487269 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488345f-c17e-44b0-94f1-df5397548930 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:55.490419 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 92/200] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:37:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:37:55.496066 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d246b-1411-4c24-b036-1d4a68baf2e5 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:55.607820 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488345f-c17e-44b0-94f1-df5397548930 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:55.625440 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d246b-1411-4c24-b036-1d4a68baf2e5 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:55.645513 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913d590-e628-403c-be5d-6973ab995f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:55.646171 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913d590-e628-403c-be5d-6973ab995f88 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:55.646455 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913d590-e628-403c-be5d-6973ab995f88 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:55.646731 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913d590-e628-403c-be5d-6973ab995f88 None admin] PATH_INFO: `/v3/projects/002bce0a21cf47508d077794ed19def7` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:55.647899 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913d590-e628-403c-be5d-6973ab995f88 None admin] RBAC: Authorizing `identity:get_project(project_id=002bce0a21cf47508d077794ed19def7)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:55.649345 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913d590-e628-403c-be5d-6973ab995f88 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:55.651161 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 109/201] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:37:55 2022] GET /identity/v3/projects/002bce0a21cf47508d077794ed19def7 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:55.651938 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913d590-e628-403c-be5d-6973ab995f88 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:55.653155 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:55.662448 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:55.688254 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369ca88-f7b4-46d4-8805-77d2e3f12be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:55.688910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369ca88-f7b4-46d4-8805-77d2e3f12be3 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:55.689192 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369ca88-f7b4-46d4-8805-77d2e3f12be3 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:55.689471 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369ca88-f7b4-46d4-8805-77d2e3f12be3 None admin] PATH_INFO: `/v3/users/3b8f2921e1d6477ab8cc516667e9c309` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:55.690783 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369ca88-f7b4-46d4-8805-77d2e3f12be3 None admin] RBAC: Authorizing `identity:get_user(user_id=3b8f2921e1d6477ab8cc516667e9c309)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:55.692222 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369ca88-f7b4-46d4-8805-77d2e3f12be3 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:55.693892 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 93/202] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:37:55 2022] GET /identity/v3/users/3b8f2921e1d6477ab8cc516667e9c309 => generated 289 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:55.694655 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369ca88-f7b4-46d4-8805-77d2e3f12be3 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:55.781943 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913d590-e628-403c-be5d-6973ab995f88 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:55.819892 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369ca88-f7b4-46d4-8805-77d2e3f12be3 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:55.826970 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1354ca-38d5-4f1a-9914-e686eb27df19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:55.828289 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1354ca-38d5-4f1a-9914-e686eb27df19 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:55.828727 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1354ca-38d5-4f1a-9914-e686eb27df19 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:55.829152 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1354ca-38d5-4f1a-9914-e686eb27df19 None admin] PATH_INFO: `/v3/projects/002bce0a21cf47508d077794ed19def7` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:55.830901 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1354ca-38d5-4f1a-9914-e686eb27df19 None admin] RBAC: Authorizing `identity:get_project(project_id=002bce0a21cf47508d077794ed19def7)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:55.833163 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1354ca-38d5-4f1a-9914-e686eb27df19 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:55.836175 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 110/203] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:37:55 2022] GET /identity/v3/projects/002bce0a21cf47508d077794ed19def7 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:55.837404 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1354ca-38d5-4f1a-9914-e686eb27df19 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:55.869697 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a28d6-8c47-4f28-9e58-ac36981f6a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:55.870619 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a28d6-8c47-4f28-9e58-ac36981f6a5d None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:55.870908 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a28d6-8c47-4f28-9e58-ac36981f6a5d None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:55.871185 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a28d6-8c47-4f28-9e58-ac36981f6a5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:55.871995 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a28d6-8c47-4f28-9e58-ac36981f6a5d None admin] RBAC: Adding query filter params (role.id=0e57d142f86c471883fc07a89fe66ec8, scope.project.id=002bce0a21cf47508d077794ed19def7, user.id=c685eef3eb3d4efd849dc73e0452e140) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:55.872568 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a28d6-8c47-4f28-9e58-ac36981f6a5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:55.874800 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a28d6-8c47-4f28-9e58-ac36981f6a5d None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:55.882692 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 94/204] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:37:55 2022] GET /identity/v3/role_assignments?user.id=c685eef3eb3d4efd849dc73e0452e140&scope.project.id=002bce0a21cf47508d077794ed19def7&role.id=0e57d142f86c471883fc07a89fe66ec8 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:55.890806 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a28d6-8c47-4f28-9e58-ac36981f6a5d None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:55.937524 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:55.979821 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1354ca-38d5-4f1a-9914-e686eb27df19 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:56.020658 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c965bbf-9e30-4597-84d9-784bd9226feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:56.021311 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c965bbf-9e30-4597-84d9-784bd9226feb None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:56.021642 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c965bbf-9e30-4597-84d9-784bd9226feb None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:56.022427 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c965bbf-9e30-4597-84d9-784bd9226feb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:56.037871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:56.099140 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c965bbf-9e30-4597-84d9-784bd9226feb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:56.100640 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c965bbf-9e30-4597-84d9-784bd9226feb None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:56.210932 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 111/205] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:37:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:37:56.211595 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:56.216398 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c965bbf-9e30-4597-84d9-784bd9226feb None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:56.218043 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a28d6-8c47-4f28-9e58-ac36981f6a5d None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:56.314255 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be02e98-66d6-4b10-a323-67ac26b37272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:56.314898 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be02e98-66d6-4b10-a323-67ac26b37272 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:56.315184 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be02e98-66d6-4b10-a323-67ac26b37272 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:56.315465 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be02e98-66d6-4b10-a323-67ac26b37272 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:56.316276 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be02e98-66d6-4b10-a323-67ac26b37272 None admin] RBAC: Adding query filter params (role.id=1f3ee786628740418d65c827bc64a9b5, scope.project.id=002bce0a21cf47508d077794ed19def7, user.id=c685eef3eb3d4efd849dc73e0452e140) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:56.316591 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be02e98-66d6-4b10-a323-67ac26b37272 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:56.318118 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be02e98-66d6-4b10-a323-67ac26b37272 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:56.320878 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c965bbf-9e30-4597-84d9-784bd9226feb None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:56.324038 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 95/206] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:37:55 2022] GET /identity/v3/role_assignments?user.id=c685eef3eb3d4efd849dc73e0452e140&scope.project.id=002bce0a21cf47508d077794ed19def7&role.id=1f3ee786628740418d65c827bc64a9b5 => generated 259 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:56.359681 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e100609-4c94-469e-be1f-40e695185594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:56.360346 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e100609-4c94-469e-be1f-40e695185594 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:56.360628 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e100609-4c94-469e-be1f-40e695185594 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:56.360907 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e100609-4c94-469e-be1f-40e695185594 None admin] PATH_INFO: `/v3/projects/7ca4d22998dd43599a48acb9cb75b454` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:56.362136 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e100609-4c94-469e-be1f-40e695185594 None admin] RBAC: Authorizing `identity:get_project(project_id=7ca4d22998dd43599a48acb9cb75b454)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:56.363601 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e100609-4c94-469e-be1f-40e695185594 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:56.365568 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 112/207] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:37:56 2022] GET /identity/v3/projects/7ca4d22998dd43599a48acb9cb75b454 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:37:56.371737 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be02e98-66d6-4b10-a323-67ac26b37272 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:56.539857 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be02e98-66d6-4b10-a323-67ac26b37272 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:56.566254 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:56.575040 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c575a-2be8-49d7-8c17-db5032579544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:56.575662 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c575a-2be8-49d7-8c17-db5032579544 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:56.576001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c575a-2be8-49d7-8c17-db5032579544 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:56.576282 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c575a-2be8-49d7-8c17-db5032579544 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:56.577087 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c575a-2be8-49d7-8c17-db5032579544 None admin] RBAC: Adding query filter params (role.id=88752d25daad459b9cc7232c4818bb30, scope.project.id=7ca4d22998dd43599a48acb9cb75b454, user.id=3b8f2921e1d6477ab8cc516667e9c309) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:56.577397 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c575a-2be8-49d7-8c17-db5032579544 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:56.578948 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c575a-2be8-49d7-8c17-db5032579544 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:56.585481 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 96/208] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:37:56 2022] GET /identity/v3/role_assignments?user.id=3b8f2921e1d6477ab8cc516667e9c309&scope.project.id=7ca4d22998dd43599a48acb9cb75b454&role.id=88752d25daad459b9cc7232c4818bb30 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:57.559720 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa4f01-940a-4cb8-ba80-8236a1e66608 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:57.560936 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa4f01-940a-4cb8-ba80-8236a1e66608 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:57.561436 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa4f01-940a-4cb8-ba80-8236a1e66608 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:57.563331 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 113/209] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:37:57.569006 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac5106-2200-49f8-8349-fc6e2b12b4db None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:57.569866 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac5106-2200-49f8-8349-fc6e2b12b4db None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:57.570343 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac5106-2200-49f8-8349-fc6e2b12b4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:57.589636 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-30ac5106-2200-49f8-8349-fc6e2b12b4db None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:57.591187 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-30ac5106-2200-49f8-8349-fc6e2b12b4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:57.663396 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 97/210] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:37:57.687133 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa4f01-940a-4cb8-ba80-8236a1e66608 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:57.741817 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:57.802258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa4f01-940a-4cb8-ba80-8236a1e66608 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:57.835858 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b7561-faea-4104-86b6-c179c647edb4 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:57.836432 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b7561-faea-4104-86b6-c179c647edb4 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:57.836921 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b7561-faea-4104-86b6-c179c647edb4 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:57.838374 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56880f-0a3b-4b00-9db1-65c750d13fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:57.839029 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56880f-0a3b-4b00-9db1-65c750d13fca None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:57.839355 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56880f-0a3b-4b00-9db1-65c750d13fca None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:57.839551 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 98/211] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:37:57.839644 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56880f-0a3b-4b00-9db1-65c750d13fca None admin] PATH_INFO: `/v3/roles/member` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:57.844776 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9308ef-e1cf-404c-afa6-398b8cb82c86 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:57.845302 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9308ef-e1cf-404c-afa6-398b8cb82c86 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:57.845826 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9308ef-e1cf-404c-afa6-398b8cb82c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:57.851324 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56880f-0a3b-4b00-9db1-65c750d13fca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:37:57.856415 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-8a56880f-0a3b-4b00-9db1-65c750d13fca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:37:57.856415 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:37:57.856415 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:37:57.856415 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:37:57.856415 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:37:57.856415 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:37:57.856415 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:37:57.856415 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:37:57.856415 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:37:57.856415 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:37:57.856415 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:37:57.856415 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:37:57.856415 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:37:57.856415 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:37:57.856415 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:37:57.856415 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:37:57.857900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:37:57.857900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:37:57.857900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:37:57.857900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:37:57.857900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:37:57.857900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:37:57.857900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:37:57.857900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:37:57.857900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:37:57.857900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:37:57.857900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:37:57.857900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:37:57.857900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:37:57.857900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:37:57.857900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:37:57.857900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:37:57.858708 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:37:57.858708 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:37:57.858708 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:37:57.858708 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:37:57.858708 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:37:57.858708 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:37:57.858708 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:37:57.858708 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:37:57.858708 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:37:57.858708 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:37:57.858708 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:37:57.858708 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:37:57.858708 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 114/212] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:37:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:37:57.868218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-cb9308ef-e1cf-404c-afa6-398b8cb82c86 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:57.869383 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56880f-0a3b-4b00-9db1-65c750d13fca None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:57.869518 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-cb9308ef-e1cf-404c-afa6-398b8cb82c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:57.942243 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 99/213] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:37:57.967223 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9308ef-e1cf-404c-afa6-398b8cb82c86 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:57.981721 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56880f-0a3b-4b00-9db1-65c750d13fca None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:57.984476 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:58.016958 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:58.023066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893ecd2-cb72-460c-a0c4-787eda1a9fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:58.023689 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893ecd2-cb72-460c-a0c4-787eda1a9fc0 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:58.023972 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893ecd2-cb72-460c-a0c4-787eda1a9fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:58.024247 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893ecd2-cb72-460c-a0c4-787eda1a9fc0 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:58.024980 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2893ecd2-cb72-460c-a0c4-787eda1a9fc0 None admin] RBAC: Adding query filter params (name=member) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:58.025287 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2893ecd2-cb72-460c-a0c4-787eda1a9fc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:58.026702 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2893ecd2-cb72-460c-a0c4-787eda1a9fc0 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:58.035116 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 115/214] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 3 12:37:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:58.036297 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517442e-c9b5-4da3-9183-2e969810af2b None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:58.036585 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517442e-c9b5-4da3-9183-2e969810af2b None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:58.036874 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517442e-c9b5-4da3-9183-2e969810af2b None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:58.038268 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 116/215] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:37:58.040796 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517442e-c9b5-4da3-9183-2e969810af2b None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:58.083295 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9308ef-e1cf-404c-afa6-398b8cb82c86 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:58.120774 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc832366-ea3e-447d-9ad7-9bd180754d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:58.121345 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc832366-ea3e-447d-9ad7-9bd180754d9d None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:58.121663 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc832366-ea3e-447d-9ad7-9bd180754d9d None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:58.121939 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc832366-ea3e-447d-9ad7-9bd180754d9d None admin] PATH_INFO: `/v3/domains/default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:58.123112 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc832366-ea3e-447d-9ad7-9bd180754d9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:58.124930 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc832366-ea3e-447d-9ad7-9bd180754d9d None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:58.129548 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 100/216] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:37:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:37:58.129548 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31eb1a7-c053-429e-b8ac-06a3814215ee None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:58.129548 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31eb1a7-c053-429e-b8ac-06a3814215ee None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:58.129548 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31eb1a7-c053-429e-b8ac-06a3814215ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:58.145615 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-c31eb1a7-c053-429e-b8ac-06a3814215ee None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:58.146814 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-c31eb1a7-c053-429e-b8ac-06a3814215ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:58.160160 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517442e-c9b5-4da3-9183-2e969810af2b None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:58.195045 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e6b06-d3ee-4174-b488-e1246ca054a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:58.195683 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e6b06-d3ee-4174-b488-e1246ca054a1 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:58.196001 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e6b06-d3ee-4174-b488-e1246ca054a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:58.196280 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e6b06-d3ee-4174-b488-e1246ca054a1 None admin] PATH_INFO: `/v3/users/d75a54002cd84963bd8a165d3f55a294` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:58.209847 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e6b06-d3ee-4174-b488-e1246ca054a1 None admin] RBAC: Authorizing `identity:get_user(user_id=d75a54002cd84963bd8a165d3f55a294)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:58.211315 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e6b06-d3ee-4174-b488-e1246ca054a1 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:58.213188 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 117/217] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:37:58 2022] GET /identity/v3/users/d75a54002cd84963bd8a165d3f55a294 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:37:58.213814 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e6b06-d3ee-4174-b488-e1246ca054a1 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:58.222726 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 101/218] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:37:58.223830 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31eb1a7-c053-429e-b8ac-06a3814215ee None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:58.250809 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:58.275394 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:58.335169 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e6b06-d3ee-4174-b488-e1246ca054a1 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:58.338646 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31eb1a7-c053-429e-b8ac-06a3814215ee None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:58.372721 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d4860-79f8-4372-939e-364fd9b44a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:58.373323 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d4860-79f8-4372-939e-364fd9b44a6e None admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:58.373634 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d4860-79f8-4372-939e-364fd9b44a6e None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:58.373914 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d4860-79f8-4372-939e-364fd9b44a6e None admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:58.374601 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d4860-79f8-4372-939e-364fd9b44a6e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:58.376045 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d4860-79f8-4372-939e-364fd9b44a6e None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:58.381617 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993527fa-6c31-44ef-a13d-4e54b4718502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:58.382460 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993527fa-6c31-44ef-a13d-4e54b4718502 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:58.382922 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993527fa-6c31-44ef-a13d-4e54b4718502 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:58.383377 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993527fa-6c31-44ef-a13d-4e54b4718502 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:58.398050 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 118/219] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Aug 3 12:37:58 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:37:58.398050 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d4860-79f8-4372-939e-364fd9b44a6e None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:58.495356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993527fa-6c31-44ef-a13d-4e54b4718502 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:58.497252 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993527fa-6c31-44ef-a13d-4e54b4718502 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:58.505982 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:58.526121 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d4860-79f8-4372-939e-364fd9b44a6e None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:58.549214 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:58.577410 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a449d1-9ba7-4d62-adc1-ae5d53c3d032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:58.578567 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a449d1-9ba7-4d62-adc1-ae5d53c3d032 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:58.579516 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a449d1-9ba7-4d62-adc1-ae5d53c3d032 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:58.579516 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a449d1-9ba7-4d62-adc1-ae5d53c3d032 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:58.596304 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a449d1-9ba7-4d62-adc1-ae5d53c3d032 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:37:58.603010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-d8a449d1-9ba7-4d62-adc1-ae5d53c3d032 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:37:58.603010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:37:58.603010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:37:58.603010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:37:58.603010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:37:58.603010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:37:58.603010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:37:58.603010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:37:58.603010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:37:58.603010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:37:58.603010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:37:58.603010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:37:58.603010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:37:58.603010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:37:58.603010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:37:58.603010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:37:58.603940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:37:58.603940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:37:58.603940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:37:58.603940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:37:58.603940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:37:58.603940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:37:58.603940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:37:58.603940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:37:58.603940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:37:58.603940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:37:58.603940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:37:58.603940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:37:58.603940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:37:58.603940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:37:58.603940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:37:58.603940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:37:58.604722 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:37:58.604722 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:37:58.604722 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:37:58.604722 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:37:58.604722 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:37:58.604722 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:37:58.604722 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:37:58.604722 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:37:58.604722 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:37:58.604722 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:37:58.604722 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:37:58.604722 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:37:58.604722 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 119/220] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 3 12:37:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:37:58.612297 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a449d1-9ba7-4d62-adc1-ae5d53c3d032 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:58.631881 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 102/221] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:37:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:37:58.637661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993527fa-6c31-44ef-a13d-4e54b4718502 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:58.743800 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a449d1-9ba7-4d62-adc1-ae5d53c3d032 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:58.767868 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993527fa-6c31-44ef-a13d-4e54b4718502 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:58.788029 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d36499-9672-4ccb-b0b1-b55c301dbc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:58.789173 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d36499-9672-4ccb-b0b1-b55c301dbc0e None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:58.789459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d36499-9672-4ccb-b0b1-b55c301dbc0e None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:58.789769 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d36499-9672-4ccb-b0b1-b55c301dbc0e None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:58.790501 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d36499-9672-4ccb-b0b1-b55c301dbc0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:58.790803 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d36499-9672-4ccb-b0b1-b55c301dbc0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:58.792630 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d36499-9672-4ccb-b0b1-b55c301dbc0e None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:58.799992 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:58.804506 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 120/222] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:37:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:58.806348 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24422f-e16e-4f44-b5f8-55025a80dc9c None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:58.806348 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24422f-e16e-4f44-b5f8-55025a80dc9c None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:58.806348 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24422f-e16e-4f44-b5f8-55025a80dc9c None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:58.807569 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 121/223] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:37:58.812451 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24422f-e16e-4f44-b5f8-55025a80dc9c None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:58.814037 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572fc9e-eac0-429f-892c-5e1c43d88dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:58.814705 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572fc9e-eac0-429f-892c-5e1c43d88dd3 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:58.814984 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572fc9e-eac0-429f-892c-5e1c43d88dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:58.815465 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572fc9e-eac0-429f-892c-5e1c43d88dd3 None admin] PATH_INFO: `/v3/projects/002bce0a21cf47508d077794ed19def7` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:58.817658 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572fc9e-eac0-429f-892c-5e1c43d88dd3 None admin] RBAC: Authorizing `identity:get_project(project_id=002bce0a21cf47508d077794ed19def7)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:58.819124 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572fc9e-eac0-429f-892c-5e1c43d88dd3 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:58.820937 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 103/224] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:37:58 2022] GET /identity/v3/projects/002bce0a21cf47508d077794ed19def7 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:37:58.822407 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149317a3-a9de-469e-86ca-cfdd3c327d9a None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:58.822694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149317a3-a9de-469e-86ca-cfdd3c327d9a None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:58.822972 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149317a3-a9de-469e-86ca-cfdd3c327d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:58.844661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-149317a3-a9de-469e-86ca-cfdd3c327d9a None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:37:58.846246 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-149317a3-a9de-469e-86ca-cfdd3c327d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:37:58.848677 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:58.924667 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 104/225] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:37:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:37:58.925920 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149317a3-a9de-469e-86ca-cfdd3c327d9a None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:58.972486 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24422f-e16e-4f44-b5f8-55025a80dc9c None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:59.009436 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db1766-028c-4fa2-a7f7-32fdfff84b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:59.010109 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db1766-028c-4fa2-a7f7-32fdfff84b21 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:59.010388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db1766-028c-4fa2-a7f7-32fdfff84b21 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:59.010659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db1766-028c-4fa2-a7f7-32fdfff84b21 None admin] PATH_INFO: `/v3/users/c685eef3eb3d4efd849dc73e0452e140` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:59.012167 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db1766-028c-4fa2-a7f7-32fdfff84b21 None admin] RBAC: Authorizing `identity:get_user(user_id=c685eef3eb3d4efd849dc73e0452e140)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:59.013784 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db1766-028c-4fa2-a7f7-32fdfff84b21 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:59.015705 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 122/226] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:37:58 2022] GET /identity/v3/users/c685eef3eb3d4efd849dc73e0452e140 => generated 283 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:37:59.016647 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db1766-028c-4fa2-a7f7-32fdfff84b21 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:59.041035 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149317a3-a9de-469e-86ca-cfdd3c327d9a None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:59.078152 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e1880-4ba0-4532-9678-fb8f69b7fe0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:59.079132 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e1880-4ba0-4532-9678-fb8f69b7fe0e None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:59.079610 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e1880-4ba0-4532-9678-fb8f69b7fe0e None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:59.080095 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e1880-4ba0-4532-9678-fb8f69b7fe0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:59.081090 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e1880-4ba0-4532-9678-fb8f69b7fe0e None admin] RBAC: Adding query filter params (role.id=e1c6e31e9e944b23bc9ba6b0099d3376, scope.project.id=002bce0a21cf47508d077794ed19def7, user.id=d75a54002cd84963bd8a165d3f55a294) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:59.081673 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e1880-4ba0-4532-9678-fb8f69b7fe0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:59.083304 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e1880-4ba0-4532-9678-fb8f69b7fe0e None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:59.087932 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:59.089943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 105/227] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:37:58 2022] GET /identity/v3/role_assignments?user.id=d75a54002cd84963bd8a165d3f55a294&scope.project.id=002bce0a21cf47508d077794ed19def7&role.id=e1c6e31e9e944b23bc9ba6b0099d3376 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:59.091240 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e1880-4ba0-4532-9678-fb8f69b7fe0e None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:59.094888 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:59.153150 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db1766-028c-4fa2-a7f7-32fdfff84b21 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:59.206454 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e1880-4ba0-4532-9678-fb8f69b7fe0e None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:59.220578 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a731ee0-78d2-4ea8-b972-74c83b11ce01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:59.221171 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a731ee0-78d2-4ea8-b972-74c83b11ce01 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:59.221453 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a731ee0-78d2-4ea8-b972-74c83b11ce01 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:59.221754 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a731ee0-78d2-4ea8-b972-74c83b11ce01 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:59.243590 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a731ee0-78d2-4ea8-b972-74c83b11ce01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:37:59.247168 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a69860-72d5-4e6d-a2d3-34083974a97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:59.248107 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a69860-72d5-4e6d-a2d3-34083974a97e None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:59.248628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a69860-72d5-4e6d-a2d3-34083974a97e None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:59.248799 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-4a731ee0-78d2-4ea8-b972-74c83b11ce01 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:37:59.248799 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:37:59.248799 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:37:59.248799 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:37:59.248799 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:37:59.248799 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:37:59.248799 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:37:59.248799 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:37:59.248799 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:37:59.248799 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:37:59.248799 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:37:59.248799 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:37:59.248799 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:37:59.248799 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:37:59.248799 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:37:59.248799 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:37:59.249652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:37:59.249652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:37:59.249652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:37:59.249652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:37:59.249652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:37:59.249652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:37:59.249652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:37:59.249652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:37:59.249652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:37:59.249652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:37:59.249652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:37:59.249652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:37:59.249652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:37:59.249652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:37:59.249652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:37:59.249652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:37:59.250434 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:37:59.250434 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:37:59.250434 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:37:59.250434 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:37:59.250434 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:37:59.250434 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:37:59.250434 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:37:59.250434 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:37:59.250434 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:37:59.250434 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:37:59.250434 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:37:59.250434 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:37:59.251783 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a69860-72d5-4e6d-a2d3-34083974a97e None admin] PATH_INFO: `/v3/projects/002bce0a21cf47508d077794ed19def7` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:59.253268 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a69860-72d5-4e6d-a2d3-34083974a97e None admin] RBAC: Authorizing `identity:get_project(project_id=002bce0a21cf47508d077794ed19def7)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:59.254403 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 123/228] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 3 12:37:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:37:59.255330 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a69860-72d5-4e6d-a2d3-34083974a97e None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:59.257317 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 106/229] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:37:59 2022] GET /identity/v3/projects/002bce0a21cf47508d077794ed19def7 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:59.260550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a731ee0-78d2-4ea8-b972-74c83b11ce01 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:59.264786 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a69860-72d5-4e6d-a2d3-34083974a97e None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:59.369374 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:59.405104 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a731ee0-78d2-4ea8-b972-74c83b11ce01 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:59.405606 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a69860-72d5-4e6d-a2d3-34083974a97e None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:59.434196 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:59.444140 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec10934-101e-44f6-bcaa-ed03c488f0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:59.444312 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa51b3-13fe-4f30-9c43-1e876bf2cb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:59.444862 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa51b3-13fe-4f30-9c43-1e876bf2cb29 None admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:59.445147 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa51b3-13fe-4f30-9c43-1e876bf2cb29 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:59.445426 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa51b3-13fe-4f30-9c43-1e876bf2cb29 None admin] PATH_INFO: `/v3/projects/002bce0a21cf47508d077794ed19def7/users/c685eef3eb3d4efd849dc73e0452e140/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:59.445828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec10934-101e-44f6-bcaa-ed03c488f0f0 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:59.446306 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec10934-101e-44f6-bcaa-ed03c488f0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:59.446773 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec10934-101e-44f6-bcaa-ed03c488f0f0 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:59.447598 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec10934-101e-44f6-bcaa-ed03c488f0f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:37:59.447768 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa51b3-13fe-4f30-9c43-1e876bf2cb29 None admin] RBAC: Authorizing `identity:create_grant(project_id=002bce0a21cf47508d077794ed19def7, user_id=c685eef3eb3d4efd849dc73e0452e140, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:59.448080 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec10934-101e-44f6-bcaa-ed03c488f0f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:59.449563 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec10934-101e-44f6-bcaa-ed03c488f0f0 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:59.449747 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa51b3-13fe-4f30-9c43-1e876bf2cb29 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:59.464239 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 107/230] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 3 12:37:59 2022] PUT /identity/v3/projects/002bce0a21cf47508d077794ed19def7/users/c685eef3eb3d4efd849dc73e0452e140/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:37:59.473845 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 124/231] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:37:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:37:59.479823 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa51b3-13fe-4f30-9c43-1e876bf2cb29 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:59.632655 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa51b3-13fe-4f30-9c43-1e876bf2cb29 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:59.663088 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:37:59.670632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283d5e2-1d95-4b27-bc4e-f0c0ed605a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:59.671596 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283d5e2-1d95-4b27-bc4e-f0c0ed605a29 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:59.672176 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283d5e2-1d95-4b27-bc4e-f0c0ed605a29 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:59.672457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283d5e2-1d95-4b27-bc4e-f0c0ed605a29 None admin] PATH_INFO: `/v3/users/c685eef3eb3d4efd849dc73e0452e140` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:59.673751 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283d5e2-1d95-4b27-bc4e-f0c0ed605a29 None admin] RBAC: Authorizing `identity:get_user(user_id=c685eef3eb3d4efd849dc73e0452e140)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:59.675202 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283d5e2-1d95-4b27-bc4e-f0c0ed605a29 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:59.677221 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 108/232] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:37:59 2022] GET /identity/v3/users/c685eef3eb3d4efd849dc73e0452e140 => generated 283 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:59.682670 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec10934-101e-44f6-bcaa-ed03c488f0f0 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:37:59.813341 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec10934-101e-44f6-bcaa-ed03c488f0f0 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:37:59.856877 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279bac9b-52b6-47ba-bfc4-9b5cbd1447e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:37:59.857857 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bac9b-52b6-47ba-bfc4-9b5cbd1447e4 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:37:59.858143 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bac9b-52b6-47ba-bfc4-9b5cbd1447e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:37:59.858421 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bac9b-52b6-47ba-bfc4-9b5cbd1447e4 None admin] PATH_INFO: `/v3/projects/002bce0a21cf47508d077794ed19def7` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:37:59.860309 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279bac9b-52b6-47ba-bfc4-9b5cbd1447e4 None admin] RBAC: Authorizing `identity:get_project(project_id=002bce0a21cf47508d077794ed19def7)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:37:59.861905 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279bac9b-52b6-47ba-bfc4-9b5cbd1447e4 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:37:59.863620 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 125/233] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:37:59 2022] GET /identity/v3/projects/002bce0a21cf47508d077794ed19def7 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:37:59.869658 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283d5e2-1d95-4b27-bc4e-f0c0ed605a29 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:00.011224 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283d5e2-1d95-4b27-bc4e-f0c0ed605a29 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:00.051093 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9165fdd-09c4-4305-8ff0-c45bad28fb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:00.051822 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9165fdd-09c4-4305-8ff0-c45bad28fb76 None admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:00.052111 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9165fdd-09c4-4305-8ff0-c45bad28fb76 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:00.052391 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9165fdd-09c4-4305-8ff0-c45bad28fb76 None admin] PATH_INFO: `/v3/projects/002bce0a21cf47508d077794ed19def7/users/c685eef3eb3d4efd849dc73e0452e140/roles/1f3ee786628740418d65c827bc64a9b5` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:00.054644 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9165fdd-09c4-4305-8ff0-c45bad28fb76 None admin] RBAC: Authorizing `identity:create_grant(project_id=002bce0a21cf47508d077794ed19def7, user_id=c685eef3eb3d4efd849dc73e0452e140, role_id=1f3ee786628740418d65c827bc64a9b5)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:00.056099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9165fdd-09c4-4305-8ff0-c45bad28fb76 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:00.071965 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 109/234] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 3 12:37:59 2022] PUT /identity/v3/projects/002bce0a21cf47508d077794ed19def7/users/c685eef3eb3d4efd849dc73e0452e140/roles/1f3ee786628740418d65c827bc64a9b5 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:38:00.948445 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816186f8-a6cc-427b-b0fa-fa77dc0bf6e4 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:00.948964 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816186f8-a6cc-427b-b0fa-fa77dc0bf6e4 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:00.948964 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816186f8-a6cc-427b-b0fa-fa77dc0bf6e4 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:00.950668 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 126/235] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:00.955680 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd60936-fb50-4544-9318-0ebfcf35117e None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:00.956083 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd60936-fb50-4544-9318-0ebfcf35117e None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:00.956265 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd60936-fb50-4544-9318-0ebfcf35117e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:00.978483 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-ffd60936-fb50-4544-9318-0ebfcf35117e None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:00.979704 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-ffd60936-fb50-4544-9318-0ebfcf35117e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:01.051169 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:01.073929 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 110/236] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:01.085965 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5333e5-f6b2-4c8c-b93d-dde18c4281ab None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:01.086252 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5333e5-f6b2-4c8c-b93d-dde18c4281ab None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:01.086533 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5333e5-f6b2-4c8c-b93d-dde18c4281ab None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:01.088081 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 127/237] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:01.093451 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a05a1-b811-40e4-aabb-789223c1a7a1 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:01.093773 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a05a1-b811-40e4-aabb-789223c1a7a1 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:01.094054 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a05a1-b811-40e4-aabb-789223c1a7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:01.106053 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5333e5-f6b2-4c8c-b93d-dde18c4281ab None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:01.115770 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-d08a05a1-b811-40e4-aabb-789223c1a7a1 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:01.116962 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-d08a05a1-b811-40e4-aabb-789223c1a7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:01.225001 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:01.240103 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 111/238] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:01.262032 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a05a1-b811-40e4-aabb-789223c1a7a1 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:01.331139 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5333e5-f6b2-4c8c-b93d-dde18c4281ab None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:01.384360 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a05a1-b811-40e4-aabb-789223c1a7a1 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:01.385804 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391157e-a396-404a-b260-98bbf2399d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:01.386557 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391157e-a396-404a-b260-98bbf2399d43 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:01.386942 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391157e-a396-404a-b260-98bbf2399d43 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:01.387319 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391157e-a396-404a-b260-98bbf2399d43 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:01.398342 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391157e-a396-404a-b260-98bbf2399d43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:01.402776 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:01.404385 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-4391157e-a396-404a-b260-98bbf2399d43 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:38:01.404385 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:01.404385 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:01.404385 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:01.404385 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:01.404385 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:01.404385 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:01.404385 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:01.404385 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:01.404385 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:01.404385 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:01.404385 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:01.404385 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:01.404385 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:01.404385 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:01.404385 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:01.406536 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:01.406536 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:01.406536 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:01.406536 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:01.406536 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:01.406536 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:01.406536 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:01.406536 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:01.406536 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:01.406536 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:01.406536 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:01.406536 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:01.406536 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:01.406536 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:01.406536 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:01.406536 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:01.408121 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:01.408121 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:01.408121 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:01.408121 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:01.408121 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:01.408121 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:01.408121 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:01.408121 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:01.408121 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:01.408121 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:01.408121 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:38:01.408121 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:01.408121 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 128/239] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:38:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:01.413538 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391157e-a396-404a-b260-98bbf2399d43 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:01.443825 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dffb9-6185-4637-bcf7-12c8482e758a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:01.444492 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dffb9-6185-4637-bcf7-12c8482e758a None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:01.444775 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dffb9-6185-4637-bcf7-12c8482e758a None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:01.445051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dffb9-6185-4637-bcf7-12c8482e758a None admin] PATH_INFO: `/v3/domains/default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:01.447221 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2dffb9-6185-4637-bcf7-12c8482e758a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:01.448718 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2dffb9-6185-4637-bcf7-12c8482e758a None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:01.453126 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 112/240] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:01.458900 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dffb9-6185-4637-bcf7-12c8482e758a None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:01.597896 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dffb9-6185-4637-bcf7-12c8482e758a None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:01.637747 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd8cb2-6b3b-423a-b30b-a4c4aab61dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:01.638897 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd8cb2-6b3b-423a-b30b-a4c4aab61dab None admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:01.639180 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd8cb2-6b3b-423a-b30b-a4c4aab61dab None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:01.639455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd8cb2-6b3b-423a-b30b-a4c4aab61dab None admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:01.640152 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd8cb2-6b3b-423a-b30b-a4c4aab61dab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:01.641480 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391157e-a396-404a-b260-98bbf2399d43 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:01.641610 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd8cb2-6b3b-423a-b30b-a4c4aab61dab None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:01.674633 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:01.676296 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 113/241] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Aug 3 12:38:01 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:38:01.677594 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9eefcf-84fe-4813-aa63-7da453c1e483 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:01.677886 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9eefcf-84fe-4813-aa63-7da453c1e483 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:01.678200 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9eefcf-84fe-4813-aa63-7da453c1e483 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:01.679530 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 114/242] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:01.686646 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90780e41-517b-4d23-a2aa-f7048b095785 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:01.686986 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90780e41-517b-4d23-a2aa-f7048b095785 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:01.687269 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90780e41-517b-4d23-a2aa-f7048b095785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:01.713543 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-90780e41-517b-4d23-a2aa-f7048b095785 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:01.714843 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-90780e41-517b-4d23-a2aa-f7048b095785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:01.718705 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4d0d9-730a-4e20-b58e-844a5f513655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:01.719352 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4d0d9-730a-4e20-b58e-844a5f513655 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:01.719641 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4d0d9-730a-4e20-b58e-844a5f513655 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:01.719922 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4d0d9-730a-4e20-b58e-844a5f513655 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:01.720660 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e4d0d9-730a-4e20-b58e-844a5f513655 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:01.720970 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e4d0d9-730a-4e20-b58e-844a5f513655 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:01.722403 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e4d0d9-730a-4e20-b58e-844a5f513655 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:01.739553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 129/243] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 3 12:38:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:01.750980 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4d0d9-730a-4e20-b58e-844a5f513655 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:01.762649 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:01.840478 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 115/244] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:01.867598 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90780e41-517b-4d23-a2aa-f7048b095785 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:01.933136 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4d0d9-730a-4e20-b58e-844a5f513655 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:01.970021 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335b15d-4ebf-4a43-9cee-55732a3ea761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:01.970656 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335b15d-4ebf-4a43-9cee-55732a3ea761 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:01.970973 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335b15d-4ebf-4a43-9cee-55732a3ea761 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:01.971253 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335b15d-4ebf-4a43-9cee-55732a3ea761 None admin] PATH_INFO: `/v3/users/e35cb714ebbe465c8579244ea05c94d2` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:01.986884 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f335b15d-4ebf-4a43-9cee-55732a3ea761 None admin] RBAC: Authorizing `identity:get_user(user_id=e35cb714ebbe465c8579244ea05c94d2)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:01.988360 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f335b15d-4ebf-4a43-9cee-55732a3ea761 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:01.990518 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 130/245] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:38:01 2022] GET /identity/v3/users/e35cb714ebbe465c8579244ea05c94d2 => generated 297 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:01.996800 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335b15d-4ebf-4a43-9cee-55732a3ea761 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:02.017790 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90780e41-517b-4d23-a2aa-f7048b095785 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:02.061156 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:02.067012 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36fd26f-ff52-42dc-8d54-28739f1cd823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:02.068140 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fd26f-ff52-42dc-8d54-28739f1cd823 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:02.069074 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fd26f-ff52-42dc-8d54-28739f1cd823 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:02.069743 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fd26f-ff52-42dc-8d54-28739f1cd823 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:02.084621 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36fd26f-ff52-42dc-8d54-28739f1cd823 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:02.091681 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-f36fd26f-ff52-42dc-8d54-28739f1cd823 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:38:02.091681 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:02.091681 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:02.091681 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:02.091681 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:02.091681 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:02.091681 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:02.091681 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:02.091681 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:02.091681 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:02.091681 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:02.091681 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:02.091681 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:02.091681 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:02.091681 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:02.091681 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:02.092640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:02.092640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:02.092640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:02.092640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:02.092640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:02.092640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:02.092640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:02.092640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:02.092640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:02.092640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:02.092640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:02.092640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:02.092640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:02.092640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:02.092640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:02.092640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:02.093431 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:02.093431 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:02.093431 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:02.093431 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:02.093431 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:02.093431 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:02.093431 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:02.093431 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:02.093431 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:02.093431 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:02.093431 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:38:02.093431 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:02.099831 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 116/246] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:38:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:38:02.103053 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36fd26f-ff52-42dc-8d54-28739f1cd823 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:02.146915 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335b15d-4ebf-4a43-9cee-55732a3ea761 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:02.151479 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:02.188675 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4728f-a95e-426f-a641-81bd9a3e538a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:02.189341 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4728f-a95e-426f-a641-81bd9a3e538a None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:02.189675 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4728f-a95e-426f-a641-81bd9a3e538a None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:02.189954 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4728f-a95e-426f-a641-81bd9a3e538a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:02.243595 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36fd26f-ff52-42dc-8d54-28739f1cd823 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:02.281590 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4728f-a95e-426f-a641-81bd9a3e538a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:02.283183 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4728f-a95e-426f-a641-81bd9a3e538a None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:02.290851 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa06541-a9a1-4b03-b12f-687ee24c4d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:02.291482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa06541-a9a1-4b03-b12f-687ee24c4d57 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:02.291763 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa06541-a9a1-4b03-b12f-687ee24c4d57 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:02.292038 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa06541-a9a1-4b03-b12f-687ee24c4d57 None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:02.292774 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa06541-a9a1-4b03-b12f-687ee24c4d57 None admin] RBAC: Adding query filter params (name=member) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:02.293080 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa06541-a9a1-4b03-b12f-687ee24c4d57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:02.295091 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa06541-a9a1-4b03-b12f-687ee24c4d57 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:02.306762 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 117/247] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 3 12:38:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:02.308652 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104bfb1-9c81-4a66-9521-0125d91add8f None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:02.308949 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104bfb1-9c81-4a66-9521-0125d91add8f None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:02.309230 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104bfb1-9c81-4a66-9521-0125d91add8f None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:02.310861 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 118/248] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:02.314434 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104bfb1-9c81-4a66-9521-0125d91add8f None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:02.340284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:02.426364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 131/249] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:38:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:38:02.428029 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6ec8b-a685-4977-b1b3-7570c9987990 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:02.428615 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6ec8b-a685-4977-b1b3-7570c9987990 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:02.429090 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6ec8b-a685-4977-b1b3-7570c9987990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:02.434606 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:02.446445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104bfb1-9c81-4a66-9521-0125d91add8f None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:02.455188 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-6af6ec8b-a685-4977-b1b3-7570c9987990 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:02.456826 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-6af6ec8b-a685-4977-b1b3-7570c9987990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:02.492632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f25af-8fb0-4b22-8b7e-ab517d41ea7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:02.493718 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f25af-8fb0-4b22-8b7e-ab517d41ea7b None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:02.494010 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f25af-8fb0-4b22-8b7e-ab517d41ea7b None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:02.494290 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f25af-8fb0-4b22-8b7e-ab517d41ea7b None admin] PATH_INFO: `/v3/users/d75a54002cd84963bd8a165d3f55a294` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:02.495974 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f25af-8fb0-4b22-8b7e-ab517d41ea7b None admin] RBAC: Authorizing `identity:get_user(user_id=d75a54002cd84963bd8a165d3f55a294)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:02.497851 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f25af-8fb0-4b22-8b7e-ab517d41ea7b None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:02.503324 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 119/250] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:38:02 2022] GET /identity/v3/users/d75a54002cd84963bd8a165d3f55a294 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:02.503324 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f25af-8fb0-4b22-8b7e-ab517d41ea7b None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:02.551482 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 132/251] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:02.552173 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6ec8b-a685-4977-b1b3-7570c9987990 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:02.642514 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f25af-8fb0-4b22-8b7e-ab517d41ea7b None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:02.657910 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:02.674448 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6ec8b-a685-4977-b1b3-7570c9987990 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:02.686054 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba43d0-bf3c-4b57-9f93-7bd1166aa248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:02.687222 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba43d0-bf3c-4b57-9f93-7bd1166aa248 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:02.687802 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba43d0-bf3c-4b57-9f93-7bd1166aa248 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:02.688085 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba43d0-bf3c-4b57-9f93-7bd1166aa248 None admin] PATH_INFO: `/v3/projects/002bce0a21cf47508d077794ed19def7` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:02.689517 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba43d0-bf3c-4b57-9f93-7bd1166aa248 None admin] RBAC: Authorizing `identity:get_project(project_id=002bce0a21cf47508d077794ed19def7)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:02.691667 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba43d0-bf3c-4b57-9f93-7bd1166aa248 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:02.694039 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 120/252] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:38:02 2022] GET /identity/v3/projects/002bce0a21cf47508d077794ed19def7 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:02.695024 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7256fe4-373c-4c76-9eaa-1ba497a931ff None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:02.695306 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7256fe4-373c-4c76-9eaa-1ba497a931ff None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:02.695582 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7256fe4-373c-4c76-9eaa-1ba497a931ff None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:02.698270 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 121/253] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:02.704205 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7256fe4-373c-4c76-9eaa-1ba497a931ff None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:02.724262 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90f4d4-eeb0-4d06-9c92-c08db26dc474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:02.725073 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90f4d4-eeb0-4d06-9c92-c08db26dc474 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:02.725364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90f4d4-eeb0-4d06-9c92-c08db26dc474 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:02.725672 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90f4d4-eeb0-4d06-9c92-c08db26dc474 None admin] PATH_INFO: `/v3/projects/002bce0a21cf47508d077794ed19def7` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:02.727224 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90f4d4-eeb0-4d06-9c92-c08db26dc474 None admin] RBAC: Authorizing `identity:get_project(project_id=002bce0a21cf47508d077794ed19def7)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:02.728942 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90f4d4-eeb0-4d06-9c92-c08db26dc474 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:02.731194 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 133/254] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:38:02 2022] GET /identity/v3/projects/002bce0a21cf47508d077794ed19def7 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:02.732154 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90f4d4-eeb0-4d06-9c92-c08db26dc474 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:02.744573 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:02.835965 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7256fe4-373c-4c76-9eaa-1ba497a931ff None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:02.849926 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90f4d4-eeb0-4d06-9c92-c08db26dc474 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:02.875255 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26433b-0fe1-4581-9466-4f8a0bc43e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:02.876028 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26433b-0fe1-4581-9466-4f8a0bc43e5a None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:02.876320 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26433b-0fe1-4581-9466-4f8a0bc43e5a None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:02.876595 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26433b-0fe1-4581-9466-4f8a0bc43e5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:02.888011 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26433b-0fe1-4581-9466-4f8a0bc43e5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:02.888421 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28781671-5d67-406f-92bf-6d44891306b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:02.889374 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28781671-5d67-406f-92bf-6d44891306b1 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:02.889879 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28781671-5d67-406f-92bf-6d44891306b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:02.890350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28781671-5d67-406f-92bf-6d44891306b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:02.891412 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28781671-5d67-406f-92bf-6d44891306b1 None admin] RBAC: Adding query filter params (role.id=88752d25daad459b9cc7232c4818bb30, scope.project.id=002bce0a21cf47508d077794ed19def7, user.id=e35cb714ebbe465c8579244ea05c94d2) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:02.891971 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28781671-5d67-406f-92bf-6d44891306b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:02.893356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-9f26433b-0fe1-4581-9466-4f8a0bc43e5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:38:02.893356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:02.893356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:02.893356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:02.893356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:02.893356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:02.893356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:02.893356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:02.893356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:02.893356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:02.893356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:02.893356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:02.893356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:02.893356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:02.893356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:02.893356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:02.894382 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:02.894382 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:02.894382 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:02.894382 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:02.894382 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:02.894382 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:02.894382 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:02.894382 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:02.894382 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:02.894382 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:02.894382 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:02.894382 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:02.894382 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:02.894382 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:02.894382 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:02.894382 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:02.895155 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:02.895155 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:02.895155 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:02.895155 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:02.895155 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:02.895155 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:02.895155 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:02.895155 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:02.895155 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:02.895155 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:02.895155 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:38:02.895155 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:02.895155 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 122/255] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 3 12:38:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:02.895823 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968832d-696f-4a08-a883-d7c64c964ce1 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:02.896605 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968832d-696f-4a08-a883-d7c64c964ce1 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:02.896605 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968832d-696f-4a08-a883-d7c64c964ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:02.897363 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28781671-5d67-406f-92bf-6d44891306b1 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:02.900881 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:02.913659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 134/256] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:38:02 2022] GET /identity/v3/role_assignments?user.id=e35cb714ebbe465c8579244ea05c94d2&scope.project.id=002bce0a21cf47508d077794ed19def7&role.id=88752d25daad459b9cc7232c4818bb30 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:02.915011 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28781671-5d67-406f-92bf-6d44891306b1 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:02.918319 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-c968832d-696f-4a08-a883-d7c64c964ce1 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:02.919818 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-c968832d-696f-4a08-a883-d7c64c964ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:02.995001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 123/257] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:03.002494 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968832d-696f-4a08-a883-d7c64c964ce1 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:03.033171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:03.130884 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968832d-696f-4a08-a883-d7c64c964ce1 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:03.170868 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e41943-aace-42ef-b2a4-104b2bd0ec19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:03.171409 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e41943-aace-42ef-b2a4-104b2bd0ec19 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:03.171690 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e41943-aace-42ef-b2a4-104b2bd0ec19 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:03.171967 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e41943-aace-42ef-b2a4-104b2bd0ec19 None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:03.172698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e41943-aace-42ef-b2a4-104b2bd0ec19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:03.173006 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e41943-aace-42ef-b2a4-104b2bd0ec19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:03.174178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28781671-5d67-406f-92bf-6d44891306b1 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:03.174612 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e41943-aace-42ef-b2a4-104b2bd0ec19 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:03.188490 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 124/258] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:38:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:03.189412 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e41943-aace-42ef-b2a4-104b2bd0ec19 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:03.215721 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12a250-22a6-4c8c-90d2-2988a196da4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:03.216669 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12a250-22a6-4c8c-90d2-2988a196da4c None admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:03.217293 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12a250-22a6-4c8c-90d2-2988a196da4c None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:03.217614 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12a250-22a6-4c8c-90d2-2988a196da4c None admin] PATH_INFO: `/v3/projects/002bce0a21cf47508d077794ed19def7/users/d75a54002cd84963bd8a165d3f55a294/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:03.219735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12a250-22a6-4c8c-90d2-2988a196da4c None admin] RBAC: Authorizing `identity:create_grant(project_id=002bce0a21cf47508d077794ed19def7, user_id=d75a54002cd84963bd8a165d3f55a294, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:03.221302 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12a250-22a6-4c8c-90d2-2988a196da4c None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:03.241084 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 135/259] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 3 12:38:02 2022] PUT /identity/v3/projects/002bce0a21cf47508d077794ed19def7/users/d75a54002cd84963bd8a165d3f55a294/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:38:03.242055 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12a250-22a6-4c8c-90d2-2988a196da4c None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:03.286101 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:03.306871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e41943-aace-42ef-b2a4-104b2bd0ec19 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:03.378457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544eb629-3919-42d9-b487-5ab31fcb6e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:03.380296 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544eb629-3919-42d9-b487-5ab31fcb6e89 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:03.380808 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544eb629-3919-42d9-b487-5ab31fcb6e89 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:03.381445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544eb629-3919-42d9-b487-5ab31fcb6e89 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:03.385523 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:03.406137 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544eb629-3919-42d9-b487-5ab31fcb6e89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:03.413873 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-544eb629-3919-42d9-b487-5ab31fcb6e89 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:38:03.413873 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:03.413873 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:03.413873 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:03.413873 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:03.413873 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:03.413873 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:03.413873 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:03.413873 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:03.413873 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:03.413873 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:03.413873 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:03.413873 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:03.413873 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:03.413873 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:03.413873 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:03.414830 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:03.414830 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:03.414830 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:03.414830 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:03.414830 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:03.414830 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:03.414830 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:03.414830 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:03.414830 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:03.414830 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:03.414830 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:03.414830 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:03.414830 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:03.414830 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:03.414830 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:03.414830 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:03.415630 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:03.415630 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:03.415630 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:03.415630 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:03.415630 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:03.415630 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:03.415630 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:03.415630 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:03.415630 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:03.415630 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:03.415630 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:38:03.415630 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:03.419014 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 125/260] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 3 12:38:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:03.429408 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544eb629-3919-42d9-b487-5ab31fcb6e89 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:03.462353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12a250-22a6-4c8c-90d2-2988a196da4c None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:03.508050 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d003b-14c3-49bd-a612-625ea66bb9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:03.508863 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d003b-14c3-49bd-a612-625ea66bb9f4 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:03.509155 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d003b-14c3-49bd-a612-625ea66bb9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:03.509658 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d003b-14c3-49bd-a612-625ea66bb9f4 None admin] PATH_INFO: `/v3/users/c685eef3eb3d4efd849dc73e0452e140` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:03.511074 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d003b-14c3-49bd-a612-625ea66bb9f4 None admin] RBAC: Authorizing `identity:get_user(user_id=c685eef3eb3d4efd849dc73e0452e140)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:03.512897 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d003b-14c3-49bd-a612-625ea66bb9f4 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:03.516235 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 136/261] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:38:03 2022] GET /identity/v3/users/c685eef3eb3d4efd849dc73e0452e140 => generated 283 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:03.522998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d003b-14c3-49bd-a612-625ea66bb9f4 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:03.578360 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544eb629-3919-42d9-b487-5ab31fcb6e89 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:03.644639 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf862cf-904f-4a47-b562-e72c33903fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:03.645269 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf862cf-904f-4a47-b562-e72c33903fa8 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:03.645571 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf862cf-904f-4a47-b562-e72c33903fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:03.645845 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf862cf-904f-4a47-b562-e72c33903fa8 None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:03.646569 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf862cf-904f-4a47-b562-e72c33903fa8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:03.646873 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf862cf-904f-4a47-b562-e72c33903fa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:03.648251 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf862cf-904f-4a47-b562-e72c33903fa8 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:03.661608 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 126/262] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:38:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:03.663770 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf862cf-904f-4a47-b562-e72c33903fa8 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:03.667493 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:03.696427 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d003b-14c3-49bd-a612-625ea66bb9f4 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:03.760140 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:03.786914 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e5850-0a57-48cd-a6ff-27ade21b0f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:03.787524 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e5850-0a57-48cd-a6ff-27ade21b0f31 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:03.787817 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e5850-0a57-48cd-a6ff-27ade21b0f31 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:03.788094 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e5850-0a57-48cd-a6ff-27ade21b0f31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:03.855544 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf862cf-904f-4a47-b562-e72c33903fa8 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:03.870568 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e5850-0a57-48cd-a6ff-27ade21b0f31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:03.872511 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e5850-0a57-48cd-a6ff-27ade21b0f31 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:03.917972 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5b608-3dd0-4edf-9b28-8ab0c8c5ba0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:03.918691 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5b608-3dd0-4edf-9b28-8ab0c8c5ba0e None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:03.918977 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5b608-3dd0-4edf-9b28-8ab0c8c5ba0e None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:03.919285 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5b608-3dd0-4edf-9b28-8ab0c8c5ba0e None admin] PATH_INFO: `/v3/users/c685eef3eb3d4efd849dc73e0452e140` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:03.921617 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5b608-3dd0-4edf-9b28-8ab0c8c5ba0e None admin] RBAC: Authorizing `identity:get_user(user_id=c685eef3eb3d4efd849dc73e0452e140)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:03.923194 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5b608-3dd0-4edf-9b28-8ab0c8c5ba0e None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:03.925110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 127/263] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:38:03 2022] GET /identity/v3/users/c685eef3eb3d4efd849dc73e0452e140 => generated 283 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:03.930461 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5b608-3dd0-4edf-9b28-8ab0c8c5ba0e None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:04.021293 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 137/264] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:38:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 03 12:38:04.027587 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e5850-0a57-48cd-a6ff-27ade21b0f31 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:04.077270 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:04.090203 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:04.129449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5b608-3dd0-4edf-9b28-8ab0c8c5ba0e None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:04.180236 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c13257-f1f3-4b16-af4f-961f3d09ddcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:04.180879 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c13257-f1f3-4b16-af4f-961f3d09ddcf None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:04.181162 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c13257-f1f3-4b16-af4f-961f3d09ddcf None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:04.181440 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c13257-f1f3-4b16-af4f-961f3d09ddcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:04.262574 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e5850-0a57-48cd-a6ff-27ade21b0f31 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:04.300988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c13257-f1f3-4b16-af4f-961f3d09ddcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:04.302496 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c13257-f1f3-4b16-af4f-961f3d09ddcf None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:04.362318 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e6fff-3ff4-441a-85f6-8482165e810f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:04.362905 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e6fff-3ff4-441a-85f6-8482165e810f None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:04.363195 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e6fff-3ff4-441a-85f6-8482165e810f None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:04.363478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e6fff-3ff4-441a-85f6-8482165e810f None admin] PATH_INFO: `/v3/projects/002bce0a21cf47508d077794ed19def7` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:04.366832 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e6fff-3ff4-441a-85f6-8482165e810f None admin] RBAC: Authorizing `identity:get_project(project_id=002bce0a21cf47508d077794ed19def7)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:04.368307 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e6fff-3ff4-441a-85f6-8482165e810f None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:04.370060 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 138/265] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:38:04 2022] GET /identity/v3/projects/002bce0a21cf47508d077794ed19def7 => generated 302 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:04.379728 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e6fff-3ff4-441a-85f6-8482165e810f None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:04.429874 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:04.481599 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 128/266] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:38:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 03 12:38:04.484946 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c13257-f1f3-4b16-af4f-961f3d09ddcf None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:04.561111 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:04.570014 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e6fff-3ff4-441a-85f6-8482165e810f None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:04.647023 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60bd60-6cbf-4c08-bfcc-555816edf216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:04.648103 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60bd60-6cbf-4c08-bfcc-555816edf216 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:04.648578 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60bd60-6cbf-4c08-bfcc-555816edf216 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:04.649042 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60bd60-6cbf-4c08-bfcc-555816edf216 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:04.650091 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60bd60-6cbf-4c08-bfcc-555816edf216 None admin] RBAC: Adding query filter params (role.id=0e57d142f86c471883fc07a89fe66ec8, scope.project.id=002bce0a21cf47508d077794ed19def7, user.id=c685eef3eb3d4efd849dc73e0452e140) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:04.650713 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60bd60-6cbf-4c08-bfcc-555816edf216 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:04.652362 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60bd60-6cbf-4c08-bfcc-555816edf216 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:04.659268 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c13257-f1f3-4b16-af4f-961f3d09ddcf None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:04.675797 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 139/267] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:38:04 2022] GET /identity/v3/role_assignments?user.id=c685eef3eb3d4efd849dc73e0452e140&scope.project.id=002bce0a21cf47508d077794ed19def7&role.id=0e57d142f86c471883fc07a89fe66ec8 => generated 608 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:04.725742 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f0fc1-5cab-4f4c-888e-5dde2d9bb088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:04.726429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f0fc1-5cab-4f4c-888e-5dde2d9bb088 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:04.726714 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f0fc1-5cab-4f4c-888e-5dde2d9bb088 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:04.726990 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f0fc1-5cab-4f4c-888e-5dde2d9bb088 None admin] PATH_INFO: `/v3/projects/002bce0a21cf47508d077794ed19def7` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:04.728268 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f0fc1-5cab-4f4c-888e-5dde2d9bb088 None admin] RBAC: Authorizing `identity:get_project(project_id=002bce0a21cf47508d077794ed19def7)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:04.729778 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f0fc1-5cab-4f4c-888e-5dde2d9bb088 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:04.731539 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 129/268] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:38:04 2022] GET /identity/v3/projects/002bce0a21cf47508d077794ed19def7 => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:04.738474 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60bd60-6cbf-4c08-bfcc-555816edf216 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:04.874707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03211ae3-e6c1-4367-a32c-16ed1e5390ec None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:04.875074 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03211ae3-e6c1-4367-a32c-16ed1e5390ec None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:04.875279 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03211ae3-e6c1-4367-a32c-16ed1e5390ec None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:04.877947 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 130/269] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:04.882612 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17645b-f147-4f17-baf5-d21cbb9fb63a None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:04.882900 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17645b-f147-4f17-baf5-d21cbb9fb63a None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:04.883438 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17645b-f147-4f17-baf5-d21cbb9fb63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:04.886923 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60bd60-6cbf-4c08-bfcc-555816edf216 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:04.915439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-7f17645b-f147-4f17-baf5-d21cbb9fb63a None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:04.916685 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-7f17645b-f147-4f17-baf5-d21cbb9fb63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:04.964654 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89bf3b-0815-410d-9c87-4f90459c46fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:04.965285 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89bf3b-0815-410d-9c87-4f90459c46fe None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:04.965595 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89bf3b-0815-410d-9c87-4f90459c46fe None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:04.965877 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89bf3b-0815-410d-9c87-4f90459c46fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:04.967562 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d89bf3b-0815-410d-9c87-4f90459c46fe None admin] RBAC: Adding query filter params (role.id=1f3ee786628740418d65c827bc64a9b5, scope.project.id=002bce0a21cf47508d077794ed19def7, user.id=c685eef3eb3d4efd849dc73e0452e140) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:04.967876 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d89bf3b-0815-410d-9c87-4f90459c46fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:04.969381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d89bf3b-0815-410d-9c87-4f90459c46fe None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:04.976722 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 140/270] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:38:04 2022] GET /identity/v3/role_assignments?user.id=c685eef3eb3d4efd849dc73e0452e140&scope.project.id=002bce0a21cf47508d077794ed19def7&role.id=1f3ee786628740418d65c827bc64a9b5 => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:04.979572 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65353a-2076-4208-82c6-d12bd546f973 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:04.979872 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65353a-2076-4208-82c6-d12bd546f973 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:04.980311 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65353a-2076-4208-82c6-d12bd546f973 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:04.981075 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:04.981917 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 141/271] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:04.990573 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad08ae4-3dc6-48ea-b438-1df617ce62aa None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:04.990863 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad08ae4-3dc6-48ea-b438-1df617ce62aa None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:04.991167 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad08ae4-3dc6-48ea-b438-1df617ce62aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:05.016001 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-8ad08ae4-3dc6-48ea-b438-1df617ce62aa None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:05.017349 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-8ad08ae4-3dc6-48ea-b438-1df617ce62aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:05.031879 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 131/272] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:05.046108 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:05.065401 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17645b-f147-4f17-baf5-d21cbb9fb63a None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:05.108740 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 142/273] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:05.157172 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad08ae4-3dc6-48ea-b438-1df617ce62aa None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:05.245352 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17645b-f147-4f17-baf5-d21cbb9fb63a None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:05.295979 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1d89f-62f4-485f-8ff3-5276305ca889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:05.297199 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1d89f-62f4-485f-8ff3-5276305ca889 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:05.297480 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1d89f-62f4-485f-8ff3-5276305ca889 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:05.297789 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1d89f-62f4-485f-8ff3-5276305ca889 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:05.311748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1d89f-62f4-485f-8ff3-5276305ca889 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:05.312446 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad08ae4-3dc6-48ea-b438-1df617ce62aa None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:05.317183 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-55a1d89f-62f4-485f-8ff3-5276305ca889 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:38:05.317183 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:05.317183 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:05.317183 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:05.317183 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:05.317183 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:05.317183 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:05.317183 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:05.317183 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:05.317183 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:05.317183 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:05.317183 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:05.317183 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:05.317183 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:05.317183 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:05.317183 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:05.318095 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:05.318095 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:05.318095 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:05.318095 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:05.318095 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:05.318095 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:05.318095 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:05.318095 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:05.318095 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:05.318095 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:05.318095 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:05.318095 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:05.318095 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:05.318095 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:05.318095 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:05.318095 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:05.318887 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:05.318887 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:05.318887 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:05.318887 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:05.318887 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:05.318887 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:05.318887 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:05.318887 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:05.318887 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:05.318887 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:05.318887 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:38:05.318887 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:05.318887 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 132/274] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:38:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:38:05.325213 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1d89f-62f4-485f-8ff3-5276305ca889 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:05.350831 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d59eee-1821-4d5a-9a51-cd1a510fcf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:05.351489 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d59eee-1821-4d5a-9a51-cd1a510fcf7b None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:05.351769 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d59eee-1821-4d5a-9a51-cd1a510fcf7b None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:05.352042 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d59eee-1821-4d5a-9a51-cd1a510fcf7b None admin] PATH_INFO: `/v3/domains/default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:05.353181 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d59eee-1821-4d5a-9a51-cd1a510fcf7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:05.354666 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d59eee-1821-4d5a-9a51-cd1a510fcf7b None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:05.356283 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 143/275] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:05.361794 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:05.363347 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d59eee-1821-4d5a-9a51-cd1a510fcf7b None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:05.391091 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:05.463515 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1d89f-62f4-485f-8ff3-5276305ca889 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:05.500397 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d59eee-1821-4d5a-9a51-cd1a510fcf7b None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:05.506902 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393b6e2-3e0b-4e51-bef8-cd003daa924f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:05.507526 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393b6e2-3e0b-4e51-bef8-cd003daa924f None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:05.507808 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393b6e2-3e0b-4e51-bef8-cd003daa924f None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:05.508082 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393b6e2-3e0b-4e51-bef8-cd003daa924f None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:05.508808 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6393b6e2-3e0b-4e51-bef8-cd003daa924f None admin] RBAC: Adding query filter params (name=member) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:05.509112 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6393b6e2-3e0b-4e51-bef8-cd003daa924f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:05.510524 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6393b6e2-3e0b-4e51-bef8-cd003daa924f None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:05.520322 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 133/276] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 3 12:38:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:05.526292 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393b6e2-3e0b-4e51-bef8-cd003daa924f None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:05.546633 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd94bd-a957-41b1-b8f3-403e7858659d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:05.547570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd94bd-a957-41b1-b8f3-403e7858659d None admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:05.547898 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd94bd-a957-41b1-b8f3-403e7858659d None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:05.548278 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd94bd-a957-41b1-b8f3-403e7858659d None admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:05.549064 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd94bd-a957-41b1-b8f3-403e7858659d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:05.551298 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd94bd-a957-41b1-b8f3-403e7858659d None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:05.576681 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 144/277] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Aug 3 12:38:05 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:38:05.636671 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:05.647815 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393b6e2-3e0b-4e51-bef8-cd003daa924f None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:05.687659 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a3e09-e094-495a-a48e-747d79c6e310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:05.688352 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a3e09-e094-495a-a48e-747d79c6e310 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:05.688606 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a3e09-e094-495a-a48e-747d79c6e310 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:05.688884 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a3e09-e094-495a-a48e-747d79c6e310 None admin] PATH_INFO: `/v3/users/0ca4ef3479644d68b7cd2f482df06685` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:05.705147 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a3e09-e094-495a-a48e-747d79c6e310 None admin] RBAC: Authorizing `identity:get_user(user_id=0ca4ef3479644d68b7cd2f482df06685)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:05.706668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a3e09-e094-495a-a48e-747d79c6e310 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:05.708712 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 134/278] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:38:05 2022] GET /identity/v3/users/0ca4ef3479644d68b7cd2f482df06685 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:05.714446 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd94bd-a957-41b1-b8f3-403e7858659d None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:05.802212 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:05.814067 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53ab1f-3417-4abf-b812-7a808d71c8ae None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:05.814351 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53ab1f-3417-4abf-b812-7a808d71c8ae None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:05.814632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53ab1f-3417-4abf-b812-7a808d71c8ae None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:05.816153 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 135/279] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:05.821032 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40a616-2dcc-4350-93ef-4d64349bf61e None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:05.821320 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40a616-2dcc-4350-93ef-4d64349bf61e None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:05.821644 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40a616-2dcc-4350-93ef-4d64349bf61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:05.826700 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd94bd-a957-41b1-b8f3-403e7858659d None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:05.843795 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-2b40a616-2dcc-4350-93ef-4d64349bf61e None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:05.846563 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-2b40a616-2dcc-4350-93ef-4d64349bf61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:05.883407 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289b930-9384-4ba7-b457-5daf967d1ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:05.884117 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289b930-9384-4ba7-b457-5daf967d1ab8 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:05.884412 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289b930-9384-4ba7-b457-5daf967d1ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:05.884694 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289b930-9384-4ba7-b457-5daf967d1ab8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:05.885534 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289b930-9384-4ba7-b457-5daf967d1ab8 None admin] RBAC: Adding query filter params (role.id=e1c6e31e9e944b23bc9ba6b0099d3376, user.id=0ca4ef3479644d68b7cd2f482df06685, scope.system=all) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:05.885920 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289b930-9384-4ba7-b457-5daf967d1ab8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:05.887483 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289b930-9384-4ba7-b457-5daf967d1ab8 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:05.894113 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 145/280] 10.222.0.46 () {56 vars in 1308 bytes} [Wed Aug 3 12:38:05 2022] GET /identity/v3/role_assignments?user.id=0ca4ef3479644d68b7cd2f482df06685&scope.system=all&role.id=e1c6e31e9e944b23bc9ba6b0099d3376 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:05.934694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 136/281] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:38:05.957575 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289b930-9384-4ba7-b457-5daf967d1ab8 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:06.094676 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289b930-9384-4ba7-b457-5daf967d1ab8 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:06.133950 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25656b-4a87-426c-94e2-ad1dd4aaca8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:06.134599 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25656b-4a87-426c-94e2-ad1dd4aaca8d None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:06.134882 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25656b-4a87-426c-94e2-ad1dd4aaca8d None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:06.135157 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25656b-4a87-426c-94e2-ad1dd4aaca8d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:06.146440 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25656b-4a87-426c-94e2-ad1dd4aaca8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:06.151885 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-ea25656b-4a87-426c-94e2-ad1dd4aaca8d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:38:06.151885 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:06.151885 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:06.151885 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:06.151885 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:06.151885 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:06.151885 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:06.151885 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:06.151885 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:06.151885 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:06.151885 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:06.151885 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:06.151885 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:06.151885 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:06.151885 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:06.151885 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:06.152751 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:06.152751 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:06.152751 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:06.152751 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:06.152751 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:06.152751 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:06.152751 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:06.152751 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:06.152751 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:06.152751 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:06.152751 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:06.152751 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:06.152751 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:06.152751 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:06.152751 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:06.152751 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:06.153552 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:06.153552 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:06.153552 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:06.153552 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:06.153552 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:06.153552 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:06.153552 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:06.153552 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:06.153552 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:06.153552 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:06.153552 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:38:06.153552 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:06.153552 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 146/282] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:38:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:06.163357 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b40a616-2dcc-4350-93ef-4d64349bf61e None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:06.179493 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006250f3-9350-40d9-8c7a-caeea8f0dd0e None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:06.180088 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006250f3-9350-40d9-8c7a-caeea8f0dd0e None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:06.180553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006250f3-9350-40d9-8c7a-caeea8f0dd0e None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:06.182429 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 147/283] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:38:06.188244 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3902603-79c2-4ad4-bcca-c2fa58b7c8ec None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:06.188801 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3902603-79c2-4ad4-bcca-c2fa58b7c8ec None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:06.189271 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3902603-79c2-4ad4-bcca-c2fa58b7c8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:06.195960 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:06.209800 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-e3902603-79c2-4ad4-bcca-c2fa58b7c8ec None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:06.211073 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-e3902603-79c2-4ad4-bcca-c2fa58b7c8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:06.285566 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 148/284] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:38:06.312140 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3902603-79c2-4ad4-bcca-c2fa58b7c8ec None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:06.337871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:06.383825 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b40a616-2dcc-4350-93ef-4d64349bf61e None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:06.438765 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3902603-79c2-4ad4-bcca-c2fa58b7c8ec None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:06.452295 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc072a58-5c83-45d3-809c-361cd928032d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:06.455122 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc072a58-5c83-45d3-809c-361cd928032d None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:06.455586 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc072a58-5c83-45d3-809c-361cd928032d None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:06.456049 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc072a58-5c83-45d3-809c-361cd928032d None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:06.457036 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc072a58-5c83-45d3-809c-361cd928032d None admin] RBAC: Adding query filter params (name=reader) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:06.457669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc072a58-5c83-45d3-809c-361cd928032d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:06.460241 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc072a58-5c83-45d3-809c-361cd928032d None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:06.477725 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 137/285] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 3 12:38:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:06.483677 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc072a58-5c83-45d3-809c-361cd928032d None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:06.498498 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:06.507065 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58a6d4-fe6c-435c-af8c-9816532e1e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:06.507945 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58a6d4-fe6c-435c-af8c-9816532e1e96 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:06.508391 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58a6d4-fe6c-435c-af8c-9816532e1e96 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:06.508828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58a6d4-fe6c-435c-af8c-9816532e1e96 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:06.528719 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe58a6d4-fe6c-435c-af8c-9816532e1e96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:06.535389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-fe58a6d4-fe6c-435c-af8c-9816532e1e96 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:38:06.535389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:06.535389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:06.535389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:06.535389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:06.535389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:06.535389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:06.535389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:06.535389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:06.535389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:06.535389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:06.535389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:06.535389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:06.535389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:06.535389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:06.535389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:06.536261 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:06.536261 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:06.536261 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:06.536261 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:06.536261 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:06.536261 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:06.536261 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:06.536261 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:06.536261 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:06.536261 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:06.536261 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:06.536261 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:06.536261 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:06.536261 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:06.536261 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:06.536261 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:06.537069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:06.537069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:06.537069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:06.537069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:06.537069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:06.537069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:06.537069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:06.537069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:06.537069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:06.537069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:06.537069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:38:06.537069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:06.539882 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 149/286] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:38:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:38:06.545902 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58a6d4-fe6c-435c-af8c-9816532e1e96 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:06.704219 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc072a58-5c83-45d3-809c-361cd928032d None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:06.731641 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58a6d4-fe6c-435c-af8c-9816532e1e96 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:06.770213 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6c12b-08eb-4af4-a1b5-5d4373c9a66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:06.770870 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6c12b-08eb-4af4-a1b5-5d4373c9a66a None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:06.771157 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6c12b-08eb-4af4-a1b5-5d4373c9a66a None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:06.771435 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6c12b-08eb-4af4-a1b5-5d4373c9a66a None admin] PATH_INFO: `/v3/users/e35cb714ebbe465c8579244ea05c94d2` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:06.778209 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6c12b-08eb-4af4-a1b5-5d4373c9a66a None admin] RBAC: Authorizing `identity:get_user(user_id=e35cb714ebbe465c8579244ea05c94d2)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:06.779258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005180e-9f06-4d60-a090-f90eea2a0cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:06.779795 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6c12b-08eb-4af4-a1b5-5d4373c9a66a None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:06.780282 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005180e-9f06-4d60-a090-f90eea2a0cb4 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:06.780737 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005180e-9f06-4d60-a090-f90eea2a0cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:06.781179 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005180e-9f06-4d60-a090-f90eea2a0cb4 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:06.781926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 138/287] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:38:06 2022] GET /identity/v3/users/e35cb714ebbe465c8579244ea05c94d2 => generated 297 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:06.782300 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005180e-9f06-4d60-a090-f90eea2a0cb4 None admin] RBAC: Adding query filter params (name=member) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:06.787047 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005180e-9f06-4d60-a090-f90eea2a0cb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:06.788670 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005180e-9f06-4d60-a090-f90eea2a0cb4 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:06.790360 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6c12b-08eb-4af4-a1b5-5d4373c9a66a None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:06.798670 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 150/288] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 3 12:38:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:06.804232 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005180e-9f06-4d60-a090-f90eea2a0cb4 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:06.818661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:06.892324 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:06.971061 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005180e-9f06-4d60-a090-f90eea2a0cb4 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:06.976065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6c12b-08eb-4af4-a1b5-5d4373c9a66a None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:07.026570 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe809c0-04c6-48c2-8904-7e9711d9ad12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:07.027502 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe809c0-04c6-48c2-8904-7e9711d9ad12 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:07.028057 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe809c0-04c6-48c2-8904-7e9711d9ad12 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:07.028536 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe809c0-04c6-48c2-8904-7e9711d9ad12 None admin] PATH_INFO: `/v3/projects/002bce0a21cf47508d077794ed19def7` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:07.030124 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe809c0-04c6-48c2-8904-7e9711d9ad12 None admin] RBAC: Authorizing `identity:get_project(project_id=002bce0a21cf47508d077794ed19def7)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:07.031764 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe809c0-04c6-48c2-8904-7e9711d9ad12 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:07.033969 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 139/289] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:38:06 2022] GET /identity/v3/projects/002bce0a21cf47508d077794ed19def7 => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:07.039587 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d0fdd-7b16-404e-92fc-88f9049d7c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:07.040219 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe809c0-04c6-48c2-8904-7e9711d9ad12 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:07.040327 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d0fdd-7b16-404e-92fc-88f9049d7c22 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:07.040522 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d0fdd-7b16-404e-92fc-88f9049d7c22 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:07.040802 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d0fdd-7b16-404e-92fc-88f9049d7c22 None admin] PATH_INFO: `/v3/users/d75a54002cd84963bd8a165d3f55a294` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:07.044036 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d0fdd-7b16-404e-92fc-88f9049d7c22 None admin] RBAC: Authorizing `identity:get_user(user_id=d75a54002cd84963bd8a165d3f55a294)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:07.048836 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d0fdd-7b16-404e-92fc-88f9049d7c22 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:07.048968 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 151/290] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:38:06 2022] GET /identity/v3/users/d75a54002cd84963bd8a165d3f55a294 => generated 297 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:07.054612 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d0fdd-7b16-404e-92fc-88f9049d7c22 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:07.160050 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:07.187235 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe809c0-04c6-48c2-8904-7e9711d9ad12 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:07.225108 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76d1d6-20e6-4c54-a580-0b8d35e29169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:07.225733 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76d1d6-20e6-4c54-a580-0b8d35e29169 None admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:07.226022 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76d1d6-20e6-4c54-a580-0b8d35e29169 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:07.226301 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76d1d6-20e6-4c54-a580-0b8d35e29169 None admin] PATH_INFO: `/v3/projects/002bce0a21cf47508d077794ed19def7/users/e35cb714ebbe465c8579244ea05c94d2/roles/88752d25daad459b9cc7232c4818bb30` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:07.228283 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76d1d6-20e6-4c54-a580-0b8d35e29169 None admin] RBAC: Authorizing `identity:create_grant(project_id=002bce0a21cf47508d077794ed19def7, user_id=e35cb714ebbe465c8579244ea05c94d2, role_id=88752d25daad459b9cc7232c4818bb30)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:07.229759 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76d1d6-20e6-4c54-a580-0b8d35e29169 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:07.244922 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 140/291] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 3 12:38:07 2022] PUT /identity/v3/projects/002bce0a21cf47508d077794ed19def7/users/e35cb714ebbe465c8579244ea05c94d2/roles/88752d25daad459b9cc7232c4818bb30 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:38:07.315920 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d0fdd-7b16-404e-92fc-88f9049d7c22 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:07.359767 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:07.375181 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfaa452-2b8c-425f-bf97-b31328bc8623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:07.375826 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfaa452-2b8c-425f-bf97-b31328bc8623 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:07.376105 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfaa452-2b8c-425f-bf97-b31328bc8623 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:07.376376 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfaa452-2b8c-425f-bf97-b31328bc8623 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:07.462058 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfaa452-2b8c-425f-bf97-b31328bc8623 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:07.464318 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfaa452-2b8c-425f-bf97-b31328bc8623 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:07.571980 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 152/292] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:38:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 03 12:38:07.578024 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76d1d6-20e6-4c54-a580-0b8d35e29169 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:07.697257 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76d1d6-20e6-4c54-a580-0b8d35e29169 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:07.733526 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece501b2-cf03-4156-a769-ee3126c84b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:07.734182 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece501b2-cf03-4156-a769-ee3126c84b0c None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:07.734469 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece501b2-cf03-4156-a769-ee3126c84b0c None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:07.734748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece501b2-cf03-4156-a769-ee3126c84b0c None admin] PATH_INFO: `/v3/projects/002bce0a21cf47508d077794ed19def7` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:07.735941 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece501b2-cf03-4156-a769-ee3126c84b0c None admin] RBAC: Authorizing `identity:get_project(project_id=002bce0a21cf47508d077794ed19def7)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:07.737412 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece501b2-cf03-4156-a769-ee3126c84b0c None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:07.739703 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 141/293] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:38:07 2022] GET /identity/v3/projects/002bce0a21cf47508d077794ed19def7 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:07.745547 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfaa452-2b8c-425f-bf97-b31328bc8623 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:07.788554 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:07.906439 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfaa452-2b8c-425f-bf97-b31328bc8623 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:07.954872 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c6f88-8869-4ac0-acef-2b0a2c44abb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:07.955877 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c6f88-8869-4ac0-acef-2b0a2c44abb3 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:07.956357 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c6f88-8869-4ac0-acef-2b0a2c44abb3 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:07.956827 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c6f88-8869-4ac0-acef-2b0a2c44abb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:07.957861 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c6f88-8869-4ac0-acef-2b0a2c44abb3 None admin] RBAC: Adding query filter params (role.id=e1c6e31e9e944b23bc9ba6b0099d3376, scope.project.id=002bce0a21cf47508d077794ed19def7, user.id=d75a54002cd84963bd8a165d3f55a294) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:07.958374 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c6f88-8869-4ac0-acef-2b0a2c44abb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:07.960036 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c6f88-8869-4ac0-acef-2b0a2c44abb3 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:07.967711 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 153/294] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:38:07 2022] GET /identity/v3/role_assignments?user.id=d75a54002cd84963bd8a165d3f55a294&scope.project.id=002bce0a21cf47508d077794ed19def7&role.id=e1c6e31e9e944b23bc9ba6b0099d3376 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:08.100542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151d0e9-6cc7-4c08-acd8-618d7ae9103a None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:08.100947 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151d0e9-6cc7-4c08-acd8-618d7ae9103a None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:08.101256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151d0e9-6cc7-4c08-acd8-618d7ae9103a None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:08.102918 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 142/295] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:08.108592 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda1c7b-8db9-437c-9067-803fe9078892 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:08.108874 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda1c7b-8db9-437c-9067-803fe9078892 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:08.109147 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda1c7b-8db9-437c-9067-803fe9078892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:08.135079 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-3cda1c7b-8db9-437c-9067-803fe9078892 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:08.136291 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-3cda1c7b-8db9-437c-9067-803fe9078892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:08.199061 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca5a79-5649-4f55-b311-7d9bd0cb389e None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:08.199331 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca5a79-5649-4f55-b311-7d9bd0cb389e None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:08.199518 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca5a79-5649-4f55-b311-7d9bd0cb389e None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:08.201602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 143/296] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:38:08.206645 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493d85e-8748-4818-935e-a31c873bafc1 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:08.207200 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493d85e-8748-4818-935e-a31c873bafc1 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:08.207760 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493d85e-8748-4818-935e-a31c873bafc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:08.233522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:08.234093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 154/297] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:08.242938 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-b493d85e-8748-4818-935e-a31c873bafc1 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:08.244165 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-b493d85e-8748-4818-935e-a31c873bafc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:08.259186 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda1c7b-8db9-437c-9067-803fe9078892 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:08.282803 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:08.334857 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 144/298] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:38:08.359689 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493d85e-8748-4818-935e-a31c873bafc1 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:08.378662 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda1c7b-8db9-437c-9067-803fe9078892 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:08.415417 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f78f6-96a9-4a9a-be10-53049bac5e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:08.416069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f78f6-96a9-4a9a-be10-53049bac5e9a None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:08.416349 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f78f6-96a9-4a9a-be10-53049bac5e9a None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:08.416620 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f78f6-96a9-4a9a-be10-53049bac5e9a None admin] PATH_INFO: `/v3/domains/default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:08.417974 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f78f6-96a9-4a9a-be10-53049bac5e9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:08.419978 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f78f6-96a9-4a9a-be10-53049bac5e9a None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:08.421729 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 155/299] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:08.427548 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f78f6-96a9-4a9a-be10-53049bac5e9a None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:08.485137 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493d85e-8748-4818-935e-a31c873bafc1 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:08.526906 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c10cd-2a31-4dad-a542-db015735449c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:08.527545 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c10cd-2a31-4dad-a542-db015735449c None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:08.527824 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c10cd-2a31-4dad-a542-db015735449c None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:08.528095 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c10cd-2a31-4dad-a542-db015735449c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:08.529038 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:08.531059 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:08.541059 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c10cd-2a31-4dad-a542-db015735449c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:08.547133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-100c10cd-2a31-4dad-a542-db015735449c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:38:08.547133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:08.547133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:08.547133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:08.547133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:08.547133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:08.547133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:08.547133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:08.547133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:08.547133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:08.547133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:08.547133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:08.547133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:08.547133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:08.547133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:08.547133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:08.548015 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:08.548015 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:08.548015 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:08.548015 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:08.548015 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:08.548015 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:08.548015 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:08.548015 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:08.548015 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:08.548015 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:08.548015 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:08.548015 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:08.548015 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:08.548015 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:08.548015 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:08.548015 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:08.549196 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:08.549196 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:08.549196 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:08.549196 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:08.549196 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:08.549196 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:08.549196 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:08.549196 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:08.549196 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:08.549196 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:08.549196 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:38:08.549196 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:08.549196 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 145/300] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:38:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:38:08.554844 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f78f6-96a9-4a9a-be10-53049bac5e9a None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:08.555240 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c10cd-2a31-4dad-a542-db015735449c None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:08.600542 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d0bd5-948f-442f-93a6-65ce98271595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:08.601421 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d0bd5-948f-442f-93a6-65ce98271595 None admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:08.601759 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d0bd5-948f-442f-93a6-65ce98271595 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:08.602004 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d0bd5-948f-442f-93a6-65ce98271595 None admin] PATH_INFO: `/v3/groups` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:08.602672 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d0bd5-948f-442f-93a6-65ce98271595 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:08.604127 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d0bd5-948f-442f-93a6-65ce98271595 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:08.620643 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 156/301] 10.222.0.46 () {60 vars in 1134 bytes} [Wed Aug 3 12:38:08 2022] POST /identity/v3/groups => generated 229 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:38:08.623678 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03b9f1-5051-4a08-8740-ba456c0f8066 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:08.623997 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03b9f1-5051-4a08-8740-ba456c0f8066 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:08.624281 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03b9f1-5051-4a08-8740-ba456c0f8066 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:08.625792 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 157/302] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:08.635404 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb35d5b-fbc2-4865-9f1c-eee3d21bc391 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:08.635795 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb35d5b-fbc2-4865-9f1c-eee3d21bc391 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:08.636155 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb35d5b-fbc2-4865-9f1c-eee3d21bc391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:08.657561 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-2eb35d5b-fbc2-4865-9f1c-eee3d21bc391 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:08.659121 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-2eb35d5b-fbc2-4865-9f1c-eee3d21bc391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:08.699074 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c10cd-2a31-4dad-a542-db015735449c None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:08.740367 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55023c41-e31b-4c41-9852-7b199cfe662c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:08.741480 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55023c41-e31b-4c41-9852-7b199cfe662c None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:08.742024 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55023c41-e31b-4c41-9852-7b199cfe662c None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:08.742522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55023c41-e31b-4c41-9852-7b199cfe662c None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:08.743517 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55023c41-e31b-4c41-9852-7b199cfe662c None admin] RBAC: Adding query filter params (name=reader) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:08.744055 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55023c41-e31b-4c41-9852-7b199cfe662c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:08.745873 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55023c41-e31b-4c41-9852-7b199cfe662c None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:08.746264 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 158/303] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:38:08.757345 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 146/304] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 3 12:38:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:08.767036 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb35d5b-fbc2-4865-9f1c-eee3d21bc391 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:08.768616 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55023c41-e31b-4c41-9852-7b199cfe662c None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:08.832756 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:08.857951 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:08.883592 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55023c41-e31b-4c41-9852-7b199cfe662c None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:08.899885 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb35d5b-fbc2-4865-9f1c-eee3d21bc391 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:08.921896 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d8f93-1616-405a-a557-cb84f9790658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:08.922545 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d8f93-1616-405a-a557-cb84f9790658 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:08.922833 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d8f93-1616-405a-a557-cb84f9790658 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:08.923112 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d8f93-1616-405a-a557-cb84f9790658 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:08.933909 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d8f93-1616-405a-a557-cb84f9790658 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:08.940135 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-ac6d8f93-1616-405a-a557-cb84f9790658 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:38:08.940135 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:08.940135 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:08.940135 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:08.940135 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:08.940135 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:08.940135 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:08.940135 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:08.940135 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:08.940135 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:08.940135 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:08.940135 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:08.940135 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:08.940135 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:08.940135 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:08.940135 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:08.941025 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:08.941025 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:08.941025 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:08.941025 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:08.941025 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:08.941025 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:08.941025 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:08.941025 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:08.941025 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:08.941025 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:08.941025 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:08.941025 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:08.941025 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:08.941025 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:08.941025 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:08.941025 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:08.941963 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:08.941963 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:08.941963 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:08.941963 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:08.941963 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:08.941963 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:08.941963 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:08.941963 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:08.941963 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:08.941963 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:08.941963 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:38:08.941963 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:08.941963 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 147/305] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:38:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:38:08.945370 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d6594-4b02-45c1-a6f0-91ab7d537005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:08.946158 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d6594-4b02-45c1-a6f0-91ab7d537005 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:08.946423 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d6594-4b02-45c1-a6f0-91ab7d537005 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:08.946698 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d6594-4b02-45c1-a6f0-91ab7d537005 None admin] PATH_INFO: `/v3/users/77317825359b402286edab99a91572d6` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:08.947776 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d8f93-1616-405a-a557-cb84f9790658 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:08.965099 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d6594-4b02-45c1-a6f0-91ab7d537005 None admin] RBAC: Authorizing `identity:get_user(user_id=77317825359b402286edab99a91572d6)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:08.967484 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d6594-4b02-45c1-a6f0-91ab7d537005 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:08.970214 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 159/306] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:38:08 2022] GET /identity/v3/users/77317825359b402286edab99a91572d6 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:08.978741 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d6594-4b02-45c1-a6f0-91ab7d537005 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:09.059088 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d8f93-1616-405a-a557-cb84f9790658 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:09.078163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:09.100440 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169064b-8b47-451b-8985-8a2b6396346d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:09.101736 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169064b-8b47-451b-8985-8a2b6396346d None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:09.102252 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169064b-8b47-451b-8985-8a2b6396346d None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:09.102730 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169064b-8b47-451b-8985-8a2b6396346d None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:09.103615 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7169064b-8b47-451b-8985-8a2b6396346d None admin] RBAC: Adding query filter params (name=member) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:09.104067 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7169064b-8b47-451b-8985-8a2b6396346d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:09.105850 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7169064b-8b47-451b-8985-8a2b6396346d None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:09.113080 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d6594-4b02-45c1-a6f0-91ab7d537005 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:09.116250 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 148/307] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 3 12:38:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:09.123257 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169064b-8b47-451b-8985-8a2b6396346d None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:09.147643 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:09.153047 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7b9d2-a2d3-4912-84da-23bd0755f967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:09.154194 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7b9d2-a2d3-4912-84da-23bd0755f967 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:09.154699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7b9d2-a2d3-4912-84da-23bd0755f967 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:09.155171 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7b9d2-a2d3-4912-84da-23bd0755f967 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:09.156164 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7b9d2-a2d3-4912-84da-23bd0755f967 None admin] RBAC: Adding query filter params (role.id=88752d25daad459b9cc7232c4818bb30, user.id=77317825359b402286edab99a91572d6, scope.system=all) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:09.156683 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7b9d2-a2d3-4912-84da-23bd0755f967 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:09.158325 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7b9d2-a2d3-4912-84da-23bd0755f967 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:09.163778 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 160/308] 10.222.0.46 () {56 vars in 1308 bytes} [Wed Aug 3 12:38:08 2022] GET /identity/v3/role_assignments?user.id=77317825359b402286edab99a91572d6&scope.system=all&role.id=88752d25daad459b9cc7232c4818bb30 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:09.251062 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169064b-8b47-451b-8985-8a2b6396346d None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:09.298937 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dafc4d-c77a-487a-9428-cbb35ed55e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:09.299944 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dafc4d-c77a-487a-9428-cbb35ed55e76 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:09.300415 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dafc4d-c77a-487a-9428-cbb35ed55e76 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:09.300899 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dafc4d-c77a-487a-9428-cbb35ed55e76 None admin] PATH_INFO: `/v3/users/0ca4ef3479644d68b7cd2f482df06685` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:09.302536 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dafc4d-c77a-487a-9428-cbb35ed55e76 None admin] RBAC: Authorizing `identity:get_user(user_id=0ca4ef3479644d68b7cd2f482df06685)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:09.304215 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dafc4d-c77a-487a-9428-cbb35ed55e76 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:09.306453 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 149/309] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:38:09 2022] GET /identity/v3/users/0ca4ef3479644d68b7cd2f482df06685 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:09.313286 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7b9d2-a2d3-4912-84da-23bd0755f967 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:09.416740 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7b9d2-a2d3-4912-84da-23bd0755f967 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:09.452895 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3792767-492a-46c1-8717-004a8b164644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:09.453927 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3792767-492a-46c1-8717-004a8b164644 None admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:09.454447 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3792767-492a-46c1-8717-004a8b164644 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:09.454929 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3792767-492a-46c1-8717-004a8b164644 None admin] PATH_INFO: `/v3/system/users/0ca4ef3479644d68b7cd2f482df06685/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:09.456595 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3792767-492a-46c1-8717-004a8b164644 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0ca4ef3479644d68b7cd2f482df06685, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:09.458192 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3792767-492a-46c1-8717-004a8b164644 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:09.468943 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 161/310] 10.222.0.46 () {58 vars in 1334 bytes} [Wed Aug 3 12:38:09 2022] PUT /identity/v3/system/users/0ca4ef3479644d68b7cd2f482df06685/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:38:09.677296 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a9f24-f1b8-491f-9e21-beb1d403856b None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:09.677648 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a9f24-f1b8-491f-9e21-beb1d403856b None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:09.677839 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a9f24-f1b8-491f-9e21-beb1d403856b None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:09.679432 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 150/311] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:09.684541 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03903c-fdf1-4d02-a763-711d0b58252a None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:09.685559 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03903c-fdf1-4d02-a763-711d0b58252a None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:09.685914 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03903c-fdf1-4d02-a763-711d0b58252a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:09.705983 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-1b03903c-fdf1-4d02-a763-711d0b58252a None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:09.707491 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-1b03903c-fdf1-4d02-a763-711d0b58252a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:09.768272 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:09.782013 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 162/312] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:09.805758 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a9f24-f1b8-491f-9e21-beb1d403856b None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:09.859087 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:09.915173 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a9f24-f1b8-491f-9e21-beb1d403856b None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:09.957638 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c26e8f-ac2d-4890-b689-f986d2f52d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:09.958230 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c26e8f-ac2d-4890-b689-f986d2f52d1b None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:09.958512 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c26e8f-ac2d-4890-b689-f986d2f52d1b None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:09.958785 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c26e8f-ac2d-4890-b689-f986d2f52d1b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:09.970687 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c26e8f-ac2d-4890-b689-f986d2f52d1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:09.975728 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-97c26e8f-ac2d-4890-b689-f986d2f52d1b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:38:09.975728 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:09.975728 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:09.975728 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:09.975728 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:09.975728 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:09.975728 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:09.975728 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:09.975728 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:09.975728 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:09.975728 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:09.975728 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:09.975728 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:09.975728 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:09.975728 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:09.975728 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:09.976597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:09.976597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:09.976597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:09.976597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:09.976597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:09.976597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:09.976597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:09.976597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:09.976597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:09.976597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:09.976597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:09.976597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:09.976597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:09.976597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:09.976597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:09.976597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:09.977392 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:09.977392 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:09.977392 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:09.977392 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:09.977392 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:09.977392 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:09.977392 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:09.977392 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:09.977392 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:09.977392 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:09.977392 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:38:09.977392 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:09.977392 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 151/313] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:38:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:09.983918 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03903c-fdf1-4d02-a763-711d0b58252a None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:10.091630 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03903c-fdf1-4d02-a763-711d0b58252a None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:10.128753 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e68cb4-ee36-4469-b047-e3571e71e9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:10.129746 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e68cb4-ee36-4469-b047-e3571e71e9d0 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:10.130230 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e68cb4-ee36-4469-b047-e3571e71e9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:10.130701 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e68cb4-ee36-4469-b047-e3571e71e9d0 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:10.131645 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e68cb4-ee36-4469-b047-e3571e71e9d0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:10.132147 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e68cb4-ee36-4469-b047-e3571e71e9d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:10.133749 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e68cb4-ee36-4469-b047-e3571e71e9d0 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:10.142810 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 163/314] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 3 12:38:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:10.153516 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c26e8f-ac2d-4890-b689-f986d2f52d1b None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:10.262411 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c26e8f-ac2d-4890-b689-f986d2f52d1b None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:10.274519 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:10.303354 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2492c61-6c3c-40e1-80ab-77fe44947efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:10.303991 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2492c61-6c3c-40e1-80ab-77fe44947efd None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:10.304268 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2492c61-6c3c-40e1-80ab-77fe44947efd None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:10.304542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2492c61-6c3c-40e1-80ab-77fe44947efd None admin] PATH_INFO: `/v3/users/e35cb714ebbe465c8579244ea05c94d2` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:10.305789 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2492c61-6c3c-40e1-80ab-77fe44947efd None admin] RBAC: Authorizing `identity:get_user(user_id=e35cb714ebbe465c8579244ea05c94d2)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:10.307214 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2492c61-6c3c-40e1-80ab-77fe44947efd None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:10.309116 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 152/315] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:38:10 2022] GET /identity/v3/users/e35cb714ebbe465c8579244ea05c94d2 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:10.314714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e68cb4-ee36-4469-b047-e3571e71e9d0 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:10.370500 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:10.420997 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e68cb4-ee36-4469-b047-e3571e71e9d0 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:10.455091 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0f4d4-de92-4aee-befc-6fda0a20fc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:10.455714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0f4d4-de92-4aee-befc-6fda0a20fc39 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:10.455998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0f4d4-de92-4aee-befc-6fda0a20fc39 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:10.456276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0f4d4-de92-4aee-befc-6fda0a20fc39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:10.527385 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0f4d4-de92-4aee-befc-6fda0a20fc39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:10.529123 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0f4d4-de92-4aee-befc-6fda0a20fc39 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:10.586832 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:10.642737 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 164/316] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:38:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:38:10.648117 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2492c61-6c3c-40e1-80ab-77fe44947efd None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:10.757767 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2492c61-6c3c-40e1-80ab-77fe44947efd None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:10.791992 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cceb5ee-402e-455f-a5cb-13a4398627bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:10.792554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cceb5ee-402e-455f-a5cb-13a4398627bf None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:10.792830 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cceb5ee-402e-455f-a5cb-13a4398627bf None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:10.793101 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cceb5ee-402e-455f-a5cb-13a4398627bf None admin] PATH_INFO: `/v3/projects/002bce0a21cf47508d077794ed19def7` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:10.794834 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cceb5ee-402e-455f-a5cb-13a4398627bf None admin] RBAC: Authorizing `identity:get_project(project_id=002bce0a21cf47508d077794ed19def7)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:10.796274 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cceb5ee-402e-455f-a5cb-13a4398627bf None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:10.798283 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 153/317] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:38:10 2022] GET /identity/v3/projects/002bce0a21cf47508d077794ed19def7 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:10.806320 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0f4d4-de92-4aee-befc-6fda0a20fc39 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:10.890612 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4930d9e-aec6-423f-a25a-8fe1b3dd5999 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:10.891138 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4930d9e-aec6-423f-a25a-8fe1b3dd5999 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:10.891138 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4930d9e-aec6-423f-a25a-8fe1b3dd5999 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:10.893603 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 154/318] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:38:10.897767 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0cfc3-b96f-42e2-aed3-b3d6d797e22f None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:10.898060 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0cfc3-b96f-42e2-aed3-b3d6d797e22f None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:10.898440 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0cfc3-b96f-42e2-aed3-b3d6d797e22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:10.908868 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0f4d4-de92-4aee-befc-6fda0a20fc39 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:10.918270 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-5ae0cfc3-b96f-42e2-aed3-b3d6d797e22f None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:10.920174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-5ae0cfc3-b96f-42e2-aed3-b3d6d797e22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:10.950817 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36ebe2-1734-4b20-855c-8ab762d0060e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:10.951851 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36ebe2-1734-4b20-855c-8ab762d0060e None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:10.952383 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36ebe2-1734-4b20-855c-8ab762d0060e None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:10.952665 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36ebe2-1734-4b20-855c-8ab762d0060e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:10.953746 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36ebe2-1734-4b20-855c-8ab762d0060e None admin] RBAC: Adding query filter params (role.id=88752d25daad459b9cc7232c4818bb30, scope.project.id=002bce0a21cf47508d077794ed19def7, user.id=e35cb714ebbe465c8579244ea05c94d2) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:10.954059 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36ebe2-1734-4b20-855c-8ab762d0060e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:10.956274 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36ebe2-1734-4b20-855c-8ab762d0060e None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:10.963861 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 165/319] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:38:10 2022] GET /identity/v3/role_assignments?user.id=e35cb714ebbe465c8579244ea05c94d2&scope.project.id=002bce0a21cf47508d077794ed19def7&role.id=88752d25daad459b9cc7232c4818bb30 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:10.970538 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:11.003708 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 155/320] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:11.027616 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36ebe2-1734-4b20-855c-8ab762d0060e None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:11.049986 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:11.143360 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36ebe2-1734-4b20-855c-8ab762d0060e None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:11.180387 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34027090-2f40-4c89-b2f6-1996e59d373f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:11.181040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34027090-2f40-4c89-b2f6-1996e59d373f None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:11.181321 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34027090-2f40-4c89-b2f6-1996e59d373f None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:11.181736 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34027090-2f40-4c89-b2f6-1996e59d373f None admin] PATH_INFO: `/v3/domains/default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:11.184008 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34027090-2f40-4c89-b2f6-1996e59d373f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:11.184416 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34027090-2f40-4c89-b2f6-1996e59d373f None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:11.186549 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 166/321] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:11.191997 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0cfc3-b96f-42e2-aed3-b3d6d797e22f None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:11.297369 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0cfc3-b96f-42e2-aed3-b3d6d797e22f None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:11.332892 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72ce38-dfc3-44ba-85dd-5b1f8180dbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:11.333437 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72ce38-dfc3-44ba-85dd-5b1f8180dbfa None admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:11.333748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72ce38-dfc3-44ba-85dd-5b1f8180dbfa None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:11.334022 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72ce38-dfc3-44ba-85dd-5b1f8180dbfa None admin] PATH_INFO: `/v3/groups` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:11.334677 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd72ce38-dfc3-44ba-85dd-5b1f8180dbfa None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:11.336112 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd72ce38-dfc3-44ba-85dd-5b1f8180dbfa None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:11.352588 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa2524-447b-4d0a-b337-5467b8c1dacd None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:11.352874 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa2524-447b-4d0a-b337-5467b8c1dacd None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:11.353342 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa2524-447b-4d0a-b337-5467b8c1dacd None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:11.353645 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 156/322] 10.222.0.46 () {60 vars in 1134 bytes} [Wed Aug 3 12:38:11 2022] POST /identity/v3/groups => generated 226 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:38:11.355066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 167/323] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:38:11.361080 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bef355-0bdb-4dc8-8cec-cc1b8d2acac6 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:11.361430 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bef355-0bdb-4dc8-8cec-cc1b8d2acac6 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:11.361704 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bef355-0bdb-4dc8-8cec-cc1b8d2acac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:11.382524 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-c8bef355-0bdb-4dc8-8cec-cc1b8d2acac6 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:11.383772 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-c8bef355-0bdb-4dc8-8cec-cc1b8d2acac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:11.416311 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:11.465543 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 157/324] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:11.485248 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa2524-447b-4d0a-b337-5467b8c1dacd None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:11.577682 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:11.583337 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf6001-8fcf-4eac-b3b6-14bc5ac7e138 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:11.583594 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf6001-8fcf-4eac-b3b6-14bc5ac7e138 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:11.583943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf6001-8fcf-4eac-b3b6-14bc5ac7e138 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:11.585544 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 158/325] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:38:11.591335 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c25715-1a81-419c-8f4d-e743bc5639e2 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:11.591335 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c25715-1a81-419c-8f4d-e743bc5639e2 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:11.591564 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c25715-1a81-419c-8f4d-e743bc5639e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:11.596026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa2524-447b-4d0a-b337-5467b8c1dacd None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:11.615170 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-13c25715-1a81-419c-8f4d-e743bc5639e2 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:11.616386 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-13c25715-1a81-419c-8f4d-e743bc5639e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:11.636389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f418a46-fb8f-4e96-9778-1ed3d640a123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:11.637069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f418a46-fb8f-4e96-9778-1ed3d640a123 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:11.637353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f418a46-fb8f-4e96-9778-1ed3d640a123 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:11.637657 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f418a46-fb8f-4e96-9778-1ed3d640a123 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:11.649819 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f418a46-fb8f-4e96-9778-1ed3d640a123 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:11.655459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-2f418a46-fb8f-4e96-9778-1ed3d640a123 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:38:11.655459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:11.655459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:11.655459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:11.655459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:11.655459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:11.655459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:11.655459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:11.655459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:11.655459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:11.655459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:11.655459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:11.655459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:11.655459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:11.655459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:11.655459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:11.656364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:11.656364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:11.656364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:11.656364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:11.656364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:11.656364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:11.656364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:11.656364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:11.656364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:11.656364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:11.656364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:11.656364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:11.656364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:11.656364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:11.656364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:11.656364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:11.657146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:11.657146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:11.657146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:11.657146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:11.657146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:11.657146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:11.657146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:11.657146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:11.657146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:11.657146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:11.657146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:38:11.657146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:11.657146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 168/326] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:38:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:11.662324 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f418a46-fb8f-4e96-9778-1ed3d640a123 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:11.720061 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 159/327] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:11.745615 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c25715-1a81-419c-8f4d-e743bc5639e2 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:11.792896 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f418a46-fb8f-4e96-9778-1ed3d640a123 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:11.836253 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efb98e-b28c-4e92-8650-cbd3d39a36b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:11.837017 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efb98e-b28c-4e92-8650-cbd3d39a36b4 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:11.837432 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efb98e-b28c-4e92-8650-cbd3d39a36b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:11.837760 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efb98e-b28c-4e92-8650-cbd3d39a36b4 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:11.838348 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02efb98e-b28c-4e92-8650-cbd3d39a36b4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:11.838653 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02efb98e-b28c-4e92-8650-cbd3d39a36b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:11.840072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02efb98e-b28c-4e92-8650-cbd3d39a36b4 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:11.851642 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 169/328] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 3 12:38:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:11.858956 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efb98e-b28c-4e92-8650-cbd3d39a36b4 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:11.870954 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:11.871738 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:11.882832 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c25715-1a81-419c-8f4d-e743bc5639e2 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:11.939313 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1a374-d864-421e-b38c-bf97e8385aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:11.941303 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1a374-d864-421e-b38c-bf97e8385aa7 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:11.942061 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1a374-d864-421e-b38c-bf97e8385aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:11.942481 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1a374-d864-421e-b38c-bf97e8385aa7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:11.957943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1a374-d864-421e-b38c-bf97e8385aa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:11.965919 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-6eb1a374-d864-421e-b38c-bf97e8385aa7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:38:11.965919 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:11.965919 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:11.965919 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:11.965919 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:11.965919 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:11.965919 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:11.965919 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:11.965919 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:11.965919 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:11.965919 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:11.965919 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:11.965919 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:11.965919 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:11.965919 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:11.965919 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:11.967429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:11.967429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:11.967429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:11.967429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:11.967429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:11.967429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:11.967429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:11.967429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:11.967429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:11.967429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:11.967429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:11.967429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:11.967429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:11.967429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:11.967429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:11.967429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:11.968187 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:11.968187 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:11.968187 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:11.968187 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:11.968187 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:11.968187 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:11.968187 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:11.968187 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:11.968187 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:11.968187 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:11.968187 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:38:11.968187 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:11.970953 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 160/329] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:38:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:11.976924 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1a374-d864-421e-b38c-bf97e8385aa7 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:12.010690 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efb98e-b28c-4e92-8650-cbd3d39a36b4 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:12.062006 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd26581-ef6c-45cf-b20e-285f4d39cc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:12.062663 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd26581-ef6c-45cf-b20e-285f4d39cc00 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:12.062938 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd26581-ef6c-45cf-b20e-285f4d39cc00 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:12.063208 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd26581-ef6c-45cf-b20e-285f4d39cc00 None admin] PATH_INFO: `/v3/users/77317825359b402286edab99a91572d6` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:12.066716 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd26581-ef6c-45cf-b20e-285f4d39cc00 None admin] RBAC: Authorizing `identity:get_user(user_id=77317825359b402286edab99a91572d6)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:12.068178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd26581-ef6c-45cf-b20e-285f4d39cc00 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:12.070157 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 170/330] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:38:11 2022] GET /identity/v3/users/77317825359b402286edab99a91572d6 => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:12.075988 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd26581-ef6c-45cf-b20e-285f4d39cc00 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:12.110707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1a374-d864-421e-b38c-bf97e8385aa7 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:12.155959 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3dce1-0112-4ad6-b274-29f20fab4017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:12.156591 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3dce1-0112-4ad6-b274-29f20fab4017 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:12.158898 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3dce1-0112-4ad6-b274-29f20fab4017 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:12.159188 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3dce1-0112-4ad6-b274-29f20fab4017 None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:12.159935 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3dce1-0112-4ad6-b274-29f20fab4017 None admin] RBAC: Adding query filter params (name=member) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:12.160247 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3dce1-0112-4ad6-b274-29f20fab4017 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:12.161942 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3dce1-0112-4ad6-b274-29f20fab4017 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:12.182900 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 161/331] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 3 12:38:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:12.188101 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3dce1-0112-4ad6-b274-29f20fab4017 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:12.214321 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:12.239813 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:12.305316 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd26581-ef6c-45cf-b20e-285f4d39cc00 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:12.368318 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f742fa9-4235-432c-8aef-6a8e7e6e6557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:12.368912 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f742fa9-4235-432c-8aef-6a8e7e6e6557 None admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:12.369197 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f742fa9-4235-432c-8aef-6a8e7e6e6557 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:12.369476 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f742fa9-4235-432c-8aef-6a8e7e6e6557 None admin] PATH_INFO: `/v3/system/users/77317825359b402286edab99a91572d6/roles/88752d25daad459b9cc7232c4818bb30` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:12.371037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f742fa9-4235-432c-8aef-6a8e7e6e6557 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=77317825359b402286edab99a91572d6, role_id=88752d25daad459b9cc7232c4818bb30)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:12.372662 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f742fa9-4235-432c-8aef-6a8e7e6e6557 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:12.382532 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 171/332] 10.222.0.46 () {58 vars in 1334 bytes} [Wed Aug 3 12:38:12 2022] PUT /identity/v3/system/users/77317825359b402286edab99a91572d6/roles/88752d25daad459b9cc7232c4818bb30 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:38:12.390383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3dce1-0112-4ad6-b274-29f20fab4017 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:12.428971 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08961e-1913-4bfa-9c88-91f627a3d8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:12.429685 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08961e-1913-4bfa-9c88-91f627a3d8ce None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:12.430018 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08961e-1913-4bfa-9c88-91f627a3d8ce None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:12.430301 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08961e-1913-4bfa-9c88-91f627a3d8ce None admin] PATH_INFO: `/v3/users/0ca4ef3479644d68b7cd2f482df06685` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:12.431571 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08961e-1913-4bfa-9c88-91f627a3d8ce None admin] RBAC: Authorizing `identity:get_user(user_id=0ca4ef3479644d68b7cd2f482df06685)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:12.433041 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08961e-1913-4bfa-9c88-91f627a3d8ce None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:12.435744 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 162/333] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:38:12 2022] GET /identity/v3/users/0ca4ef3479644d68b7cd2f482df06685 => generated 293 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:12.441661 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f742fa9-4235-432c-8aef-6a8e7e6e6557 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:12.572387 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f742fa9-4235-432c-8aef-6a8e7e6e6557 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:12.616810 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013bbe1-f967-471b-9303-e3698c16eee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:12.617521 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013bbe1-f967-471b-9303-e3698c16eee4 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:12.617803 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013bbe1-f967-471b-9303-e3698c16eee4 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:12.618082 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013bbe1-f967-471b-9303-e3698c16eee4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:12.619056 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013bbe1-f967-471b-9303-e3698c16eee4 None admin] RBAC: Adding query filter params (role.id=e1c6e31e9e944b23bc9ba6b0099d3376, user.id=0ca4ef3479644d68b7cd2f482df06685, scope.system=all) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:12.619498 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013bbe1-f967-471b-9303-e3698c16eee4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:12.621012 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013bbe1-f967-471b-9303-e3698c16eee4 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:12.634035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:12.645718 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 172/334] 10.222.0.46 () {56 vars in 1308 bytes} [Wed Aug 3 12:38:12 2022] GET /identity/v3/role_assignments?user.id=0ca4ef3479644d68b7cd2f482df06685&scope.system=all&role.id=e1c6e31e9e944b23bc9ba6b0099d3376 => generated 510 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:14.081433 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a778d2-1500-4218-b237-2ef4f1dd4b85 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:14.081967 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a778d2-1500-4218-b237-2ef4f1dd4b85 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:14.082041 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a778d2-1500-4218-b237-2ef4f1dd4b85 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:14.083455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 163/335] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:14.088923 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43227dfd-b4c4-467d-8922-41db7ecd7c6e None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:14.089329 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43227dfd-b4c4-467d-8922-41db7ecd7c6e None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:14.089535 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43227dfd-b4c4-467d-8922-41db7ecd7c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:14.113289 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-43227dfd-b4c4-467d-8922-41db7ecd7c6e None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:14.114803 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-43227dfd-b4c4-467d-8922-41db7ecd7c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:14.122935 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c88e9c-5338-499a-b157-27bcd4641c64 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:14.123277 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c88e9c-5338-499a-b157-27bcd4641c64 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:14.123576 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c88e9c-5338-499a-b157-27bcd4641c64 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:14.125135 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 164/336] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:14.132296 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55340a5c-7694-432b-b34c-3010050d1081 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:14.132296 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55340a5c-7694-432b-b34c-3010050d1081 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:14.135304 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55340a5c-7694-432b-b34c-3010050d1081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:14.156043 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-55340a5c-7694-432b-b34c-3010050d1081 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:14.158345 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-55340a5c-7694-432b-b34c-3010050d1081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:14.227653 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 173/337] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:14.241150 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 165/338] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:38:14.263057 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43227dfd-b4c4-467d-8922-41db7ecd7c6e None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:14.267380 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55340a5c-7694-432b-b34c-3010050d1081 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:14.289825 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:14.395850 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55340a5c-7694-432b-b34c-3010050d1081 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:14.439316 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1ea1b-e6ee-419a-891f-037e24181156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:14.440330 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1ea1b-e6ee-419a-891f-037e24181156 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:14.440647 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43227dfd-b4c4-467d-8922-41db7ecd7c6e None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:14.441025 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1ea1b-e6ee-419a-891f-037e24181156 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:14.441519 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1ea1b-e6ee-419a-891f-037e24181156 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:14.455570 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1ea1b-e6ee-419a-891f-037e24181156 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:14.462035 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-30a1ea1b-e6ee-419a-891f-037e24181156 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:38:14.462035 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:14.462035 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:14.462035 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:14.462035 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:14.462035 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:14.462035 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:14.462035 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:14.462035 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:14.462035 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:14.462035 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:14.462035 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:14.462035 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:14.462035 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:14.462035 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:14.462035 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:14.462926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:14.462926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:14.462926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:14.462926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:14.462926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:14.462926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:14.462926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:14.462926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:14.462926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:14.462926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:14.462926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:14.462926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:14.462926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:14.462926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:14.462926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:14.462926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:14.463708 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:14.463708 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:14.463708 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:14.463708 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:14.463708 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:14.463708 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:14.463708 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:14.463708 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:14.463708 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:14.463708 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:14.463708 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:38:14.463708 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:14.466887 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 166/339] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 3 12:38:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:38:14.474279 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1ea1b-e6ee-419a-891f-037e24181156 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:14.498114 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:14.516322 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a80d47-dd5f-404f-bc82-145e33e8edae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:14.516989 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a80d47-dd5f-404f-bc82-145e33e8edae None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:14.517331 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a80d47-dd5f-404f-bc82-145e33e8edae None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:14.517662 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a80d47-dd5f-404f-bc82-145e33e8edae None admin] PATH_INFO: `/v3/roles/member` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:14.539670 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a80d47-dd5f-404f-bc82-145e33e8edae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:14.545448 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-92a80d47-dd5f-404f-bc82-145e33e8edae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:38:14.545448 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:14.545448 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:14.545448 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:14.545448 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:14.545448 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:14.545448 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:14.545448 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:14.545448 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:14.545448 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:14.545448 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:14.545448 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:14.545448 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:14.545448 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:14.545448 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:14.545448 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:14.546350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:14.546350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:14.546350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:14.546350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:14.546350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:14.546350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:14.546350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:14.546350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:14.546350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:14.546350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:14.546350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:14.546350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:14.546350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:14.546350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:14.546350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:14.546350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:14.547131 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:14.547131 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:14.547131 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:14.547131 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:14.547131 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:14.547131 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:14.547131 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:14.547131 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:14.547131 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:14.547131 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:14.547131 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:38:14.547131 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:14.547131 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 174/340] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:38:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:14.552800 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a80d47-dd5f-404f-bc82-145e33e8edae None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:14.571091 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:14.605043 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1ea1b-e6ee-419a-891f-037e24181156 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:14.650484 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a9acb-558a-4bf0-b6c3-963a937ca29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:14.651693 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a9acb-558a-4bf0-b6c3-963a937ca29e None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:14.652513 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a9acb-558a-4bf0-b6c3-963a937ca29e None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:14.652895 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a9acb-558a-4bf0-b6c3-963a937ca29e None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:14.654198 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a9acb-558a-4bf0-b6c3-963a937ca29e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:14.654757 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a9acb-558a-4bf0-b6c3-963a937ca29e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:14.656532 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a9acb-558a-4bf0-b6c3-963a937ca29e None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:14.668789 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 167/341] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:38:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:14.677199 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a9acb-558a-4bf0-b6c3-963a937ca29e None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:14.706948 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a80d47-dd5f-404f-bc82-145e33e8edae None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:14.755373 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843d24b-0d62-4791-9d64-0106e08719d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:14.756417 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843d24b-0d62-4791-9d64-0106e08719d7 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:14.756806 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843d24b-0d62-4791-9d64-0106e08719d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:14.757186 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843d24b-0d62-4791-9d64-0106e08719d7 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:14.758053 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843d24b-0d62-4791-9d64-0106e08719d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:14.758461 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843d24b-0d62-4791-9d64-0106e08719d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:14.760145 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843d24b-0d62-4791-9d64-0106e08719d7 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:14.771423 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 175/342] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 3 12:38:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:14.778142 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843d24b-0d62-4791-9d64-0106e08719d7 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:14.829526 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a9acb-558a-4bf0-b6c3-963a937ca29e None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:14.842981 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:14.906953 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843d24b-0d62-4791-9d64-0106e08719d7 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:14.908567 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856175f4-fbc4-4dd0-8c45-ebeee102b227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:14.909173 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856175f4-fbc4-4dd0-8c45-ebeee102b227 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:14.909487 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856175f4-fbc4-4dd0-8c45-ebeee102b227 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:14.909805 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856175f4-fbc4-4dd0-8c45-ebeee102b227 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:14.922634 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:14.959699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf145f-9997-41f4-b7fd-b2ae72e150b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:14.960480 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf145f-9997-41f4-b7fd-b2ae72e150b4 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:14.960868 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf145f-9997-41f4-b7fd-b2ae72e150b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:14.961246 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf145f-9997-41f4-b7fd-b2ae72e150b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:15.043715 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf145f-9997-41f4-b7fd-b2ae72e150b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:15.046954 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf145f-9997-41f4-b7fd-b2ae72e150b4 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:15.073118 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856175f4-fbc4-4dd0-8c45-ebeee102b227 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:15.078738 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856175f4-fbc4-4dd0-8c45-ebeee102b227 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:15.102265 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:15.161987 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 176/343] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:38:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:38:15.167206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf145f-9997-41f4-b7fd-b2ae72e150b4 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:15.215376 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 168/344] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:38:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 03 12:38:15.222185 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856175f4-fbc4-4dd0-8c45-ebeee102b227 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:15.269652 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:15.303192 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf145f-9997-41f4-b7fd-b2ae72e150b4 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:15.341971 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ccaaa2-0b6b-4dce-9d2e-870d9eb6694c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:15.343034 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ccaaa2-0b6b-4dce-9d2e-870d9eb6694c None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:15.343515 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ccaaa2-0b6b-4dce-9d2e-870d9eb6694c None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:15.344002 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ccaaa2-0b6b-4dce-9d2e-870d9eb6694c None admin] PATH_INFO: `/v3/projects/7ca4d22998dd43599a48acb9cb75b454` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:15.344523 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856175f4-fbc4-4dd0-8c45-ebeee102b227 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:15.345687 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ccaaa2-0b6b-4dce-9d2e-870d9eb6694c None admin] RBAC: Authorizing `identity:get_project(project_id=7ca4d22998dd43599a48acb9cb75b454)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:15.347346 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ccaaa2-0b6b-4dce-9d2e-870d9eb6694c None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:15.349286 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 177/345] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:38:15 2022] GET /identity/v3/projects/7ca4d22998dd43599a48acb9cb75b454 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:15.350684 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12d5ba-af02-4f0f-bad9-e7daa17dcd0c None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:15.351171 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12d5ba-af02-4f0f-bad9-e7daa17dcd0c None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:15.351660 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12d5ba-af02-4f0f-bad9-e7daa17dcd0c None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:15.353387 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 178/346] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:15.358434 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12d5ba-af02-4f0f-bad9-e7daa17dcd0c None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:15.379221 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:15.394848 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e467183-54f4-436a-9ead-44dc1079f592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:15.395501 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e467183-54f4-436a-9ead-44dc1079f592 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:15.395781 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e467183-54f4-436a-9ead-44dc1079f592 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:15.396053 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e467183-54f4-436a-9ead-44dc1079f592 None admin] PATH_INFO: `/v3/projects/7ca4d22998dd43599a48acb9cb75b454` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:15.402261 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e467183-54f4-436a-9ead-44dc1079f592 None admin] RBAC: Authorizing `identity:get_project(project_id=7ca4d22998dd43599a48acb9cb75b454)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:15.404269 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e467183-54f4-436a-9ead-44dc1079f592 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:15.406335 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 169/347] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:38:15 2022] GET /identity/v3/projects/7ca4d22998dd43599a48acb9cb75b454 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:15.407525 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43badf42-b7dc-409b-9d65-1dfa60e55880 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:15.407781 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43badf42-b7dc-409b-9d65-1dfa60e55880 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:15.408054 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43badf42-b7dc-409b-9d65-1dfa60e55880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:15.439073 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-43badf42-b7dc-409b-9d65-1dfa60e55880 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:15.440211 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-43badf42-b7dc-409b-9d65-1dfa60e55880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:15.477200 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12d5ba-af02-4f0f-bad9-e7daa17dcd0c None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:15.516506 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7b2cb-86c0-45e9-8658-c1c42e647220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:15.517738 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7b2cb-86c0-45e9-8658-c1c42e647220 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:15.518221 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7b2cb-86c0-45e9-8658-c1c42e647220 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:15.518708 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7b2cb-86c0-45e9-8658-c1c42e647220 None admin] PATH_INFO: `/v3/groups/60fc43b20c8149eda819bdeff51c161a` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:15.525379 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7b2cb-86c0-45e9-8658-c1c42e647220 None admin] RBAC: Authorizing `identity:get_group(group_id=60fc43b20c8149eda819bdeff51c161a)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:15.527126 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7b2cb-86c0-45e9-8658-c1c42e647220 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:15.529915 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 179/348] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Aug 3 12:38:15 2022] GET /identity/v3/groups/60fc43b20c8149eda819bdeff51c161a => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:15.531367 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7b2cb-86c0-45e9-8658-c1c42e647220 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:15.547891 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 170/349] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:15.549096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43badf42-b7dc-409b-9d65-1dfa60e55880 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:15.604974 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:15.632052 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:15.650607 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7b2cb-86c0-45e9-8658-c1c42e647220 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:15.687062 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa390b86-f111-4b9d-900f-dc90f0a0e19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:15.688088 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa390b86-f111-4b9d-900f-dc90f0a0e19f None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:15.688570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa390b86-f111-4b9d-900f-dc90f0a0e19f None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:15.689049 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa390b86-f111-4b9d-900f-dc90f0a0e19f None admin] PATH_INFO: `/v3/groups/60fc43b20c8149eda819bdeff51c161a` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:15.690647 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa390b86-f111-4b9d-900f-dc90f0a0e19f None admin] RBAC: Authorizing `identity:get_group(group_id=60fc43b20c8149eda819bdeff51c161a)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:15.692484 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa390b86-f111-4b9d-900f-dc90f0a0e19f None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:15.694533 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 180/350] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Aug 3 12:38:15 2022] GET /identity/v3/groups/60fc43b20c8149eda819bdeff51c161a => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:15.695502 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa390b86-f111-4b9d-900f-dc90f0a0e19f None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:15.703895 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43badf42-b7dc-409b-9d65-1dfa60e55880 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:15.752365 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e55d07-0044-4666-bdec-18bba0899e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:15.753063 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e55d07-0044-4666-bdec-18bba0899e6c None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:15.753346 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e55d07-0044-4666-bdec-18bba0899e6c None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:15.753659 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e55d07-0044-4666-bdec-18bba0899e6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:15.754465 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e55d07-0044-4666-bdec-18bba0899e6c None admin] RBAC: Adding query filter params (group.id=60fc43b20c8149eda819bdeff51c161a, role.id=e1c6e31e9e944b23bc9ba6b0099d3376, scope.project.id=7ca4d22998dd43599a48acb9cb75b454) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:15.754780 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e55d07-0044-4666-bdec-18bba0899e6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:15.757074 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e55d07-0044-4666-bdec-18bba0899e6c None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:15.768711 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 171/351] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Aug 3 12:38:15 2022] GET /identity/v3/role_assignments?group.id=60fc43b20c8149eda819bdeff51c161a&scope.project.id=7ca4d22998dd43599a48acb9cb75b454&role.id=e1c6e31e9e944b23bc9ba6b0099d3376 => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:15.773528 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d412b-af31-4ea7-ba28-352c8c75936d None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:15.773528 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d412b-af31-4ea7-ba28-352c8c75936d None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:15.773528 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d412b-af31-4ea7-ba28-352c8c75936d None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:15.773528 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 172/352] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:15.773528 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d412b-af31-4ea7-ba28-352c8c75936d None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:15.879879 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa390b86-f111-4b9d-900f-dc90f0a0e19f None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:15.958935 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab9a12-2a25-4d9a-9442-ca985852a6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:15.959946 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab9a12-2a25-4d9a-9442-ca985852a6bd None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:15.960232 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab9a12-2a25-4d9a-9442-ca985852a6bd None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:15.960504 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab9a12-2a25-4d9a-9442-ca985852a6bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:15.969270 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:15.975989 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d412b-af31-4ea7-ba28-352c8c75936d None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:15.981866 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab9a12-2a25-4d9a-9442-ca985852a6bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:15.988364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-bbab9a12-2a25-4d9a-9442-ca985852a6bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:38:15.988364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:15.988364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:15.988364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:15.988364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:15.988364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:15.988364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:15.988364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:15.988364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:15.988364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:15.988364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:15.988364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:15.988364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:15.988364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:15.988364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:15.988364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:15.989714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:15.989714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:15.989714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:15.989714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:15.989714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:15.989714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:15.989714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:15.989714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:15.989714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:15.989714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:15.989714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:15.989714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:15.989714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:15.989714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:15.989714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:15.989714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:15.990759 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:15.990759 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:15.990759 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:15.990759 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:15.990759 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:15.990759 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:15.990759 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:15.990759 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:15.990759 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:15.990759 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:15.990759 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:38:15.990759 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:15.990759 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 181/353] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:38:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:15.991577 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ac18f-a8b9-4251-bfdd-7838710c5133 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:15.991983 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ac18f-a8b9-4251-bfdd-7838710c5133 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:15.992333 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ac18f-a8b9-4251-bfdd-7838710c5133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:16.024847 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-6c1ac18f-a8b9-4251-bfdd-7838710c5133 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:16.024847 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-6c1ac18f-a8b9-4251-bfdd-7838710c5133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:16.025854 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:16.032779 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a91a9-d265-468b-975f-746c4da12541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:16.033660 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a91a9-d265-468b-975f-746c4da12541 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:16.033768 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a91a9-d265-468b-975f-746c4da12541 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:16.033993 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a91a9-d265-468b-975f-746c4da12541 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:16.034811 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a91a9-d265-468b-975f-746c4da12541 None admin] RBAC: Adding query filter params (group.id=60fc43b20c8149eda819bdeff51c161a, role.id=1f3ee786628740418d65c827bc64a9b5, scope.project.id=7ca4d22998dd43599a48acb9cb75b454) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:16.035125 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a91a9-d265-468b-975f-746c4da12541 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:16.036573 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a91a9-d265-468b-975f-746c4da12541 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:16.043688 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 173/354] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Aug 3 12:38:15 2022] GET /identity/v3/role_assignments?group.id=60fc43b20c8149eda819bdeff51c161a&scope.project.id=7ca4d22998dd43599a48acb9cb75b454&role.id=1f3ee786628740418d65c827bc64a9b5 => generated 260 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:16.044856 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a91a9-d265-468b-975f-746c4da12541 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:16.160803 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 182/355] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:16.172174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a91a9-d265-468b-975f-746c4da12541 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:16.188709 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531027f-adc5-49b4-8b1e-21b632d81351 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:16.189332 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531027f-adc5-49b4-8b1e-21b632d81351 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:16.189840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531027f-adc5-49b4-8b1e-21b632d81351 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:16.191480 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 183/356] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:38:16.199582 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b95e3-9d33-4457-a421-baf91492ee38 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:16.200170 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b95e3-9d33-4457-a421-baf91492ee38 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:16.201311 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b95e3-9d33-4457-a421-baf91492ee38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:16.224090 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-927b95e3-9d33-4457-a421-baf91492ee38 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:16.225683 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-927b95e3-9d33-4457-a421-baf91492ee38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:16.250682 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f16c97-4d2f-4415-be8a-a75638da6bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:16.251199 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f16c97-4d2f-4415-be8a-a75638da6bf2 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:16.251199 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f16c97-4d2f-4415-be8a-a75638da6bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:16.251519 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f16c97-4d2f-4415-be8a-a75638da6bf2 None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:16.252202 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f16c97-4d2f-4415-be8a-a75638da6bf2 None admin] RBAC: Adding query filter params (name=member) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:16.252512 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f16c97-4d2f-4415-be8a-a75638da6bf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:16.253946 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f16c97-4d2f-4415-be8a-a75638da6bf2 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:16.270072 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 174/357] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 3 12:38:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:16.270442 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f16c97-4d2f-4415-be8a-a75638da6bf2 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:16.308059 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 184/358] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:38:16.313139 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b95e3-9d33-4457-a421-baf91492ee38 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:16.357879 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:16.389808 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:16.429114 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b95e3-9d33-4457-a421-baf91492ee38 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:16.469789 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f16c97-4d2f-4415-be8a-a75638da6bf2 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:16.470877 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06056573-a651-4f82-95f6-9c551caf344c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:16.471768 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06056573-a651-4f82-95f6-9c551caf344c None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:16.472239 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06056573-a651-4f82-95f6-9c551caf344c None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:16.472578 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06056573-a651-4f82-95f6-9c551caf344c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:16.518203 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98c35f-c696-4c83-bb8f-be9b93464d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:16.519027 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98c35f-c696-4c83-bb8f-be9b93464d9a None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:16.519422 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98c35f-c696-4c83-bb8f-be9b93464d9a None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:16.520133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98c35f-c696-4c83-bb8f-be9b93464d9a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:16.536029 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98c35f-c696-4c83-bb8f-be9b93464d9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:16.545174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-ad98c35f-c696-4c83-bb8f-be9b93464d9a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:38:16.545174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:16.545174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:16.545174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:16.545174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:16.545174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:16.545174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:16.545174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:16.545174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:16.545174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:16.545174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:16.545174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:16.545174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:16.545174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:16.545174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:16.545174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:16.546307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:16.546307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:16.546307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:16.546307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:16.546307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:16.546307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:16.546307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:16.546307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:16.546307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:16.546307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:16.546307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:16.546307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:16.546307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:16.546307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:16.546307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:16.546307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:16.547306 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:16.547306 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:16.547306 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:16.547306 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:16.547306 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:16.547306 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:16.547306 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:16.547306 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:16.547306 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:16.547306 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:16.547306 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:38:16.547306 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:16.547306 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 175/359] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 3 12:38:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:16.552692 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98c35f-c696-4c83-bb8f-be9b93464d9a None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:16.562208 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06056573-a651-4f82-95f6-9c551caf344c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:16.563894 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06056573-a651-4f82-95f6-9c551caf344c None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:16.661064 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:16.685682 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:16.712782 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 185/360] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:38:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:38:16.712782 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06056573-a651-4f82-95f6-9c551caf344c None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:16.713469 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98c35f-c696-4c83-bb8f-be9b93464d9a None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:16.763015 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4df476-b006-48b5-b4e1-1b90ff16f03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:16.763835 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4df476-b006-48b5-b4e1-1b90ff16f03b None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:16.764124 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4df476-b006-48b5-b4e1-1b90ff16f03b None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:16.764403 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4df476-b006-48b5-b4e1-1b90ff16f03b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:16.776469 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4df476-b006-48b5-b4e1-1b90ff16f03b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:16.782598 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-2e4df476-b006-48b5-b4e1-1b90ff16f03b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:38:16.782598 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:16.782598 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:16.782598 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:16.782598 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:16.782598 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:16.782598 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:16.782598 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:16.782598 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:16.782598 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:16.782598 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:16.782598 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:16.782598 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:16.782598 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:16.782598 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:16.782598 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:16.783494 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:16.783494 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:16.783494 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:16.783494 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:16.783494 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:16.783494 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:16.783494 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:16.783494 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:16.783494 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:16.783494 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:16.783494 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:16.783494 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:16.783494 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:16.783494 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:16.783494 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:16.783494 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:16.784278 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:16.784278 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:16.784278 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:16.784278 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:16.784278 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:16.784278 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:16.784278 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:16.784278 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:16.784278 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:16.784278 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:16.784278 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 03 12:38:16.784278 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:16.784278 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 176/361] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:38:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:16.785001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0908c01-a7de-4544-aac1-8abf640cf8d4 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:16.788337 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0908c01-a7de-4544-aac1-8abf640cf8d4 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:16.788337 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0908c01-a7de-4544-aac1-8abf640cf8d4 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:16.788337 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 177/362] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:16.788337 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0908c01-a7de-4544-aac1-8abf640cf8d4 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:16.867183 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06056573-a651-4f82-95f6-9c551caf344c None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:16.915371 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ccccb3-9d50-4f3b-8e1f-1733863bc9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:16.916029 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ccccb3-9d50-4f3b-8e1f-1733863bc9a8 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:16.916318 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ccccb3-9d50-4f3b-8e1f-1733863bc9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:16.916594 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ccccb3-9d50-4f3b-8e1f-1733863bc9a8 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:16.917319 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ccccb3-9d50-4f3b-8e1f-1733863bc9a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:16.917707 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ccccb3-9d50-4f3b-8e1f-1733863bc9a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:16.919133 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ccccb3-9d50-4f3b-8e1f-1733863bc9a8 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:16.919537 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0908c01-a7de-4544-aac1-8abf640cf8d4 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:16.928629 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 186/363] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:38:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:16.929986 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94866d3d-30d2-42c1-83e2-1b218d96a841 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:16.930275 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94866d3d-30d2-42c1-83e2-1b218d96a841 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:16.930554 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94866d3d-30d2-42c1-83e2-1b218d96a841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:16.953053 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-94866d3d-30d2-42c1-83e2-1b218d96a841 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:16.954855 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-94866d3d-30d2-42c1-83e2-1b218d96a841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:16.967635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028437c-8f93-4bea-908c-aa833330fd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:16.968710 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028437c-8f93-4bea-908c-aa833330fd34 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:16.969007 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028437c-8f93-4bea-908c-aa833330fd34 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:16.969286 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028437c-8f93-4bea-908c-aa833330fd34 None admin] PATH_INFO: `/v3/projects/002bce0a21cf47508d077794ed19def7` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:16.970748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028437c-8f93-4bea-908c-aa833330fd34 None admin] RBAC: Authorizing `identity:get_project(project_id=002bce0a21cf47508d077794ed19def7)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:16.972921 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028437c-8f93-4bea-908c-aa833330fd34 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:16.975820 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 178/364] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:38:16 2022] GET /identity/v3/projects/002bce0a21cf47508d077794ed19def7 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:16.976702 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028437c-8f93-4bea-908c-aa833330fd34 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:16.988345 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:16.998171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:17.040634 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 187/365] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:17.045699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94866d3d-30d2-42c1-83e2-1b218d96a841 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:17.099785 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028437c-8f93-4bea-908c-aa833330fd34 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:17.135615 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05f3ae-5475-4650-a184-a05aed012e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:17.136246 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05f3ae-5475-4650-a184-a05aed012e43 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:17.136529 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05f3ae-5475-4650-a184-a05aed012e43 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:17.136806 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05f3ae-5475-4650-a184-a05aed012e43 None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:17.137561 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05f3ae-5475-4650-a184-a05aed012e43 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:17.138477 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05f3ae-5475-4650-a184-a05aed012e43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:17.139869 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05f3ae-5475-4650-a184-a05aed012e43 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:17.149307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 179/366] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 3 12:38:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:17.150112 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05f3ae-5475-4650-a184-a05aed012e43 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:17.186417 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94866d3d-30d2-42c1-83e2-1b218d96a841 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:17.225277 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42496fda-fb21-4aaf-80b2-657c2ee208bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:17.226028 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42496fda-fb21-4aaf-80b2-657c2ee208bc None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:17.226310 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42496fda-fb21-4aaf-80b2-657c2ee208bc None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:17.226582 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42496fda-fb21-4aaf-80b2-657c2ee208bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:17.232007 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:17.258887 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:17.259532 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05f3ae-5475-4650-a184-a05aed012e43 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:17.296352 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7842c95-e5c3-4364-b087-464c4ac15e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:17.296931 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7842c95-e5c3-4364-b087-464c4ac15e8b None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:17.297211 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7842c95-e5c3-4364-b087-464c4ac15e8b None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:17.297487 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7842c95-e5c3-4364-b087-464c4ac15e8b None admin] PATH_INFO: `/v3/groups/60fc43b20c8149eda819bdeff51c161a` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:17.298721 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7842c95-e5c3-4364-b087-464c4ac15e8b None admin] RBAC: Authorizing `identity:get_group(group_id=60fc43b20c8149eda819bdeff51c161a)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:17.300171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7842c95-e5c3-4364-b087-464c4ac15e8b None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:17.302267 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 180/367] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Aug 3 12:38:17 2022] GET /identity/v3/groups/60fc43b20c8149eda819bdeff51c161a => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:17.303114 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7842c95-e5c3-4364-b087-464c4ac15e8b None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:17.312998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42496fda-fb21-4aaf-80b2-657c2ee208bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:17.314555 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42496fda-fb21-4aaf-80b2-657c2ee208bc None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:17.411410 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7842c95-e5c3-4364-b087-464c4ac15e8b None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:17.437875 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 188/368] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:38:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:38:17.438770 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42496fda-fb21-4aaf-80b2-657c2ee208bc None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:17.462824 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4b161-b107-45fc-bcad-3b68f50ad089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:17.463647 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4b161-b107-45fc-bcad-3b68f50ad089 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:17.463934 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4b161-b107-45fc-bcad-3b68f50ad089 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:17.464208 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4b161-b107-45fc-bcad-3b68f50ad089 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:17.478973 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e4b161-b107-45fc-bcad-3b68f50ad089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:17.485023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-c1e4b161-b107-45fc-bcad-3b68f50ad089 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:38:17.485023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:17.485023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:17.485023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:17.485023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:17.485023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:17.485023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:17.485023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:17.485023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:17.485023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:17.485023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:17.485023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:17.485023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:17.485023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:17.485023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:17.485023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:17.485938 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:17.485938 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:17.485938 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:17.485938 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:17.485938 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:17.485938 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:17.485938 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:17.485938 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:17.485938 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:17.485938 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:17.485938 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:17.485938 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:17.485938 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:17.485938 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:17.485938 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:17.485938 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:17.486727 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:17.486727 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:17.486727 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:17.486727 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:17.486727 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:17.486727 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:17.486727 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:17.486727 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:17.486727 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:17.486727 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:17.486727 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:38:17.486727 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:17.487790 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 181/369] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 3 12:38:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:17.488520 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4b161-b107-45fc-bcad-3b68f50ad089 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:17.491724 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:17.513884 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:17.572270 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42496fda-fb21-4aaf-80b2-657c2ee208bc None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:17.622794 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63decd7a-0f91-4f7c-9265-d4aed19b6899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:17.623551 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63decd7a-0f91-4f7c-9265-d4aed19b6899 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:17.623840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63decd7a-0f91-4f7c-9265-d4aed19b6899 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:17.624119 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63decd7a-0f91-4f7c-9265-d4aed19b6899 None admin] PATH_INFO: `/v3/users/77317825359b402286edab99a91572d6` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:17.625653 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63decd7a-0f91-4f7c-9265-d4aed19b6899 None admin] RBAC: Authorizing `identity:get_user(user_id=77317825359b402286edab99a91572d6)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:17.628184 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63decd7a-0f91-4f7c-9265-d4aed19b6899 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:17.630187 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 189/370] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:38:17 2022] GET /identity/v3/users/77317825359b402286edab99a91572d6 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:17.630971 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63decd7a-0f91-4f7c-9265-d4aed19b6899 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:17.636294 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4b161-b107-45fc-bcad-3b68f50ad089 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:17.685481 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2222f21-90b6-48ba-8a87-a67f32668df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:17.686565 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2222f21-90b6-48ba-8a87-a67f32668df7 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:17.687116 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2222f21-90b6-48ba-8a87-a67f32668df7 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:17.687620 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2222f21-90b6-48ba-8a87-a67f32668df7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:17.688625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2222f21-90b6-48ba-8a87-a67f32668df7 None admin] RBAC: Adding query filter params (group.id=60fc43b20c8149eda819bdeff51c161a, role.id=e1c6e31e9e944b23bc9ba6b0099d3376, scope.project.id=002bce0a21cf47508d077794ed19def7) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:17.689205 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2222f21-90b6-48ba-8a87-a67f32668df7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:17.690955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2222f21-90b6-48ba-8a87-a67f32668df7 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:17.697171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 182/371] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Aug 3 12:38:17 2022] GET /identity/v3/role_assignments?group.id=60fc43b20c8149eda819bdeff51c161a&scope.project.id=002bce0a21cf47508d077794ed19def7&role.id=e1c6e31e9e944b23bc9ba6b0099d3376 => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:17.699078 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2222f21-90b6-48ba-8a87-a67f32668df7 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:17.765281 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63decd7a-0f91-4f7c-9265-d4aed19b6899 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:17.786597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:17.808153 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:17.820947 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228c9f7-3da2-4c9a-869b-1ad836c198ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:17.821640 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228c9f7-3da2-4c9a-869b-1ad836c198ce None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:17.821922 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228c9f7-3da2-4c9a-869b-1ad836c198ce None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:17.822198 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228c9f7-3da2-4c9a-869b-1ad836c198ce None admin] PATH_INFO: `/v3/projects/002bce0a21cf47508d077794ed19def7` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:17.823805 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228c9f7-3da2-4c9a-869b-1ad836c198ce None admin] RBAC: Authorizing `identity:get_project(project_id=002bce0a21cf47508d077794ed19def7)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:17.826315 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228c9f7-3da2-4c9a-869b-1ad836c198ce None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:17.828710 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 190/372] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:38:17 2022] GET /identity/v3/projects/002bce0a21cf47508d077794ed19def7 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:17.830210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228c9f7-3da2-4c9a-869b-1ad836c198ce None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:17.832651 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2222f21-90b6-48ba-8a87-a67f32668df7 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:17.881014 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8914560-a5e6-45d0-8422-4607ece424c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:17.881931 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8914560-a5e6-45d0-8422-4607ece424c2 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:17.882221 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8914560-a5e6-45d0-8422-4607ece424c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:17.882499 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8914560-a5e6-45d0-8422-4607ece424c2 None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:17.884216 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8914560-a5e6-45d0-8422-4607ece424c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:17.884537 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8914560-a5e6-45d0-8422-4607ece424c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:17.885970 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8914560-a5e6-45d0-8422-4607ece424c2 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:17.897557 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 183/373] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:38:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:17.899170 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8914560-a5e6-45d0-8422-4607ece424c2 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:17.965436 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228c9f7-3da2-4c9a-869b-1ad836c198ce None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:18.004454 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072323b4-6898-4622-83d7-05e9cbaef132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:18.005439 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072323b4-6898-4622-83d7-05e9cbaef132 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:18.005975 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072323b4-6898-4622-83d7-05e9cbaef132 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:18.006471 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072323b4-6898-4622-83d7-05e9cbaef132 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:18.007535 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072323b4-6898-4622-83d7-05e9cbaef132 None admin] RBAC: Adding query filter params (role.id=88752d25daad459b9cc7232c4818bb30, user.id=77317825359b402286edab99a91572d6, scope.system=all) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:18.008044 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072323b4-6898-4622-83d7-05e9cbaef132 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:18.009811 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072323b4-6898-4622-83d7-05e9cbaef132 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:18.024063 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 191/374] 10.222.0.46 () {56 vars in 1308 bytes} [Wed Aug 3 12:38:17 2022] GET /identity/v3/role_assignments?user.id=77317825359b402286edab99a91572d6&scope.system=all&role.id=88752d25daad459b9cc7232c4818bb30 => generated 510 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:18.025228 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072323b4-6898-4622-83d7-05e9cbaef132 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:18.029319 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8914560-a5e6-45d0-8422-4607ece424c2 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:18.061821 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:18.071545 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33af58d-9ab9-4c03-878d-2184dd35e987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:18.072099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33af58d-9ab9-4c03-878d-2184dd35e987 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:18.072383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33af58d-9ab9-4c03-878d-2184dd35e987 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:18.072659 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33af58d-9ab9-4c03-878d-2184dd35e987 None admin] PATH_INFO: `/v3/groups/60fc43b20c8149eda819bdeff51c161a` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:18.074032 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33af58d-9ab9-4c03-878d-2184dd35e987 None admin] RBAC: Authorizing `identity:get_group(group_id=60fc43b20c8149eda819bdeff51c161a)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:18.076069 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33af58d-9ab9-4c03-878d-2184dd35e987 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:18.078179 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 184/375] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Aug 3 12:38:17 2022] GET /identity/v3/groups/60fc43b20c8149eda819bdeff51c161a => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:18.084279 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33af58d-9ab9-4c03-878d-2184dd35e987 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:18.099306 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:18.149417 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072323b4-6898-4622-83d7-05e9cbaef132 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:18.187596 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976a563-60e7-4dc0-b0fe-43cbe15df7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:18.188340 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976a563-60e7-4dc0-b0fe-43cbe15df7a2 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:18.188525 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976a563-60e7-4dc0-b0fe-43cbe15df7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:18.188804 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976a563-60e7-4dc0-b0fe-43cbe15df7a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:18.268257 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33af58d-9ab9-4c03-878d-2184dd35e987 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:18.300517 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8976a563-60e7-4dc0-b0fe-43cbe15df7a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:18.302302 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8976a563-60e7-4dc0-b0fe-43cbe15df7a2 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:18.344659 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7521cd-3c20-4d32-b760-10cef86edcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:18.345738 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7521cd-3c20-4d32-b760-10cef86edcb6 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:18.346220 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7521cd-3c20-4d32-b760-10cef86edcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:18.346687 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7521cd-3c20-4d32-b760-10cef86edcb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:18.347826 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7521cd-3c20-4d32-b760-10cef86edcb6 None admin] RBAC: Adding query filter params (group.id=60fc43b20c8149eda819bdeff51c161a, role.id=1f3ee786628740418d65c827bc64a9b5, scope.project.id=002bce0a21cf47508d077794ed19def7) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:18.348433 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7521cd-3c20-4d32-b760-10cef86edcb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:18.350190 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7521cd-3c20-4d32-b760-10cef86edcb6 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:18.357777 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 185/376] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Aug 3 12:38:18 2022] GET /identity/v3/role_assignments?group.id=60fc43b20c8149eda819bdeff51c161a&scope.project.id=002bce0a21cf47508d077794ed19def7&role.id=1f3ee786628740418d65c827bc64a9b5 => generated 260 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:18.359532 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27794c7d-8a97-4cde-8337-151ba183a7ef None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:18.360043 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27794c7d-8a97-4cde-8337-151ba183a7ef None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:18.360512 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27794c7d-8a97-4cde-8337-151ba183a7ef None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:18.366900 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 186/377] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:18.368987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71095a5-f631-4964-9f92-8057f8a48b1e None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:18.369475 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71095a5-f631-4964-9f92-8057f8a48b1e None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:18.370162 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71095a5-f631-4964-9f92-8057f8a48b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:18.388565 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:18.393324 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-b71095a5-f631-4964-9f92-8057f8a48b1e None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:18.395540 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-b71095a5-f631-4964-9f92-8057f8a48b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:18.449508 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 192/378] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:38:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:38:18.455613 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976a563-60e7-4dc0-b0fe-43cbe15df7a2 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:18.476297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:18.499736 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 187/379] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:18.543723 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71095a5-f631-4964-9f92-8057f8a48b1e None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:18.584984 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976a563-60e7-4dc0-b0fe-43cbe15df7a2 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:18.637474 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a0ec1-9097-4dfd-b010-65360514b618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:18.638805 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a0ec1-9097-4dfd-b010-65360514b618 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:18.639173 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a0ec1-9097-4dfd-b010-65360514b618 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:18.639477 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a0ec1-9097-4dfd-b010-65360514b618 None admin] PATH_INFO: `/v3/projects/ef821f4e4aa44ffbb19f8f2890cba575` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:18.640760 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a0ec1-9097-4dfd-b010-65360514b618 None admin] RBAC: Authorizing `identity:get_project(project_id=ef821f4e4aa44ffbb19f8f2890cba575)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:18.642256 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a0ec1-9097-4dfd-b010-65360514b618 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:18.645167 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 193/380] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:38:18 2022] GET /identity/v3/projects/ef821f4e4aa44ffbb19f8f2890cba575 => generated 344 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:18.654883 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a0ec1-9097-4dfd-b010-65360514b618 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:18.688953 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:18.737851 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71095a5-f631-4964-9f92-8057f8a48b1e None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:18.783241 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b981e2-668b-40ae-9093-8cd7e5fd7f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:18.784393 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b981e2-668b-40ae-9093-8cd7e5fd7f30 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:18.784991 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b981e2-668b-40ae-9093-8cd7e5fd7f30 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:18.785482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b981e2-668b-40ae-9093-8cd7e5fd7f30 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:18.792036 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a0ec1-9097-4dfd-b010-65360514b618 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:18.800192 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b981e2-668b-40ae-9093-8cd7e5fd7f30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:18.805988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-72b981e2-668b-40ae-9093-8cd7e5fd7f30 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:38:18.805988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:18.805988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:18.805988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:18.805988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:18.805988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:18.805988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:18.805988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:18.805988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:18.805988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:18.805988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:18.805988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:18.805988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:18.805988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:18.805988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:18.805988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:18.806876 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:18.806876 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:18.806876 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:18.806876 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:18.806876 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:18.806876 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:18.806876 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:18.806876 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:18.806876 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:18.806876 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:18.806876 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:18.806876 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:18.806876 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:18.806876 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:18.806876 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:18.806876 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:18.807660 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:18.807660 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:18.807660 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:18.807660 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:18.807660 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:18.807660 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:18.807660 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:18.807660 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:18.807660 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:18.807660 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:18.807660 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:38:18.807660 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:18.815894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 188/381] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:38:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:18.817403 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b981e2-668b-40ae-9093-8cd7e5fd7f30 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:18.832307 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f488d-2123-423f-aa06-a80b4b8237f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:18.832966 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f488d-2123-423f-aa06-a80b4b8237f6 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:18.833246 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f488d-2123-423f-aa06-a80b4b8237f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:18.833543 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f488d-2123-423f-aa06-a80b4b8237f6 None admin] PATH_INFO: `/v3/groups/43a7de66a1814a5e9918d7cd8aa9f2d5` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:18.840456 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f488d-2123-423f-aa06-a80b4b8237f6 None admin] RBAC: Authorizing `identity:get_group(group_id=43a7de66a1814a5e9918d7cd8aa9f2d5)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:18.842702 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f488d-2123-423f-aa06-a80b4b8237f6 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:18.844378 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 194/382] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Aug 3 12:38:18 2022] GET /identity/v3/groups/43a7de66a1814a5e9918d7cd8aa9f2d5 => generated 229 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:18.850987 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f488d-2123-423f-aa06-a80b4b8237f6 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:18.883400 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:18.965392 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:18.971801 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b981e2-668b-40ae-9093-8cd7e5fd7f30 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:18.983226 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f488d-2123-423f-aa06-a80b4b8237f6 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:19.025911 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd99e2-c50d-4849-8f50-d08bbf1c0c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:19.026536 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd99e2-c50d-4849-8f50-d08bbf1c0c3c None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:19.026817 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd99e2-c50d-4849-8f50-d08bbf1c0c3c None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:19.027091 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd99e2-c50d-4849-8f50-d08bbf1c0c3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:19.028358 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd99e2-c50d-4849-8f50-d08bbf1c0c3c None admin] RBAC: Adding query filter params (group.id=43a7de66a1814a5e9918d7cd8aa9f2d5, role.id=0e57d142f86c471883fc07a89fe66ec8, scope.project.id=ef821f4e4aa44ffbb19f8f2890cba575) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:19.029416 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd99e2-c50d-4849-8f50-d08bbf1c0c3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:19.031095 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd99e2-c50d-4849-8f50-d08bbf1c0c3c None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:19.037941 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 195/383] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Aug 3 12:38:18 2022] GET /identity/v3/role_assignments?group.id=43a7de66a1814a5e9918d7cd8aa9f2d5&scope.project.id=ef821f4e4aa44ffbb19f8f2890cba575&role.id=0e57d142f86c471883fc07a89fe66ec8 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:19.038913 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8840c17-5a00-4c30-9b7a-9e6d0c2cced9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:19.039783 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8840c17-5a00-4c30-9b7a-9e6d0c2cced9 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:19.040317 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8840c17-5a00-4c30-9b7a-9e6d0c2cced9 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:19.040809 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8840c17-5a00-4c30-9b7a-9e6d0c2cced9 None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:19.041839 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8840c17-5a00-4c30-9b7a-9e6d0c2cced9 None admin] RBAC: Adding query filter params (name=member) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:19.042362 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8840c17-5a00-4c30-9b7a-9e6d0c2cced9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:19.044152 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8840c17-5a00-4c30-9b7a-9e6d0c2cced9 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:19.058277 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 189/384] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 3 12:38:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:19.065476 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd99e2-c50d-4849-8f50-d08bbf1c0c3c None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:19.103942 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c325a3-3a26-4234-a5b9-8d89fa185dff None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:19.104276 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c325a3-3a26-4234-a5b9-8d89fa185dff None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:19.104513 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c325a3-3a26-4234-a5b9-8d89fa185dff None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:19.106153 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 190/385] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:19.111937 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc78a60-45a0-4362-a757-77fe545da5b4 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:19.112264 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc78a60-45a0-4362-a757-77fe545da5b4 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:19.112500 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc78a60-45a0-4362-a757-77fe545da5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:19.150665 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-7cc78a60-45a0-4362-a757-77fe545da5b4 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:19.151907 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-7cc78a60-45a0-4362-a757-77fe545da5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:19.200357 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd99e2-c50d-4849-8f50-d08bbf1c0c3c None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:19.238067 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3fc40d-a542-46b5-a1b5-fd777b71eb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:19.238650 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fc40d-a542-46b5-a1b5-fd777b71eb6f None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:19.238937 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fc40d-a542-46b5-a1b5-fd777b71eb6f None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:19.239773 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fc40d-a542-46b5-a1b5-fd777b71eb6f None admin] PATH_INFO: `/v3/groups/60fc43b20c8149eda819bdeff51c161a` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:19.241008 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3fc40d-a542-46b5-a1b5-fd777b71eb6f None admin] RBAC: Authorizing `identity:get_group(group_id=60fc43b20c8149eda819bdeff51c161a)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:19.243069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3fc40d-a542-46b5-a1b5-fd777b71eb6f None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:19.245146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 196/386] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Aug 3 12:38:19 2022] GET /identity/v3/groups/60fc43b20c8149eda819bdeff51c161a => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:19.251454 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3fc40d-a542-46b5-a1b5-fd777b71eb6f None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:19.281306 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:19.295744 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 191/387] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:38:19.334796 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc78a60-45a0-4362-a757-77fe545da5b4 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:19.370606 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3fc40d-a542-46b5-a1b5-fd777b71eb6f None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:19.408897 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c48f1-0367-4383-8c0f-625944b96153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:19.409609 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c48f1-0367-4383-8c0f-625944b96153 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:19.409903 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c48f1-0367-4383-8c0f-625944b96153 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:19.410185 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c48f1-0367-4383-8c0f-625944b96153 None admin] PATH_INFO: `/v3/projects/7ca4d22998dd43599a48acb9cb75b454` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:19.411480 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c48f1-0367-4383-8c0f-625944b96153 None admin] RBAC: Authorizing `identity:get_project(project_id=7ca4d22998dd43599a48acb9cb75b454)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:19.413227 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:19.415954 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c48f1-0367-4383-8c0f-625944b96153 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:19.418723 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 197/388] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:38:19 2022] GET /identity/v3/projects/7ca4d22998dd43599a48acb9cb75b454 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:19.426486 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c48f1-0367-4383-8c0f-625944b96153 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:19.495218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc78a60-45a0-4362-a757-77fe545da5b4 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:19.529396 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:19.546757 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073e66c-c106-4c66-bae5-05564ba26ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:19.547763 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073e66c-c106-4c66-bae5-05564ba26ae7 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:19.548265 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073e66c-c106-4c66-bae5-05564ba26ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:19.548737 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073e66c-c106-4c66-bae5-05564ba26ae7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:19.551013 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c48f1-0367-4383-8c0f-625944b96153 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:19.578492 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073e66c-c106-4c66-bae5-05564ba26ae7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:19.583894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-9073e66c-c106-4c66-bae5-05564ba26ae7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:38:19.583894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:19.583894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:19.583894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:19.583894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:19.583894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:19.583894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:19.583894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:19.583894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:19.583894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:19.583894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:19.583894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:19.583894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:19.583894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:19.583894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:19.583894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:19.584764 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:19.584764 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:19.584764 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:19.584764 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:19.584764 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:19.584764 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:19.584764 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:19.584764 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:19.584764 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:19.584764 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:19.584764 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:19.584764 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:19.584764 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:19.584764 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:19.584764 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:19.584764 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:19.585581 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:19.585581 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:19.585581 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:19.585581 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:19.585581 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:19.585581 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:19.585581 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:19.585581 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:19.585581 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:19.585581 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:19.585581 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:38:19.585581 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:19.588006 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 192/389] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 3 12:38:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:19.594267 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073e66c-c106-4c66-bae5-05564ba26ae7 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:19.595086 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ae74b-6853-470f-9f4c-6d091c15ba9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:19.598822 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ae74b-6853-470f-9f4c-6d091c15ba9a None admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:19.599959 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ae74b-6853-470f-9f4c-6d091c15ba9a None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:19.600697 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ae74b-6853-470f-9f4c-6d091c15ba9a None admin] PATH_INFO: `/v3/projects/7ca4d22998dd43599a48acb9cb75b454/groups/60fc43b20c8149eda819bdeff51c161a/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:19.609004 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ae74b-6853-470f-9f4c-6d091c15ba9a None admin] RBAC: Authorizing `identity:create_grant(project_id=7ca4d22998dd43599a48acb9cb75b454, group_id=60fc43b20c8149eda819bdeff51c161a, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:19.610916 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ae74b-6853-470f-9f4c-6d091c15ba9a None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:19.630508 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 198/390] 10.222.0.46 () {58 vars in 1442 bytes} [Wed Aug 3 12:38:19 2022] PUT /identity/v3/projects/7ca4d22998dd43599a48acb9cb75b454/groups/60fc43b20c8149eda819bdeff51c161a/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:38:19.728139 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073e66c-c106-4c66-bae5-05564ba26ae7 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:19.730344 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:19.771579 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8cac4a-97f8-474f-8596-ed5002722d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:19.772134 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cac4a-97f8-474f-8596-ed5002722d6a None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:19.772414 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cac4a-97f8-474f-8596-ed5002722d6a None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:19.772687 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cac4a-97f8-474f-8596-ed5002722d6a None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:19.773488 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8cac4a-97f8-474f-8596-ed5002722d6a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:19.773770 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8cac4a-97f8-474f-8596-ed5002722d6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:19.775162 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8cac4a-97f8-474f-8596-ed5002722d6a None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:19.787997 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 193/391] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:38:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:19.794529 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ae74b-6853-470f-9f4c-6d091c15ba9a None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:19.927160 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ae74b-6853-470f-9f4c-6d091c15ba9a None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:19.965720 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642dc03-102a-4182-ad72-a447ba4b29af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:19.967118 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642dc03-102a-4182-ad72-a447ba4b29af None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:19.967421 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642dc03-102a-4182-ad72-a447ba4b29af None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:19.967701 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642dc03-102a-4182-ad72-a447ba4b29af None admin] PATH_INFO: `/v3/groups/60fc43b20c8149eda819bdeff51c161a` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:19.968863 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5642dc03-102a-4182-ad72-a447ba4b29af None admin] RBAC: Authorizing `identity:get_group(group_id=60fc43b20c8149eda819bdeff51c161a)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:19.970347 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5642dc03-102a-4182-ad72-a447ba4b29af None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:19.972283 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 199/392] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Aug 3 12:38:19 2022] GET /identity/v3/groups/60fc43b20c8149eda819bdeff51c161a => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:19.977468 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8cac4a-97f8-474f-8596-ed5002722d6a None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:20.112885 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8cac4a-97f8-474f-8596-ed5002722d6a None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:20.149155 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3438faf-5e42-410c-9206-37db1da59a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:20.149846 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3438faf-5e42-410c-9206-37db1da59a4d None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:20.150128 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3438faf-5e42-410c-9206-37db1da59a4d None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:20.150402 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3438faf-5e42-410c-9206-37db1da59a4d None admin] PATH_INFO: `/v3/projects/7ca4d22998dd43599a48acb9cb75b454` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:20.151704 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3438faf-5e42-410c-9206-37db1da59a4d None admin] RBAC: Authorizing `identity:get_project(project_id=7ca4d22998dd43599a48acb9cb75b454)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:20.154091 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3438faf-5e42-410c-9206-37db1da59a4d None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:20.156296 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 194/393] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:38:19 2022] GET /identity/v3/projects/7ca4d22998dd43599a48acb9cb75b454 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:20.161659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642dc03-102a-4182-ad72-a447ba4b29af None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:20.180439 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:20.273190 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642dc03-102a-4182-ad72-a447ba4b29af None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:20.309417 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06779802-dfee-4046-a584-17a5bca65822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:20.310500 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06779802-dfee-4046-a584-17a5bca65822 None admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:20.310786 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06779802-dfee-4046-a584-17a5bca65822 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:20.311070 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06779802-dfee-4046-a584-17a5bca65822 None admin] PATH_INFO: `/v3/projects/7ca4d22998dd43599a48acb9cb75b454/groups/60fc43b20c8149eda819bdeff51c161a/roles/1f3ee786628740418d65c827bc64a9b5` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:20.313321 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06779802-dfee-4046-a584-17a5bca65822 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ca4d22998dd43599a48acb9cb75b454, group_id=60fc43b20c8149eda819bdeff51c161a, role_id=1f3ee786628740418d65c827bc64a9b5)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:20.314815 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06779802-dfee-4046-a584-17a5bca65822 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:20.331158 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 200/394] 10.222.0.46 () {58 vars in 1442 bytes} [Wed Aug 3 12:38:20 2022] PUT /identity/v3/projects/7ca4d22998dd43599a48acb9cb75b454/groups/60fc43b20c8149eda819bdeff51c161a/roles/1f3ee786628740418d65c827bc64a9b5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:38:20.670582 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02205220-0d8a-4410-b92f-02060411f8bb None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:20.671113 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02205220-0d8a-4410-b92f-02060411f8bb None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:20.671113 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02205220-0d8a-4410-b92f-02060411f8bb None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:20.672708 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 195/395] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:20.678445 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055607f7-0732-475a-a747-3786e2abe6b0 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:20.678737 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055607f7-0732-475a-a747-3786e2abe6b0 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:20.679018 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055607f7-0732-475a-a747-3786e2abe6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:20.699569 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-055607f7-0732-475a-a747-3786e2abe6b0 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:20.701352 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-055607f7-0732-475a-a747-3786e2abe6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:20.776192 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 201/396] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:38:20.799647 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02205220-0d8a-4410-b92f-02060411f8bb None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:20.833425 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:20.922484 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02205220-0d8a-4410-b92f-02060411f8bb None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:20.958452 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7c465-b7c8-44da-83be-b96d4b174341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:20.959106 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7c465-b7c8-44da-83be-b96d4b174341 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:20.959389 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7c465-b7c8-44da-83be-b96d4b174341 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:20.959667 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7c465-b7c8-44da-83be-b96d4b174341 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:20.971115 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7c465-b7c8-44da-83be-b96d4b174341 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:20.977990 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-f4a7c465-b7c8-44da-83be-b96d4b174341 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:38:20.977990 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:20.977990 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:20.977990 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:20.977990 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:20.977990 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:20.977990 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:20.977990 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:20.977990 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:20.977990 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:20.977990 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:20.977990 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:20.977990 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:20.977990 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:20.977990 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:20.977990 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:20.978988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:20.978988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:20.978988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:20.978988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:20.978988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:20.978988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:20.978988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:20.978988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:20.978988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:20.978988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:20.978988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:20.978988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:20.978988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:20.978988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:20.978988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:20.978988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:20.979806 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:20.979806 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:20.979806 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:20.979806 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:20.979806 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:20.979806 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:20.979806 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:20.979806 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:20.979806 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:20.979806 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:20.979806 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:38:20.979806 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:20.980433 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 196/397] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:38:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:20.986266 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055607f7-0732-475a-a747-3786e2abe6b0 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:20.997814 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:21.140830 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055607f7-0732-475a-a747-3786e2abe6b0 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:21.181184 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f5974-513c-4237-b061-e25df87b1852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:21.181768 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f5974-513c-4237-b061-e25df87b1852 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:21.182050 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f5974-513c-4237-b061-e25df87b1852 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:21.182343 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f5974-513c-4237-b061-e25df87b1852 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:21.183054 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f5974-513c-4237-b061-e25df87b1852 None admin] RBAC: Adding query filter params (name=member) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:21.183357 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f5974-513c-4237-b061-e25df87b1852 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:21.184776 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f5974-513c-4237-b061-e25df87b1852 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:21.195669 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 202/398] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 3 12:38:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:21.200033 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7c465-b7c8-44da-83be-b96d4b174341 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:21.335143 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b500f08-7e09-401a-8fe2-af579b50d134 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:21.335643 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b500f08-7e09-401a-8fe2-af579b50d134 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:21.335716 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b500f08-7e09-401a-8fe2-af579b50d134 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:21.337340 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 203/399] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:21.345086 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa15204-479b-41b9-b0eb-f5b6e4d1302d None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:21.345374 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa15204-479b-41b9-b0eb-f5b6e4d1302d None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:21.345683 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa15204-479b-41b9-b0eb-f5b6e4d1302d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:21.374458 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:21.381113 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-baa15204-479b-41b9-b0eb-f5b6e4d1302d None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:21.382074 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7c465-b7c8-44da-83be-b96d4b174341 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:21.382712 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-baa15204-479b-41b9-b0eb-f5b6e4d1302d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:21.430909 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb2703-aae4-414b-88fd-912a4eae7965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:21.433724 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb2703-aae4-414b-88fd-912a4eae7965 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:21.435582 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb2703-aae4-414b-88fd-912a4eae7965 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:21.437386 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb2703-aae4-414b-88fd-912a4eae7965 None admin] PATH_INFO: `/v3/groups/60fc43b20c8149eda819bdeff51c161a` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:21.442426 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb2703-aae4-414b-88fd-912a4eae7965 None admin] RBAC: Authorizing `identity:get_group(group_id=60fc43b20c8149eda819bdeff51c161a)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:21.444734 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb2703-aae4-414b-88fd-912a4eae7965 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:21.460187 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 197/400] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Aug 3 12:38:21 2022] GET /identity/v3/groups/60fc43b20c8149eda819bdeff51c161a => generated 226 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:21.462286 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb2703-aae4-414b-88fd-912a4eae7965 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:21.500076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:21.512544 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 204/401] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:38:21.575282 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa15204-479b-41b9-b0eb-f5b6e4d1302d None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:21.667109 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb2703-aae4-414b-88fd-912a4eae7965 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:21.711759 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03de60-84fa-4e70-9293-e0c414f50a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:21.712517 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03de60-84fa-4e70-9293-e0c414f50a9a None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:21.712952 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03de60-84fa-4e70-9293-e0c414f50a9a None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:21.713380 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03de60-84fa-4e70-9293-e0c414f50a9a None admin] PATH_INFO: `/v3/projects/002bce0a21cf47508d077794ed19def7` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:21.715115 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03de60-84fa-4e70-9293-e0c414f50a9a None admin] RBAC: Authorizing `identity:get_project(project_id=002bce0a21cf47508d077794ed19def7)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:21.717107 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03de60-84fa-4e70-9293-e0c414f50a9a None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:21.719863 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 198/402] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:38:21 2022] GET /identity/v3/projects/002bce0a21cf47508d077794ed19def7 => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:21.726629 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03de60-84fa-4e70-9293-e0c414f50a9a None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:21.736502 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa15204-479b-41b9-b0eb-f5b6e4d1302d None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:21.769452 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:21.781837 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78816f9a-9c3b-4065-bc0f-dd13bf5d74ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:21.782492 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78816f9a-9c3b-4065-bc0f-dd13bf5d74ee None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:21.782775 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78816f9a-9c3b-4065-bc0f-dd13bf5d74ee None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:21.783050 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78816f9a-9c3b-4065-bc0f-dd13bf5d74ee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:21.810568 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78816f9a-9c3b-4065-bc0f-dd13bf5d74ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:21.821878 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-78816f9a-9c3b-4065-bc0f-dd13bf5d74ee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:38:21.821878 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:21.821878 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:21.821878 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:21.821878 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:21.821878 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:21.821878 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:21.821878 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:21.821878 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:21.821878 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:21.821878 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:21.821878 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:21.821878 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:21.821878 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:21.821878 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:21.821878 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:21.822828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:21.822828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:21.822828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:21.822828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:21.822828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:21.822828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:21.822828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:21.822828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:21.822828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:21.822828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:21.822828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:21.822828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:21.822828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:21.822828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:21.822828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:21.822828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:21.824352 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:21.824352 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:21.824352 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:21.824352 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:21.824352 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:21.824352 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:21.824352 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:21.824352 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:21.824352 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:21.824352 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:21.824352 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:38:21.824352 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:21.824352 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 205/403] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 3 12:38:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:38:21.831585 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78816f9a-9c3b-4065-bc0f-dd13bf5d74ee None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:21.886239 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03de60-84fa-4e70-9293-e0c414f50a9a None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:21.954829 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:21.963407 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425523b-06fe-438c-8bb3-3b2da18e5370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:21.964030 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425523b-06fe-438c-8bb3-3b2da18e5370 None admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:21.964312 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425523b-06fe-438c-8bb3-3b2da18e5370 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:21.964593 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425523b-06fe-438c-8bb3-3b2da18e5370 None admin] PATH_INFO: `/v3/projects/002bce0a21cf47508d077794ed19def7/groups/60fc43b20c8149eda819bdeff51c161a/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:21.972057 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425523b-06fe-438c-8bb3-3b2da18e5370 None admin] RBAC: Authorizing `identity:create_grant(project_id=002bce0a21cf47508d077794ed19def7, group_id=60fc43b20c8149eda819bdeff51c161a, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:21.973601 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425523b-06fe-438c-8bb3-3b2da18e5370 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:21.997127 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 199/404] 10.222.0.46 () {58 vars in 1442 bytes} [Wed Aug 3 12:38:21 2022] PUT /identity/v3/projects/002bce0a21cf47508d077794ed19def7/groups/60fc43b20c8149eda819bdeff51c161a/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:38:22.053967 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78816f9a-9c3b-4065-bc0f-dd13bf5d74ee None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:22.108530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab731d57-7706-42c7-82d0-1ac1a5d7fb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:22.109641 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab731d57-7706-42c7-82d0-1ac1a5d7fb03 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:22.110139 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab731d57-7706-42c7-82d0-1ac1a5d7fb03 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:22.110631 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab731d57-7706-42c7-82d0-1ac1a5d7fb03 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:22.111602 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab731d57-7706-42c7-82d0-1ac1a5d7fb03 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:22.112118 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab731d57-7706-42c7-82d0-1ac1a5d7fb03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:22.113777 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab731d57-7706-42c7-82d0-1ac1a5d7fb03 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:22.126312 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 206/405] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:38:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:22.130802 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425523b-06fe-438c-8bb3-3b2da18e5370 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:22.136953 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df0bfe-625e-46fd-9835-b213b8e5def3 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:22.137549 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df0bfe-625e-46fd-9835-b213b8e5def3 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:22.138578 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df0bfe-625e-46fd-9835-b213b8e5def3 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:22.140233 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 207/406] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:38:22.146727 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecd349-330f-4862-85b3-d7941314a2fc None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:22.147066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecd349-330f-4862-85b3-d7941314a2fc None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:22.147348 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecd349-330f-4862-85b3-d7941314a2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:22.170462 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-1fecd349-330f-4862-85b3-d7941314a2fc None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:22.171826 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-1fecd349-330f-4862-85b3-d7941314a2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:22.289358 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 208/407] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:22.317818 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecd349-330f-4862-85b3-d7941314a2fc None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:22.320296 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:22.346176 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425523b-06fe-438c-8bb3-3b2da18e5370 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:22.384955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d5c5a-ded5-49a4-996e-7aa268ec25ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:22.386013 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d5c5a-ded5-49a4-996e-7aa268ec25ea None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:22.386458 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d5c5a-ded5-49a4-996e-7aa268ec25ea None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:22.386993 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d5c5a-ded5-49a4-996e-7aa268ec25ea None admin] PATH_INFO: `/v3/groups/60fc43b20c8149eda819bdeff51c161a` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:22.388962 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d5c5a-ded5-49a4-996e-7aa268ec25ea None admin] RBAC: Authorizing `identity:get_group(group_id=60fc43b20c8149eda819bdeff51c161a)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:22.390583 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d5c5a-ded5-49a4-996e-7aa268ec25ea None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:22.392719 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 200/408] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Aug 3 12:38:22 2022] GET /identity/v3/groups/60fc43b20c8149eda819bdeff51c161a => generated 226 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:22.398654 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d5c5a-ded5-49a4-996e-7aa268ec25ea None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:22.403942 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:22.478114 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecd349-330f-4862-85b3-d7941314a2fc None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:22.512791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d5c5a-ded5-49a4-996e-7aa268ec25ea None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:22.535432 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d36d49-f13a-4ee3-b546-06d172ce201d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:22.536040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d36d49-f13a-4ee3-b546-06d172ce201d None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:22.536426 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d36d49-f13a-4ee3-b546-06d172ce201d None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:22.537006 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d36d49-f13a-4ee3-b546-06d172ce201d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:22.555666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7766a117-57d2-4cbe-bfd5-7f447412914e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:22.556483 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d36d49-f13a-4ee3-b546-06d172ce201d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:22.557283 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766a117-57d2-4cbe-bfd5-7f447412914e None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:22.559090 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766a117-57d2-4cbe-bfd5-7f447412914e None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:22.559636 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766a117-57d2-4cbe-bfd5-7f447412914e None admin] PATH_INFO: `/v3/projects/002bce0a21cf47508d077794ed19def7` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:22.562592 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7766a117-57d2-4cbe-bfd5-7f447412914e None admin] RBAC: Authorizing `identity:get_project(project_id=002bce0a21cf47508d077794ed19def7)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:22.565342 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7766a117-57d2-4cbe-bfd5-7f447412914e None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:22.569467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-11d36d49-f13a-4ee3-b546-06d172ce201d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:38:22.569467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:22.569467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:22.569467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:22.569467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:22.569467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:22.569467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:22.569467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:22.569467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:22.569467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:22.569467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:22.569467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:22.569467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:22.569467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:22.569467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:22.569467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:22.570545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:22.570545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:22.570545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:22.570545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:22.570545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:22.570545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:22.570545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:22.570545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:22.570545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:22.570545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:22.570545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:22.570545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:22.570545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:22.570545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:22.570545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:22.570545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:22.571481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:22.571481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:22.571481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:22.571481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:22.571481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:22.571481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:22.571481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:22.571481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:22.571481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:22.571481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:22.571481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:38:22.571481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:22.572375 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 201/409] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:38:22 2022] GET /identity/v3/projects/002bce0a21cf47508d077794ed19def7 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:22.574039 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 209/410] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 3 12:38:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:38:22.581603 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7766a117-57d2-4cbe-bfd5-7f447412914e None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:22.583512 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d36d49-f13a-4ee3-b546-06d172ce201d None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:22.633720 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:22.750153 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7766a117-57d2-4cbe-bfd5-7f447412914e None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:22.786284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d36d49-f13a-4ee3-b546-06d172ce201d None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:22.788396 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178df57-9086-48be-b6c4-8446673f988f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:22.789345 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178df57-9086-48be-b6c4-8446673f988f None admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:22.789871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178df57-9086-48be-b6c4-8446673f988f None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:22.790343 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178df57-9086-48be-b6c4-8446673f988f None admin] PATH_INFO: `/v3/projects/002bce0a21cf47508d077794ed19def7/groups/60fc43b20c8149eda819bdeff51c161a/roles/1f3ee786628740418d65c827bc64a9b5` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:22.793009 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e178df57-9086-48be-b6c4-8446673f988f None admin] RBAC: Authorizing `identity:create_grant(project_id=002bce0a21cf47508d077794ed19def7, group_id=60fc43b20c8149eda819bdeff51c161a, role_id=1f3ee786628740418d65c827bc64a9b5)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:22.795376 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e178df57-9086-48be-b6c4-8446673f988f None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:22.796738 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:22.814138 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 202/411] 10.222.0.46 () {58 vars in 1442 bytes} [Wed Aug 3 12:38:22 2022] PUT /identity/v3/projects/002bce0a21cf47508d077794ed19def7/groups/60fc43b20c8149eda819bdeff51c161a/roles/1f3ee786628740418d65c827bc64a9b5 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:38:22.815981 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c4c47-c0d9-4c91-b936-a48e2c8d0647 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:22.816614 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c4c47-c0d9-4c91-b936-a48e2c8d0647 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:22.817113 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c4c47-c0d9-4c91-b936-a48e2c8d0647 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:22.819249 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 203/412] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:22.827472 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccdc15-d7ce-416b-a68c-a2f8689b345b None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:22.828253 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccdc15-d7ce-416b-a68c-a2f8689b345b None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:22.828865 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccdc15-d7ce-416b-a68c-a2f8689b345b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:22.829321 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c867e1-d0f1-4581-94b6-a8a9fff6263c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:22.829993 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c867e1-d0f1-4581-94b6-a8a9fff6263c None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:22.830276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c867e1-d0f1-4581-94b6-a8a9fff6263c None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:22.830556 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c867e1-d0f1-4581-94b6-a8a9fff6263c None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:22.831295 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c867e1-d0f1-4581-94b6-a8a9fff6263c None admin] RBAC: Adding query filter params (name=admin) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:22.831599 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c867e1-d0f1-4581-94b6-a8a9fff6263c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:22.832989 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c867e1-d0f1-4581-94b6-a8a9fff6263c None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:22.844383 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 210/413] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:38:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:22.864154 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c867e1-d0f1-4581-94b6-a8a9fff6263c None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:22.865646 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-e1ccdc15-d7ce-416b-a68c-a2f8689b345b None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:22.867101 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-e1ccdc15-d7ce-416b-a68c-a2f8689b345b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:22.953957 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 204/414] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:38:22.977698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ccdc15-d7ce-416b-a68c-a2f8689b345b None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:23.003929 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:23.054664 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c867e1-d0f1-4581-94b6-a8a9fff6263c None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:23.105666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ccdc15-d7ce-416b-a68c-a2f8689b345b None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:23.105963 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb645f-d76b-4d2f-b7d2-22bd1c4dd848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:23.107265 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb645f-d76b-4d2f-b7d2-22bd1c4dd848 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:23.107552 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb645f-d76b-4d2f-b7d2-22bd1c4dd848 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:23.108098 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb645f-d76b-4d2f-b7d2-22bd1c4dd848 None admin] PATH_INFO: `/v3/groups/43a7de66a1814a5e9918d7cd8aa9f2d5` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:23.110198 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb645f-d76b-4d2f-b7d2-22bd1c4dd848 None admin] RBAC: Authorizing `identity:get_group(group_id=43a7de66a1814a5e9918d7cd8aa9f2d5)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:23.111715 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb645f-d76b-4d2f-b7d2-22bd1c4dd848 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:23.113709 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 211/415] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Aug 3 12:38:22 2022] GET /identity/v3/groups/43a7de66a1814a5e9918d7cd8aa9f2d5 => generated 229 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:23.115815 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9fbe7-1e24-4497-8de0-cefc2e94536b None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:23.116551 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9fbe7-1e24-4497-8de0-cefc2e94536b None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:23.116851 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9fbe7-1e24-4497-8de0-cefc2e94536b None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:23.119084 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 212/416] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:23.119851 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9fbe7-1e24-4497-8de0-cefc2e94536b None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:23.146486 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd92ec-10ad-4dcf-b1de-b5de7a7681cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:23.147130 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd92ec-10ad-4dcf-b1de-b5de7a7681cb None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:23.147406 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd92ec-10ad-4dcf-b1de-b5de7a7681cb None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:23.147675 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd92ec-10ad-4dcf-b1de-b5de7a7681cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:23.158848 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd92ec-10ad-4dcf-b1de-b5de7a7681cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:23.163731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-7fdd92ec-10ad-4dcf-b1de-b5de7a7681cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:38:23.163731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:23.163731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:23.163731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:23.163731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:23.163731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:23.163731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:23.163731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:23.163731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:23.163731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:23.163731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:23.163731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:23.163731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:23.163731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:23.163731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:23.163731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:23.164602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:23.164602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:23.164602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:23.164602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:23.164602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:23.164602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:23.164602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:23.164602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:23.164602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:23.164602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:23.164602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:23.164602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:23.164602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:23.164602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:23.164602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:23.164602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:23.165397 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:23.165397 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:23.165397 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:23.165397 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:23.165397 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:23.165397 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:23.165397 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:23.165397 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:23.165397 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:23.165397 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:23.165397 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:38:23.165397 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:23.165397 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 205/417] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:38:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:23.166640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785762a-d962-4e28-85b8-edd3dfdcbbd1 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:23.166809 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785762a-d962-4e28-85b8-edd3dfdcbbd1 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:23.166958 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785762a-d962-4e28-85b8-edd3dfdcbbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:23.173398 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:23.185820 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-a785762a-d962-4e28-85b8-edd3dfdcbbd1 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:23.187093 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-a785762a-d962-4e28-85b8-edd3dfdcbbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:23.247724 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9fbe7-1e24-4497-8de0-cefc2e94536b None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:23.282823 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 206/418] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:23.284094 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785762a-d962-4e28-85b8-edd3dfdcbbd1 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:23.287787 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:23.315481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f4b88-0e1c-4b5e-b30c-396467af7fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:23.316065 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f4b88-0e1c-4b5e-b30c-396467af7fd8 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:23.316348 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f4b88-0e1c-4b5e-b30c-396467af7fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:23.316622 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f4b88-0e1c-4b5e-b30c-396467af7fd8 None admin] PATH_INFO: `/v3/projects/ef821f4e4aa44ffbb19f8f2890cba575` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:23.317963 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f4b88-0e1c-4b5e-b30c-396467af7fd8 None admin] RBAC: Authorizing `identity:get_project(project_id=ef821f4e4aa44ffbb19f8f2890cba575)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:23.319557 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f4b88-0e1c-4b5e-b30c-396467af7fd8 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:23.321641 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 213/419] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:38:23 2022] GET /identity/v3/projects/ef821f4e4aa44ffbb19f8f2890cba575 => generated 344 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:23.322765 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f4b88-0e1c-4b5e-b30c-396467af7fd8 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:23.412794 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785762a-d962-4e28-85b8-edd3dfdcbbd1 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:23.439823 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f4b88-0e1c-4b5e-b30c-396467af7fd8 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:23.448198 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:23.454009 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1caa6d-7a1b-41fc-abed-19e670e2e953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:23.454932 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1caa6d-7a1b-41fc-abed-19e670e2e953 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:23.455366 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1caa6d-7a1b-41fc-abed-19e670e2e953 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:23.455783 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1caa6d-7a1b-41fc-abed-19e670e2e953 None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:23.456736 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1caa6d-7a1b-41fc-abed-19e670e2e953 None admin] RBAC: Adding query filter params (name=member) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:23.457242 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1caa6d-7a1b-41fc-abed-19e670e2e953 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:23.458794 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1caa6d-7a1b-41fc-abed-19e670e2e953 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:23.469370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 207/420] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 3 12:38:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:23.470403 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1caa6d-7a1b-41fc-abed-19e670e2e953 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:23.485531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37eb3a-77ff-4e6f-8f9c-3677fc6b5fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:23.486247 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37eb3a-77ff-4e6f-8f9c-3677fc6b5fdf None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:23.486531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37eb3a-77ff-4e6f-8f9c-3677fc6b5fdf None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:23.486856 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37eb3a-77ff-4e6f-8f9c-3677fc6b5fdf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:23.499104 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37eb3a-77ff-4e6f-8f9c-3677fc6b5fdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:23.506128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-ad37eb3a-77ff-4e6f-8f9c-3677fc6b5fdf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:38:23.506128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:23.506128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:23.506128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:23.506128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:23.506128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:23.506128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:23.506128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:23.506128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:23.506128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:23.506128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:23.506128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:23.506128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:23.506128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:23.506128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:23.506128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:23.507189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:23.507189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:23.507189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:23.507189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:23.507189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:23.507189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:23.507189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:23.507189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:23.507189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:23.507189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:23.507189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:23.507189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:23.507189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:23.507189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:23.507189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:23.507189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:23.508105 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:23.508105 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:23.508105 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:23.508105 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:23.508105 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:23.508105 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:23.508105 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:23.508105 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:23.508105 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:23.508105 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:23.508105 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:38:23.508105 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:23.508105 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 214/421] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 3 12:38:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:23.508858 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37eb3a-77ff-4e6f-8f9c-3677fc6b5fdf None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:23.546067 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:23.585402 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1caa6d-7a1b-41fc-abed-19e670e2e953 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:23.620098 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37eb3a-77ff-4e6f-8f9c-3677fc6b5fdf None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:23.622763 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987eb032-9ac8-4eb3-a4ad-9f2b2bc34946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:23.623724 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987eb032-9ac8-4eb3-a4ad-9f2b2bc34946 None admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:23.624160 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987eb032-9ac8-4eb3-a4ad-9f2b2bc34946 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:23.624596 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987eb032-9ac8-4eb3-a4ad-9f2b2bc34946 None admin] PATH_INFO: `/v3/projects/ef821f4e4aa44ffbb19f8f2890cba575/groups/43a7de66a1814a5e9918d7cd8aa9f2d5/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:23.626732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987eb032-9ac8-4eb3-a4ad-9f2b2bc34946 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef821f4e4aa44ffbb19f8f2890cba575, group_id=43a7de66a1814a5e9918d7cd8aa9f2d5, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:23.628439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987eb032-9ac8-4eb3-a4ad-9f2b2bc34946 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:23.646224 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 208/422] 10.222.0.46 () {58 vars in 1442 bytes} [Wed Aug 3 12:38:23 2022] PUT /identity/v3/projects/ef821f4e4aa44ffbb19f8f2890cba575/groups/43a7de66a1814a5e9918d7cd8aa9f2d5/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:38:23.647378 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987eb032-9ac8-4eb3-a4ad-9f2b2bc34946 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:23.671652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ff1fc-f29c-4391-b1a6-4a8c109e76f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:23.672415 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ff1fc-f29c-4391-b1a6-4a8c109e76f8 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:23.672702 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ff1fc-f29c-4391-b1a6-4a8c109e76f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:23.672980 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ff1fc-f29c-4391-b1a6-4a8c109e76f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:23.750017 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:23.783445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987eb032-9ac8-4eb3-a4ad-9f2b2bc34946 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:23.817402 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:23.829646 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de81615-344d-4691-80e8-8d4250882468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:23.830697 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de81615-344d-4691-80e8-8d4250882468 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:23.831159 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de81615-344d-4691-80e8-8d4250882468 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:23.831612 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de81615-344d-4691-80e8-8d4250882468 None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:23.831842 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ff1fc-f29c-4391-b1a6-4a8c109e76f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:23.832648 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de81615-344d-4691-80e8-8d4250882468 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:23.833108 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de81615-344d-4691-80e8-8d4250882468 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:23.833330 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ff1fc-f29c-4391-b1a6-4a8c109e76f8 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:23.834790 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de81615-344d-4691-80e8-8d4250882468 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:23.846202 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 209/423] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:38:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:23.852382 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de81615-344d-4691-80e8-8d4250882468 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:23.993865 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 215/424] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:38:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:38:24.001386 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ff1fc-f29c-4391-b1a6-4a8c109e76f8 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:24.002855 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de81615-344d-4691-80e8-8d4250882468 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:24.051937 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0cc21-ad42-44e4-b9ba-66acf1bc96f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:24.052567 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0cc21-ad42-44e4-b9ba-66acf1bc96f2 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:24.052851 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0cc21-ad42-44e4-b9ba-66acf1bc96f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:24.053126 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0cc21-ad42-44e4-b9ba-66acf1bc96f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:24.081704 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:24.124225 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ff1fc-f29c-4391-b1a6-4a8c109e76f8 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:24.161427 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff58bc-9757-44e1-ac88-0a4ab6f64ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:24.162386 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff58bc-9757-44e1-ac88-0a4ab6f64ebb None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:24.162811 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff58bc-9757-44e1-ac88-0a4ab6f64ebb None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:24.163227 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff58bc-9757-44e1-ac88-0a4ab6f64ebb None admin] PATH_INFO: `/v3/projects/7ca4d22998dd43599a48acb9cb75b454` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:24.164862 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff58bc-9757-44e1-ac88-0a4ab6f64ebb None admin] RBAC: Authorizing `identity:get_project(project_id=7ca4d22998dd43599a48acb9cb75b454)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:24.166479 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff58bc-9757-44e1-ac88-0a4ab6f64ebb None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:24.168732 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 216/425] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:38:24 2022] GET /identity/v3/projects/7ca4d22998dd43599a48acb9cb75b454 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:24.176056 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff58bc-9757-44e1-ac88-0a4ab6f64ebb None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:24.209430 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:24.231083 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e0cc21-ad42-44e4-b9ba-66acf1bc96f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:24.233291 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e0cc21-ad42-44e4-b9ba-66acf1bc96f2 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:24.373177 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 210/426] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:38:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:38:24.379447 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0cc21-ad42-44e4-b9ba-66acf1bc96f2 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:24.395288 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff58bc-9757-44e1-ac88-0a4ab6f64ebb None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:24.439571 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a1640-5ed8-48fa-a170-50734d97b11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:24.440224 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a1640-5ed8-48fa-a170-50734d97b11f None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:24.440764 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a1640-5ed8-48fa-a170-50734d97b11f None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:24.440764 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a1640-5ed8-48fa-a170-50734d97b11f None admin] PATH_INFO: `/v3/groups/60fc43b20c8149eda819bdeff51c161a` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:24.441955 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a1640-5ed8-48fa-a170-50734d97b11f None admin] RBAC: Authorizing `identity:get_group(group_id=60fc43b20c8149eda819bdeff51c161a)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:24.443418 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a1640-5ed8-48fa-a170-50734d97b11f None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:24.445335 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 217/427] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Aug 3 12:38:24 2022] GET /identity/v3/groups/60fc43b20c8149eda819bdeff51c161a => generated 226 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:24.446707 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100755b7-e454-49b9-aab3-163409e8e03b None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:24.446993 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100755b7-e454-49b9-aab3-163409e8e03b None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:24.447271 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100755b7-e454-49b9-aab3-163409e8e03b None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:24.453536 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 218/428] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:24.454456 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100755b7-e454-49b9-aab3-163409e8e03b None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:24.457576 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:24.509714 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:24.526083 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0cc21-ad42-44e4-b9ba-66acf1bc96f2 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:24.564452 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf67c6f-3628-4656-bf33-846737724cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:24.565297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf67c6f-3628-4656-bf33-846737724cce None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:24.565676 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf67c6f-3628-4656-bf33-846737724cce None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:24.566079 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf67c6f-3628-4656-bf33-846737724cce None admin] PATH_INFO: `/v3/projects/7ca4d22998dd43599a48acb9cb75b454` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:24.567462 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf67c6f-3628-4656-bf33-846737724cce None admin] RBAC: Authorizing `identity:get_project(project_id=7ca4d22998dd43599a48acb9cb75b454)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:24.569101 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf67c6f-3628-4656-bf33-846737724cce None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:24.571046 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 211/429] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:38:24 2022] GET /identity/v3/projects/7ca4d22998dd43599a48acb9cb75b454 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:24.572396 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6724d7-7d45-4de0-a6bf-ef83df4a1828 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:24.572762 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6724d7-7d45-4de0-a6bf-ef83df4a1828 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:24.573117 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6724d7-7d45-4de0-a6bf-ef83df4a1828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:24.576924 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100755b7-e454-49b9-aab3-163409e8e03b None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:24.596537 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-9f6724d7-7d45-4de0-a6bf-ef83df4a1828 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:24.597779 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-9f6724d7-7d45-4de0-a6bf-ef83df4a1828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:24.614176 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f004a59-a11c-407b-8e71-110b8bc815c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:24.615272 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f004a59-a11c-407b-8e71-110b8bc815c3 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:24.615845 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f004a59-a11c-407b-8e71-110b8bc815c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:24.616279 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f004a59-a11c-407b-8e71-110b8bc815c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:24.617457 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f004a59-a11c-407b-8e71-110b8bc815c3 None admin] RBAC: Adding query filter params (group.id=60fc43b20c8149eda819bdeff51c161a, role.id=e1c6e31e9e944b23bc9ba6b0099d3376, scope.project.id=7ca4d22998dd43599a48acb9cb75b454) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:24.617953 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f004a59-a11c-407b-8e71-110b8bc815c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:24.619645 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f004a59-a11c-407b-8e71-110b8bc815c3 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:24.633696 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 219/430] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Aug 3 12:38:24 2022] GET /identity/v3/role_assignments?group.id=60fc43b20c8149eda819bdeff51c161a&scope.project.id=7ca4d22998dd43599a48acb9cb75b454&role.id=e1c6e31e9e944b23bc9ba6b0099d3376 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:24.634617 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f004a59-a11c-407b-8e71-110b8bc815c3 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:24.695515 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 212/431] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:24.718955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6724d7-7d45-4de0-a6bf-ef83df4a1828 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:24.807515 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:24.858860 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f004a59-a11c-407b-8e71-110b8bc815c3 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:24.866372 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:24.884083 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6724d7-7d45-4de0-a6bf-ef83df4a1828 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:24.896958 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f077f-7e61-4a53-beb8-84132fa3745f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:24.897641 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f077f-7e61-4a53-beb8-84132fa3745f None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:24.897927 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f077f-7e61-4a53-beb8-84132fa3745f None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:24.898205 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f077f-7e61-4a53-beb8-84132fa3745f None admin] PATH_INFO: `/v3/groups/60fc43b20c8149eda819bdeff51c161a` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:24.899372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f077f-7e61-4a53-beb8-84132fa3745f None admin] RBAC: Authorizing `identity:get_group(group_id=60fc43b20c8149eda819bdeff51c161a)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:24.900808 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f077f-7e61-4a53-beb8-84132fa3745f None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:24.902619 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 220/432] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Aug 3 12:38:24 2022] GET /identity/v3/groups/60fc43b20c8149eda819bdeff51c161a => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:24.909013 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f077f-7e61-4a53-beb8-84132fa3745f None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:24.923775 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a968a-6d5e-4a37-80a9-d86838905b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:24.924425 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a968a-6d5e-4a37-80a9-d86838905b87 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:24.924861 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a968a-6d5e-4a37-80a9-d86838905b87 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:24.925141 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a968a-6d5e-4a37-80a9-d86838905b87 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:24.937514 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a968a-6d5e-4a37-80a9-d86838905b87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:24.942978 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-a64a968a-6d5e-4a37-80a9-d86838905b87 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:38:24.942978 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:24.942978 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:24.942978 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:24.942978 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:24.942978 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:24.942978 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:24.942978 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:24.942978 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:24.942978 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:24.942978 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:24.942978 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:24.942978 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:24.942978 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:24.942978 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:24.942978 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:24.943857 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:24.943857 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:24.943857 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:24.943857 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:24.943857 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:24.943857 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:24.943857 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:24.943857 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:24.943857 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:24.943857 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:24.943857 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:24.943857 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:24.943857 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:24.943857 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:24.943857 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:24.943857 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:24.944631 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:24.944631 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:24.944631 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:24.944631 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:24.944631 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:24.944631 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:24.944631 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:24.944631 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:24.944631 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:24.944631 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:24.944631 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 03 12:38:24.944631 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:24.944631 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 213/433] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:38:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:38:24.953144 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a968a-6d5e-4a37-80a9-d86838905b87 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:25.014392 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f077f-7e61-4a53-beb8-84132fa3745f None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:25.057376 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d923477-8a43-4aa3-ba5f-dc5e189295a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:25.058039 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d923477-8a43-4aa3-ba5f-dc5e189295a1 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:25.058433 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d923477-8a43-4aa3-ba5f-dc5e189295a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:25.058712 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d923477-8a43-4aa3-ba5f-dc5e189295a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:25.060353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d923477-8a43-4aa3-ba5f-dc5e189295a1 None admin] RBAC: Adding query filter params (group.id=60fc43b20c8149eda819bdeff51c161a, role.id=1f3ee786628740418d65c827bc64a9b5, scope.project.id=7ca4d22998dd43599a48acb9cb75b454) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:25.060688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d923477-8a43-4aa3-ba5f-dc5e189295a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:25.062361 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d923477-8a43-4aa3-ba5f-dc5e189295a1 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:25.064581 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:25.071155 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a968a-6d5e-4a37-80a9-d86838905b87 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:25.071533 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 221/434] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Aug 3 12:38:24 2022] GET /identity/v3/role_assignments?group.id=60fc43b20c8149eda819bdeff51c161a&scope.project.id=7ca4d22998dd43599a48acb9cb75b454&role.id=1f3ee786628740418d65c827bc64a9b5 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:25.073026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f9d00-4c0a-4511-8a32-b43d36875168 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:25.073324 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f9d00-4c0a-4511-8a32-b43d36875168 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:25.073637 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f9d00-4c0a-4511-8a32-b43d36875168 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:25.075831 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 222/435] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:25.084121 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5d306-720f-49fe-9f08-30b75e9ee131 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:25.084452 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5d306-720f-49fe-9f08-30b75e9ee131 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:25.084826 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5d306-720f-49fe-9f08-30b75e9ee131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:25.108591 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-e5c5d306-720f-49fe-9f08-30b75e9ee131 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:25.109864 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-e5c5d306-720f-49fe-9f08-30b75e9ee131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:25.126554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b5cd4-d249-4fd0-849f-345cb34868d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:25.127679 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b5cd4-d249-4fd0-849f-345cb34868d3 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:25.128132 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b5cd4-d249-4fd0-849f-345cb34868d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:25.128599 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b5cd4-d249-4fd0-849f-345cb34868d3 None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:25.129526 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b5cd4-d249-4fd0-849f-345cb34868d3 None admin] RBAC: Adding query filter params (name=member) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:25.130003 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b5cd4-d249-4fd0-849f-345cb34868d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:25.131932 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b5cd4-d249-4fd0-849f-345cb34868d3 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:25.142950 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 214/436] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 3 12:38:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:25.150613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b5cd4-d249-4fd0-849f-345cb34868d3 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:25.163473 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:25.203620 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 223/437] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:25.228210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5d306-720f-49fe-9f08-30b75e9ee131 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:25.291635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b5cd4-d249-4fd0-849f-345cb34868d3 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:25.348342 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1264e79-832e-4feb-8048-19670c070af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:25.348979 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1264e79-832e-4feb-8048-19670c070af5 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:25.349265 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1264e79-832e-4feb-8048-19670c070af5 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:25.349600 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1264e79-832e-4feb-8048-19670c070af5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:25.358132 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5d306-720f-49fe-9f08-30b75e9ee131 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:25.392020 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:25.399772 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c17e2e-3fd5-46cc-a1f4-ece8825e3363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:25.400373 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c17e2e-3fd5-46cc-a1f4-ece8825e3363 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:25.400716 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c17e2e-3fd5-46cc-a1f4-ece8825e3363 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:25.401006 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c17e2e-3fd5-46cc-a1f4-ece8825e3363 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:25.413527 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c17e2e-3fd5-46cc-a1f4-ece8825e3363 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:25.420101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-56c17e2e-3fd5-46cc-a1f4-ece8825e3363 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:38:25.420101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:25.420101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:25.420101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:25.420101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:25.420101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:25.420101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:25.420101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:25.420101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:25.420101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:25.420101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:25.420101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:25.420101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:25.420101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:25.420101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:25.420101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:25.420978 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:25.420978 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:25.420978 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:25.420978 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:25.420978 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:25.420978 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:25.420978 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:25.420978 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:25.420978 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:25.420978 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:25.420978 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:25.420978 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:25.420978 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:25.420978 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:25.420978 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:25.420978 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:25.421809 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:25.421809 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:25.421809 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:25.421809 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:25.421809 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:25.421809 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:25.421809 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:25.421809 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:25.421809 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:25.421809 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:25.421809 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:38:25.421809 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:25.424548 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 224/438] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 3 12:38:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:25.426141 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1264e79-832e-4feb-8048-19670c070af5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:25.427349 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c17e2e-3fd5-46cc-a1f4-ece8825e3363 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:25.427930 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1264e79-832e-4feb-8048-19670c070af5 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:25.439495 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:25.545351 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c17e2e-3fd5-46cc-a1f4-ece8825e3363 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:25.567640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 215/439] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:38:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:38:25.573197 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1264e79-832e-4feb-8048-19670c070af5 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:25.588248 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492a76d-55b7-45cd-92ce-94005d041a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:25.588881 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492a76d-55b7-45cd-92ce-94005d041a43 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:25.589163 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492a76d-55b7-45cd-92ce-94005d041a43 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:25.589439 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492a76d-55b7-45cd-92ce-94005d041a43 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:25.590259 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492a76d-55b7-45cd-92ce-94005d041a43 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:25.590569 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492a76d-55b7-45cd-92ce-94005d041a43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:25.591997 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492a76d-55b7-45cd-92ce-94005d041a43 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:25.601635 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 225/440] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:38:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:25.608799 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492a76d-55b7-45cd-92ce-94005d041a43 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:25.671980 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:25.695389 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1264e79-832e-4feb-8048-19670c070af5 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:25.704694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:25.733169 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492a76d-55b7-45cd-92ce-94005d041a43 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:25.736295 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658378c-5e94-4e7d-bec9-15855717a8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:25.736435 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658378c-5e94-4e7d-bec9-15855717a8a5 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:25.736706 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658378c-5e94-4e7d-bec9-15855717a8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:25.737123 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658378c-5e94-4e7d-bec9-15855717a8a5 None admin] PATH_INFO: `/v3/projects/002bce0a21cf47508d077794ed19def7` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:25.738358 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e658378c-5e94-4e7d-bec9-15855717a8a5 None admin] RBAC: Authorizing `identity:get_project(project_id=002bce0a21cf47508d077794ed19def7)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:25.740073 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e658378c-5e94-4e7d-bec9-15855717a8a5 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:25.746146 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 216/441] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:38:25 2022] GET /identity/v3/projects/002bce0a21cf47508d077794ed19def7 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:25.747798 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658378c-5e94-4e7d-bec9-15855717a8a5 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:25.772336 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad119a-6c06-4d40-9fc3-2ea2ca5da838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:25.773042 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad119a-6c06-4d40-9fc3-2ea2ca5da838 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:25.773391 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad119a-6c06-4d40-9fc3-2ea2ca5da838 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:25.773694 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad119a-6c06-4d40-9fc3-2ea2ca5da838 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:25.843259 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad119a-6c06-4d40-9fc3-2ea2ca5da838 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:25.844715 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad119a-6c06-4d40-9fc3-2ea2ca5da838 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:25.858384 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658378c-5e94-4e7d-bec9-15855717a8a5 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:25.894126 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9cd3dd-c3d5-468d-b9e9-0697206a0132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:25.894888 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9cd3dd-c3d5-468d-b9e9-0697206a0132 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:25.895104 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9cd3dd-c3d5-468d-b9e9-0697206a0132 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:25.895386 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9cd3dd-c3d5-468d-b9e9-0697206a0132 None admin] PATH_INFO: `/v3/groups/60fc43b20c8149eda819bdeff51c161a` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:25.896548 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9cd3dd-c3d5-468d-b9e9-0697206a0132 None admin] RBAC: Authorizing `identity:get_group(group_id=60fc43b20c8149eda819bdeff51c161a)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:25.898029 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9cd3dd-c3d5-468d-b9e9-0697206a0132 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:25.899468 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:25.899648 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 217/442] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Aug 3 12:38:25 2022] GET /identity/v3/groups/60fc43b20c8149eda819bdeff51c161a => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:25.906106 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9cd3dd-c3d5-468d-b9e9-0697206a0132 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:25.955503 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 226/443] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:38:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:38:25.960537 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad119a-6c06-4d40-9fc3-2ea2ca5da838 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:25.962598 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:26.018837 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9cd3dd-c3d5-468d-b9e9-0697206a0132 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:26.053365 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3496bcd-b23d-48fc-9677-2bed11199d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:26.054016 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3496bcd-b23d-48fc-9677-2bed11199d89 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:26.054304 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3496bcd-b23d-48fc-9677-2bed11199d89 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:26.054584 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3496bcd-b23d-48fc-9677-2bed11199d89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:26.055386 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3496bcd-b23d-48fc-9677-2bed11199d89 None admin] RBAC: Adding query filter params (group.id=60fc43b20c8149eda819bdeff51c161a, role.id=e1c6e31e9e944b23bc9ba6b0099d3376, scope.project.id=002bce0a21cf47508d077794ed19def7) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:26.055703 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3496bcd-b23d-48fc-9677-2bed11199d89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:26.057131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3496bcd-b23d-48fc-9677-2bed11199d89 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:26.065622 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 218/444] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Aug 3 12:38:25 2022] GET /identity/v3/role_assignments?group.id=60fc43b20c8149eda819bdeff51c161a&scope.project.id=002bce0a21cf47508d077794ed19def7&role.id=e1c6e31e9e944b23bc9ba6b0099d3376 => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:26.071320 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad119a-6c06-4d40-9fc3-2ea2ca5da838 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:26.110385 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c954d-539a-4e0e-bf6d-58061e6e8169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:26.111058 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c954d-539a-4e0e-bf6d-58061e6e8169 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:26.111343 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c954d-539a-4e0e-bf6d-58061e6e8169 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:26.111621 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c954d-539a-4e0e-bf6d-58061e6e8169 None admin] PATH_INFO: `/v3/projects/002bce0a21cf47508d077794ed19def7` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:26.112884 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022c954d-539a-4e0e-bf6d-58061e6e8169 None admin] RBAC: Authorizing `identity:get_project(project_id=002bce0a21cf47508d077794ed19def7)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:26.114670 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022c954d-539a-4e0e-bf6d-58061e6e8169 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:26.116657 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 227/445] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:38:25 2022] GET /identity/v3/projects/002bce0a21cf47508d077794ed19def7 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:26.123127 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3496bcd-b23d-48fc-9677-2bed11199d89 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:26.126202 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e8d62-f05f-4e73-84ad-d5d05839e7f3 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:26.126507 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e8d62-f05f-4e73-84ad-d5d05839e7f3 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:26.126785 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e8d62-f05f-4e73-84ad-d5d05839e7f3 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:26.128146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 228/446] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:38:26.133833 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3fc73-a146-4d98-b89b-305c36a10619 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:26.134131 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3fc73-a146-4d98-b89b-305c36a10619 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:26.134377 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3fc73-a146-4d98-b89b-305c36a10619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:26.153978 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-1bb3fc73-a146-4d98-b89b-305c36a10619 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:26.155268 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-1bb3fc73-a146-4d98-b89b-305c36a10619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:26.169975 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:26.236524 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 229/447] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:38:26.249140 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3496bcd-b23d-48fc-9677-2bed11199d89 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:26.260487 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:26.260966 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3fc73-a146-4d98-b89b-305c36a10619 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:26.288503 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19236f24-5b15-497f-b0da-390d1866dd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:26.289623 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19236f24-5b15-497f-b0da-390d1866dd3b None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:26.289917 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19236f24-5b15-497f-b0da-390d1866dd3b None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:26.290198 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19236f24-5b15-497f-b0da-390d1866dd3b None admin] PATH_INFO: `/v3/groups/60fc43b20c8149eda819bdeff51c161a` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:26.291552 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19236f24-5b15-497f-b0da-390d1866dd3b None admin] RBAC: Authorizing `identity:get_group(group_id=60fc43b20c8149eda819bdeff51c161a)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:26.294857 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19236f24-5b15-497f-b0da-390d1866dd3b None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:26.296519 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 219/448] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Aug 3 12:38:26 2022] GET /identity/v3/groups/60fc43b20c8149eda819bdeff51c161a => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:26.302784 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19236f24-5b15-497f-b0da-390d1866dd3b None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:26.384722 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3fc73-a146-4d98-b89b-305c36a10619 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:26.421129 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19236f24-5b15-497f-b0da-390d1866dd3b None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:26.428679 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bec90-c540-4f97-b719-2c6ef67bb1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:26.429080 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bec90-c540-4f97-b719-2c6ef67bb1b0 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:26.429363 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bec90-c540-4f97-b719-2c6ef67bb1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:26.429705 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bec90-c540-4f97-b719-2c6ef67bb1b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:26.442566 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8bec90-c540-4f97-b719-2c6ef67bb1b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:26.447640 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-6b8bec90-c540-4f97-b719-2c6ef67bb1b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:38:26.447640 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:26.447640 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:26.447640 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:26.447640 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:26.447640 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:26.447640 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:26.447640 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:26.447640 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:26.447640 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:26.447640 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:26.447640 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:26.447640 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:26.447640 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:26.447640 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:26.447640 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:26.448699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:26.448699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:26.448699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:26.448699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:26.448699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:26.448699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:26.448699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:26.448699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:26.448699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:26.448699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:26.448699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:26.448699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:26.448699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:26.448699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:26.448699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:26.448699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:26.449635 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:26.449635 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:26.449635 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:26.449635 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:26.449635 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:26.449635 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:26.449635 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:26.449635 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:26.449635 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:26.449635 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:26.449635 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:38:26.449635 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:26.449635 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 230/449] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 3 12:38:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:38:26.454652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bec90-c540-4f97-b719-2c6ef67bb1b0 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:26.465819 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:26.466209 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82205a24-0f57-429b-8033-a14f621f85d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:26.466747 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82205a24-0f57-429b-8033-a14f621f85d0 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:26.467029 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82205a24-0f57-429b-8033-a14f621f85d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:26.467302 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82205a24-0f57-429b-8033-a14f621f85d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:26.468201 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82205a24-0f57-429b-8033-a14f621f85d0 None admin] RBAC: Adding query filter params (group.id=60fc43b20c8149eda819bdeff51c161a, role.id=1f3ee786628740418d65c827bc64a9b5, scope.project.id=002bce0a21cf47508d077794ed19def7) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:26.468552 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82205a24-0f57-429b-8033-a14f621f85d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:26.470061 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82205a24-0f57-429b-8033-a14f621f85d0 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:26.475885 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 220/450] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Aug 3 12:38:26 2022] GET /identity/v3/role_assignments?group.id=60fc43b20c8149eda819bdeff51c161a&scope.project.id=002bce0a21cf47508d077794ed19def7&role.id=1f3ee786628740418d65c827bc64a9b5 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:26.560473 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bec90-c540-4f97-b719-2c6ef67bb1b0 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:26.596705 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5255fb-3351-45e7-b68f-251239cf7f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:26.597328 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5255fb-3351-45e7-b68f-251239cf7f3b None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:26.597643 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5255fb-3351-45e7-b68f-251239cf7f3b None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:26.597920 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5255fb-3351-45e7-b68f-251239cf7f3b None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:26.598653 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5255fb-3351-45e7-b68f-251239cf7f3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:26.598958 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5255fb-3351-45e7-b68f-251239cf7f3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:26.600363 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5255fb-3351-45e7-b68f-251239cf7f3b None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:26.610322 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 231/451] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:38:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:26.616353 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82205a24-0f57-429b-8033-a14f621f85d0 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:26.661487 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:26.720794 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82205a24-0f57-429b-8033-a14f621f85d0 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:26.754610 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8840a95-893d-4557-9a1f-d5d0ac7a044f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:26.755226 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8840a95-893d-4557-9a1f-d5d0ac7a044f None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:26.755505 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8840a95-893d-4557-9a1f-d5d0ac7a044f None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:26.755782 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8840a95-893d-4557-9a1f-d5d0ac7a044f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:26.832612 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8840a95-893d-4557-9a1f-d5d0ac7a044f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:26.834066 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8840a95-893d-4557-9a1f-d5d0ac7a044f None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:26.873163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:26.929764 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 221/452] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:38:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:38:26.936014 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5255fb-3351-45e7-b68f-251239cf7f3b None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:27.003782 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:27.033792 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5255fb-3351-45e7-b68f-251239cf7f3b None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:27.066295 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c02f2-a86a-4593-92f7-05e9213cebcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:27.066922 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c02f2-a86a-4593-92f7-05e9213cebcb None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:27.067201 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c02f2-a86a-4593-92f7-05e9213cebcb None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:27.067474 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c02f2-a86a-4593-92f7-05e9213cebcb None admin] PATH_INFO: `/v3/projects/ef821f4e4aa44ffbb19f8f2890cba575` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:27.068625 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c02f2-a86a-4593-92f7-05e9213cebcb None admin] RBAC: Authorizing `identity:get_project(project_id=ef821f4e4aa44ffbb19f8f2890cba575)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:27.070109 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c02f2-a86a-4593-92f7-05e9213cebcb None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:27.071752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 232/453] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:38:26 2022] GET /identity/v3/projects/ef821f4e4aa44ffbb19f8f2890cba575 => generated 344 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:27.077317 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8840a95-893d-4557-9a1f-d5d0ac7a044f None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:27.171575 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8840a95-893d-4557-9a1f-d5d0ac7a044f None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:27.203473 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4325391-45f8-446a-8696-d3f404bd0275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:27.204085 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4325391-45f8-446a-8696-d3f404bd0275 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:27.204361 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4325391-45f8-446a-8696-d3f404bd0275 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:27.204632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4325391-45f8-446a-8696-d3f404bd0275 None admin] PATH_INFO: `/v3/groups/43a7de66a1814a5e9918d7cd8aa9f2d5` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:27.205772 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4325391-45f8-446a-8696-d3f404bd0275 None admin] RBAC: Authorizing `identity:get_group(group_id=43a7de66a1814a5e9918d7cd8aa9f2d5)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:27.207181 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4325391-45f8-446a-8696-d3f404bd0275 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:27.208732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 222/454] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Aug 3 12:38:27 2022] GET /identity/v3/groups/43a7de66a1814a5e9918d7cd8aa9f2d5 => generated 229 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:27.214480 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c02f2-a86a-4593-92f7-05e9213cebcb None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:27.313857 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c02f2-a86a-4593-92f7-05e9213cebcb None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:27.345869 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e6fce-136d-4423-9918-313514da3648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:27.346467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e6fce-136d-4423-9918-313514da3648 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:27.346745 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e6fce-136d-4423-9918-313514da3648 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:27.347015 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e6fce-136d-4423-9918-313514da3648 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:27.347790 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e6fce-136d-4423-9918-313514da3648 None admin] RBAC: Adding query filter params (group.id=43a7de66a1814a5e9918d7cd8aa9f2d5, role.id=0e57d142f86c471883fc07a89fe66ec8, scope.project.id=ef821f4e4aa44ffbb19f8f2890cba575) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:27.348097 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e6fce-136d-4423-9918-313514da3648 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:27.349526 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e6fce-136d-4423-9918-313514da3648 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:27.355037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 233/455] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Aug 3 12:38:27 2022] GET /identity/v3/role_assignments?group.id=43a7de66a1814a5e9918d7cd8aa9f2d5&scope.project.id=ef821f4e4aa44ffbb19f8f2890cba575&role.id=0e57d142f86c471883fc07a89fe66ec8 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:29.935959 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96af7e-491b-474f-bc9a-5e422229b13f None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:29.937021 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96af7e-491b-474f-bc9a-5e422229b13f None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:29.937622 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96af7e-491b-474f-bc9a-5e422229b13f None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:29.939506 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 223/456] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:29.944711 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49701896-bb2f-419d-b325-3ccc5f66fed5 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:29.945601 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49701896-bb2f-419d-b325-3ccc5f66fed5 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:29.946086 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49701896-bb2f-419d-b325-3ccc5f66fed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:29.953359 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:29.966449 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-49701896-bb2f-419d-b325-3ccc5f66fed5 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:29.967877 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-49701896-bb2f-419d-b325-3ccc5f66fed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:30.051711 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 234/457] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:30.058134 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8f52c-c4cf-47df-b433-5333ac59223d None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:30.058418 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8f52c-c4cf-47df-b433-5333ac59223d None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:30.058693 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8f52c-c4cf-47df-b433-5333ac59223d None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:30.060650 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 224/458] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:30.066202 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba9237-c001-4c2f-8c0d-cc9a56673db2 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:30.066550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba9237-c001-4c2f-8c0d-cc9a56673db2 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:30.066825 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba9237-c001-4c2f-8c0d-cc9a56673db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:30.077750 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8f52c-c4cf-47df-b433-5333ac59223d None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:30.091664 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:30.093611 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-20ba9237-c001-4c2f-8c0d-cc9a56673db2 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:30.098824 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-20ba9237-c001-4c2f-8c0d-cc9a56673db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:30.184206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 235/459] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:30.185675 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdaaf8-fa28-4080-9bb4-a0d88f5a83a6 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:30.186020 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdaaf8-fa28-4080-9bb4-a0d88f5a83a6 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:30.186244 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdaaf8-fa28-4080-9bb4-a0d88f5a83a6 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:30.187831 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 236/460] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:30.193565 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628210a-f602-4e63-9837-4ad2f0c9a7e7 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:30.193853 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628210a-f602-4e63-9837-4ad2f0c9a7e7 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:30.194132 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628210a-f602-4e63-9837-4ad2f0c9a7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:30.214963 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-f628210a-f602-4e63-9837-4ad2f0c9a7e7 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:30.217659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-f628210a-f602-4e63-9837-4ad2f0c9a7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:30.240524 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8f52c-c4cf-47df-b433-5333ac59223d None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:30.286526 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d80336-73a3-49e7-88ba-19eef799d339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:30.287983 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d80336-73a3-49e7-88ba-19eef799d339 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:30.288470 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d80336-73a3-49e7-88ba-19eef799d339 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:30.289202 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d80336-73a3-49e7-88ba-19eef799d339 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:30.291799 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:30.302993 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d80336-73a3-49e7-88ba-19eef799d339 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:30.304698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d80336-73a3-49e7-88ba-19eef799d339 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:30.312748 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 237/461] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:30.318082 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628210a-f602-4e63-9837-4ad2f0c9a7e7 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:30.333383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-74d80336-73a3-49e7-88ba-19eef799d339 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:30.333383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:30.333383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:30.333383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:30.333383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:30.333383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:30.333383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:30.333383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:30.333383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:30.333383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:30.333383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:30.333383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:30.333383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:30.333383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:30.333383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:30.334370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:30.334370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:30.334370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:30.334370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:30.334370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:30.334370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:30.334370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:30.334370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:30.334370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:30.334370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:30.334370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:30.334370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:30.334370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:30.334370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:30.334370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:30.334370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:30.334370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:30.335455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:30.335455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:30.335455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:30.335455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:30.338799 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 225/462] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:30.341077 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d80336-73a3-49e7-88ba-19eef799d339 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:30.403963 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:30.435573 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628210a-f602-4e63-9837-4ad2f0c9a7e7 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:30.447795 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d80336-73a3-49e7-88ba-19eef799d339 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:30.472439 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b047c7d6-36a4-4f10-8a7a-abced8c4221e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:30.473430 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047c7d6-36a4-4f10-8a7a-abced8c4221e None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:30.473959 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047c7d6-36a4-4f10-8a7a-abced8c4221e None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:30.474442 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047c7d6-36a4-4f10-8a7a-abced8c4221e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:30.483601 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd9941-a0ff-4df7-ba29-09c3ff770b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:30.484490 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd9941-a0ff-4df7-ba29-09c3ff770b7d None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:30.484935 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd9941-a0ff-4df7-ba29-09c3ff770b7d None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:30.485351 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd9941-a0ff-4df7-ba29-09c3ff770b7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:30.485750 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b047c7d6-36a4-4f10-8a7a-abced8c4221e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:30.487318 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b047c7d6-36a4-4f10-8a7a-abced8c4221e None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:30.497806 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd9941-a0ff-4df7-ba29-09c3ff770b7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:30.499579 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd9941-a0ff-4df7-ba29-09c3ff770b7d None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:30.504977 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-b047c7d6-36a4-4f10-8a7a-abced8c4221e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:30.504977 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:30.504977 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:30.504977 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:30.504977 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:30.504977 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:30.504977 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:30.504977 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:30.504977 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:30.504977 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:30.504977 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:30.504977 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:30.504977 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:30.504977 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:30.504977 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:30.506025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:30.506025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:30.506025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:30.506025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:30.506025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:30.506025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:30.506025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:30.506025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:30.506025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:30.506025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:30.506025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:30.506025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:30.506025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:30.506025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:30.506025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:30.506025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:30.506025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:30.507052 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:30.507052 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:30.507052 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:30.507052 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:30.508624 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 238/463] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:30.509733 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b047c7d6-36a4-4f10-8a7a-abced8c4221e None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:30.517894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-2fdd9941-a0ff-4df7-ba29-09c3ff770b7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:30.517894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:30.517894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:30.517894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:30.517894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:30.517894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:30.517894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:30.517894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:30.517894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:30.517894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:30.517894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:30.517894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:30.517894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:30.517894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:30.517894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:30.518771 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:30.518771 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:30.518771 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:30.518771 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:30.518771 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:30.518771 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:30.518771 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:30.518771 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:30.518771 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:30.518771 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:30.518771 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:30.518771 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:30.518771 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:30.518771 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:30.518771 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:30.518771 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:30.518771 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:30.519595 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:30.519595 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:30.519595 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:30.519595 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:30.524069 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 226/464] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:30.525195 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd9941-a0ff-4df7-ba29-09c3ff770b7d None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:30.561704 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:30.620291 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b047c7d6-36a4-4f10-8a7a-abced8c4221e None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:30.632070 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd9941-a0ff-4df7-ba29-09c3ff770b7d None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:30.645629 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:30.659107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e9e16-c1fc-4b47-9b30-db3ed33f6506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:30.659722 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e9e16-c1fc-4b47-9b30-db3ed33f6506 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:30.660170 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e9e16-c1fc-4b47-9b30-db3ed33f6506 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:30.660440 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e9e16-c1fc-4b47-9b30-db3ed33f6506 None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:30.661282 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e9e16-c1fc-4b47-9b30-db3ed33f6506 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:30.661751 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e9e16-c1fc-4b47-9b30-db3ed33f6506 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:30.663345 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e9e16-c1fc-4b47-9b30-db3ed33f6506 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:30.668089 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a77a15-7bb0-4ba7-a64b-9737679b8e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:30.668853 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a77a15-7bb0-4ba7-a64b-9737679b8e99 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:30.669136 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a77a15-7bb0-4ba7-a64b-9737679b8e99 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:30.669411 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a77a15-7bb0-4ba7-a64b-9737679b8e99 None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:30.670141 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a77a15-7bb0-4ba7-a64b-9737679b8e99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:30.670447 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a77a15-7bb0-4ba7-a64b-9737679b8e99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:30.671791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a77a15-7bb0-4ba7-a64b-9737679b8e99 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:30.676883 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 239/465] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:30.677987 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e9e16-c1fc-4b47-9b30-db3ed33f6506 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:30.687381 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 227/466] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:30.688623 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc8c74-cfb8-4fe8-8e6f-64943a389aa2 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:30.688913 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc8c74-cfb8-4fe8-8e6f-64943a389aa2 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:30.689185 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc8c74-cfb8-4fe8-8e6f-64943a389aa2 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:30.690690 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 228/467] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:30.691380 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc8c74-cfb8-4fe8-8e6f-64943a389aa2 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:30.794915 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e9e16-c1fc-4b47-9b30-db3ed33f6506 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:30.798342 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:30.808682 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc8c74-cfb8-4fe8-8e6f-64943a389aa2 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:30.833407 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef29a3-a902-4854-bfed-db4b779e832c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:30.834060 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef29a3-a902-4854-bfed-db4b779e832c None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:30.834346 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef29a3-a902-4854-bfed-db4b779e832c None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:30.834616 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef29a3-a902-4854-bfed-db4b779e832c None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:30.835305 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef29a3-a902-4854-bfed-db4b779e832c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:30.835607 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef29a3-a902-4854-bfed-db4b779e832c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:30.836972 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef29a3-a902-4854-bfed-db4b779e832c None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:30.846252 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f450ae-cbfa-4ead-852f-6cabcf996c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:30.846863 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f450ae-cbfa-4ead-852f-6cabcf996c16 None admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:30.847144 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f450ae-cbfa-4ead-852f-6cabcf996c16 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:30.847424 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f450ae-cbfa-4ead-852f-6cabcf996c16 None admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:30.848101 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f450ae-cbfa-4ead-852f-6cabcf996c16 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:30.854046 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 240/468] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:30.854186 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f450ae-cbfa-4ead-852f-6cabcf996c16 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:30.854276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef29a3-a902-4854-bfed-db4b779e832c None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:30.881521 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 229/469] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Aug 3 12:38:30 2022] POST /identity/v3/users => generated 246 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:38:30.881521 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1291e50-8506-46e9-b8c1-08b58d978620 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:30.881521 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1291e50-8506-46e9-b8c1-08b58d978620 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:30.881521 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1291e50-8506-46e9-b8c1-08b58d978620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:30.896540 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-e1291e50-8506-46e9-b8c1-08b58d978620 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:30.897882 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-e1291e50-8506-46e9-b8c1-08b58d978620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:30.931194 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:30.988316 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 230/470] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:30.989268 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1291e50-8506-46e9-b8c1-08b58d978620 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:31.011036 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef29a3-a902-4854-bfed-db4b779e832c None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:31.058640 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55177463-23a0-4796-ba34-1a881131be97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:31.059169 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55177463-23a0-4796-ba34-1a881131be97 None admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:31.060057 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55177463-23a0-4796-ba34-1a881131be97 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:31.060507 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55177463-23a0-4796-ba34-1a881131be97 None admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:31.061402 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55177463-23a0-4796-ba34-1a881131be97 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:31.062872 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55177463-23a0-4796-ba34-1a881131be97 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:31.086864 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 241/471] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Aug 3 12:38:30 2022] POST /identity/v3/users => generated 248 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:38:31.087772 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55177463-23a0-4796-ba34-1a881131be97 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:31.116447 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:31.124200 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1291e50-8506-46e9-b8c1-08b58d978620 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:31.173108 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851147e9-bfdb-4b6d-941e-06aecf336dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:31.173772 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851147e9-bfdb-4b6d-941e-06aecf336dde None admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:31.174590 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851147e9-bfdb-4b6d-941e-06aecf336dde None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:31.174886 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851147e9-bfdb-4b6d-941e-06aecf336dde None admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:31.175638 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851147e9-bfdb-4b6d-941e-06aecf336dde None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:31.177732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851147e9-bfdb-4b6d-941e-06aecf336dde None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:31.207918 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 231/472] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Aug 3 12:38:30 2022] POST /identity/v3/users => generated 248 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:38:31.209705 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6d907-98fc-499b-b52d-09082e261cc2 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:31.210242 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6d907-98fc-499b-b52d-09082e261cc2 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:31.210749 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6d907-98fc-499b-b52d-09082e261cc2 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:31.212374 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 232/473] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:31.220281 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec9fa6-c941-497a-a1bc-24275eca360a None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:31.220619 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec9fa6-c941-497a-a1bc-24275eca360a None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:31.220847 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec9fa6-c941-497a-a1bc-24275eca360a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:31.237961 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55177463-23a0-4796-ba34-1a881131be97 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:31.266712 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-48ec9fa6-c941-497a-a1bc-24275eca360a None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:31.267953 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-48ec9fa6-c941-497a-a1bc-24275eca360a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:31.289049 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:31.294332 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e5c46-3d31-4890-9ecb-deabfa273e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:31.295127 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e5c46-3d31-4890-9ecb-deabfa273e4f None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:31.295521 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e5c46-3d31-4890-9ecb-deabfa273e4f None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:31.295800 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e5c46-3d31-4890-9ecb-deabfa273e4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:31.320350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e5c46-3d31-4890-9ecb-deabfa273e4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:31.322486 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e5c46-3d31-4890-9ecb-deabfa273e4f None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:31.344170 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-7c5e5c46-3d31-4890-9ecb-deabfa273e4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:31.344170 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:31.344170 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:31.344170 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:31.344170 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:31.344170 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:31.344170 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:31.344170 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:31.344170 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:31.344170 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:31.344170 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:31.344170 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:31.344170 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:31.344170 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:31.344170 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:31.345069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:31.345069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:31.345069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:31.345069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:31.345069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:31.345069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:31.345069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:31.345069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:31.345069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:31.345069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:31.345069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:31.345069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:31.345069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:31.345069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:31.345069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:31.345069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:31.345069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:31.345920 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:31.345920 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:31.345920 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:31.345920 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:31.347117 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 242/474] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:31.352992 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e5c46-3d31-4890-9ecb-deabfa273e4f None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:31.376437 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 233/475] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:31.424610 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec9fa6-c941-497a-a1bc-24275eca360a None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:31.457004 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:31.495586 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e5c46-3d31-4890-9ecb-deabfa273e4f None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:31.547161 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e3255-fec6-4e8d-83bc-8aed4c7bd9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:31.548048 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e3255-fec6-4e8d-83bc-8aed4c7bd9e9 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:31.548346 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e3255-fec6-4e8d-83bc-8aed4c7bd9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:31.549039 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e3255-fec6-4e8d-83bc-8aed4c7bd9e9 None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:31.550078 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e3255-fec6-4e8d-83bc-8aed4c7bd9e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:31.550395 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e3255-fec6-4e8d-83bc-8aed4c7bd9e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:31.552686 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e3255-fec6-4e8d-83bc-8aed4c7bd9e9 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:31.554683 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec9fa6-c941-497a-a1bc-24275eca360a None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:31.569916 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 243/476] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:31.576635 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e3255-fec6-4e8d-83bc-8aed4c7bd9e9 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:31.605270 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4cbd9-244d-4118-b1f8-fcb2515ebaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:31.606436 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4cbd9-244d-4118-b1f8-fcb2515ebaf7 None admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:31.606727 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4cbd9-244d-4118-b1f8-fcb2515ebaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:31.607159 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4cbd9-244d-4118-b1f8-fcb2515ebaf7 None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:31.608075 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4cbd9-244d-4118-b1f8-fcb2515ebaf7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:31.613952 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4cbd9-244d-4118-b1f8-fcb2515ebaf7 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:31.625120 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.sql.core [None req-7bf4cbd9-244d-4118-b1f8-fcb2515ebaf7 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 03 12:38:31.625120 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 03 12:38:31.625120 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [parameters: {'id': '9b895bf3bc464ae99591d156b233da15', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 03 12:38:31.625120 dv-cinder-850836-4-smb devstack@keystone.service[91788]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91788) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 03 12:38:31.644792 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-7bf4cbd9-244d-4118-b1f8-fcb2515ebaf7 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 03 12:38:31.644792 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:31.644792 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 03 12:38:31.644792 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 03 12:38:31.644792 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 03 12:38:31.644792 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 03 12:38:31.644792 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 03 12:38:31.644792 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application result = self._query(query) Aug 03 12:38:31.644792 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 03 12:38:31.644792 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application conn.query(q) Aug 03 12:38:31.644792 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 03 12:38:31.644792 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 03 12:38:31.644792 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 03 12:38:31.644792 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application result.read() Aug 03 12:38:31.644792 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 03 12:38:31.645737 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 03 12:38:31.645737 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 03 12:38:31.645737 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 03 12:38:31.645737 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 03 12:38:31.645737 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 03 12:38:31.645737 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 03 12:38:31.645737 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 03 12:38:31.645737 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 03 12:38:31.645737 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:31.645737 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 03 12:38:31.645737 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:31.645737 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:31.645737 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 03 12:38:31.645737 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 03 12:38:31.645737 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 03 12:38:31.645737 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return ref.to_dict() Aug 03 12:38:31.645737 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 03 12:38:31.645737 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application next(self.gen) Aug 03 12:38:31.647133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 03 12:38:31.647133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application yield resource Aug 03 12:38:31.647133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 03 12:38:31.647133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application next(self.gen) Aug 03 12:38:31.647133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 03 12:38:31.647133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self.session.rollback() Aug 03 12:38:31.647133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 12:38:31.647133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self.force_reraise() Aug 03 12:38:31.647133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 12:38:31.647133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise self.value Aug 03 12:38:31.647133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 03 12:38:31.647133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 03 12:38:31.647133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 03 12:38:31.647133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application session.commit() Aug 03 12:38:31.647133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 03 12:38:31.647133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 03 12:38:31.647133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 03 12:38:31.649416 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self._prepare_impl() Aug 03 12:38:31.649416 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 03 12:38:31.649416 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self.session.flush() Aug 03 12:38:31.649416 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 03 12:38:31.649416 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self._flush(objects) Aug 03 12:38:31.649416 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 03 12:38:31.649416 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 03 12:38:31.649416 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 03 12:38:31.649416 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application compat.raise_( Aug 03 12:38:31.649416 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 03 12:38:31.649416 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception Aug 03 12:38:31.649416 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 03 12:38:31.649416 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application flush_context.execute() Aug 03 12:38:31.649416 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 03 12:38:31.649416 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rec.execute(self) Aug 03 12:38:31.649416 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 03 12:38:31.649416 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 03 12:38:31.651444 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 03 12:38:31.651444 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 03 12:38:31.651444 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 03 12:38:31.651444 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 03 12:38:31.651444 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 03 12:38:31.651444 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 03 12:38:31.651444 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 03 12:38:31.651444 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 03 12:38:31.651444 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 03 12:38:31.651444 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 03 12:38:31.651444 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 03 12:38:31.651444 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 03 12:38:31.651444 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 03 12:38:31.651444 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 03 12:38:31.651444 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 03 12:38:31.651444 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception Aug 03 12:38:31.655472 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 03 12:38:31.655472 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 03 12:38:31.655472 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 03 12:38:31.655472 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 03 12:38:31.655472 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 03 12:38:31.655472 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application result = self._query(query) Aug 03 12:38:31.655472 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 03 12:38:31.655472 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application conn.query(q) Aug 03 12:38:31.655472 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 03 12:38:31.655472 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 03 12:38:31.655472 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 03 12:38:31.655472 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application result.read() Aug 03 12:38:31.655472 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 03 12:38:31.655472 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 03 12:38:31.655472 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 03 12:38:31.655472 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 03 12:38:31.657337 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 03 12:38:31.657337 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 03 12:38:31.657337 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 03 12:38:31.657337 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 03 12:38:31.657337 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 03 12:38:31.657337 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 03 12:38:31.657337 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [parameters: {'id': '9b895bf3bc464ae99591d156b233da15', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 03 12:38:31.657337 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 03 12:38:31.657337 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:31.657337 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:38:31.657337 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:31.657337 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:31.657337 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:31.657337 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:31.657337 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:31.657337 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:31.659242 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:31.659242 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:31.659242 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:31.659242 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:31.659242 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:31.659242 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:31.659242 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 03 12:38:31.659242 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 03 12:38:31.659242 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:31.659242 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:31.659242 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 03 12:38:31.659242 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 03 12:38:31.659242 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 03 12:38:31.659242 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 03 12:38:31.659242 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 03 12:38:31.659242 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:31.661127 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 234/477] 10.222.0.46 () {60 vars in 1131 bytes} [Wed Aug 3 12:38:31 2022] POST /identity/v3/roles => generated 144 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:38:31.661127 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4cbd9-244d-4118-b1f8-fcb2515ebaf7 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:31.681830 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:31.705911 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e3255-fec6-4e8d-83bc-8aed4c7bd9e9 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:31.743221 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0808a1-23a3-4d57-ba1b-51592b2fc373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:31.744355 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0808a1-23a3-4d57-ba1b-51592b2fc373 None admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:31.744840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0808a1-23a3-4d57-ba1b-51592b2fc373 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:31.745314 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0808a1-23a3-4d57-ba1b-51592b2fc373 None admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:31.746270 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0808a1-23a3-4d57-ba1b-51592b2fc373 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:31.748490 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0808a1-23a3-4d57-ba1b-51592b2fc373 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:31.751425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:31.782105 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 244/478] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Aug 3 12:38:31 2022] POST /identity/v3/users => generated 249 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:38:31.854066 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4cbd9-244d-4118-b1f8-fcb2515ebaf7 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:31.916908 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54342133-6f48-458e-9690-d516d8b3aaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:31.917602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54342133-6f48-458e-9690-d516d8b3aaf6 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:31.917889 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54342133-6f48-458e-9690-d516d8b3aaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:31.918168 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54342133-6f48-458e-9690-d516d8b3aaf6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:31.936543 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54342133-6f48-458e-9690-d516d8b3aaf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:31.941789 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-54342133-6f48-458e-9690-d516d8b3aaf6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:38:31.941789 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:31.941789 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:31.941789 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:31.941789 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:31.941789 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:31.941789 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:31.941789 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:31.941789 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:31.941789 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:31.941789 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:31.941789 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:31.941789 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:31.941789 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:31.941789 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:31.941789 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:31.942811 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:31.942811 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:31.942811 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:31.942811 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:31.942811 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:31.942811 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:31.942811 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:31.942811 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:31.942811 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:31.942811 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:31.942811 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:31.942811 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:31.942811 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:31.942811 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:31.942811 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:31.942811 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:31.943609 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:31.943609 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:31.943609 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:31.943609 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:31.943609 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:31.943609 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:31.943609 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:31.943609 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:31.943609 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:31.943609 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:31.943609 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 03 12:38:31.943609 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:31.947228 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 235/479] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 3 12:38:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:31.952946 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0808a1-23a3-4d57-ba1b-51592b2fc373 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:32.062595 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0808a1-23a3-4d57-ba1b-51592b2fc373 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:32.098553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000180ab-7dcd-4cd8-9801-832a1edb3451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:32.099174 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000180ab-7dcd-4cd8-9801-832a1edb3451 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:32.099452 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000180ab-7dcd-4cd8-9801-832a1edb3451 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:32.099726 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000180ab-7dcd-4cd8-9801-832a1edb3451 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:32.100452 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000180ab-7dcd-4cd8-9801-832a1edb3451 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:32.100754 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000180ab-7dcd-4cd8-9801-832a1edb3451 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:32.102161 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000180ab-7dcd-4cd8-9801-832a1edb3451 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:32.111714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 245/480] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:38:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:33.306581 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24b295-fd28-4d29-9946-9fcada55a81d None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:33.307084 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24b295-fd28-4d29-9946-9fcada55a81d None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:33.307156 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24b295-fd28-4d29-9946-9fcada55a81d None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:33.308747 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 236/481] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:33.314675 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa49eb-55c1-4b45-8ad7-87cbb8e4667e None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:33.315088 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa49eb-55c1-4b45-8ad7-87cbb8e4667e None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:33.315258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa49eb-55c1-4b45-8ad7-87cbb8e4667e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:33.334539 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-d6fa49eb-55c1-4b45-8ad7-87cbb8e4667e None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:33.335751 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-d6fa49eb-55c1-4b45-8ad7-87cbb8e4667e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:33.393099 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:33.427819 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 246/482] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:33.451777 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24b295-fd28-4d29-9946-9fcada55a81d None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:33.522098 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:33.556989 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24b295-fd28-4d29-9946-9fcada55a81d None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:33.599512 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068add9-f982-4a56-b8d4-807caf4eeaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:33.600154 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068add9-f982-4a56-b8d4-807caf4eeaaf None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:33.600435 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068add9-f982-4a56-b8d4-807caf4eeaaf None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:33.600709 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068add9-f982-4a56-b8d4-807caf4eeaaf None admin] PATH_INFO: `/v3/roles/service` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:33.615751 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068add9-f982-4a56-b8d4-807caf4eeaaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:33.620666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-4068add9-f982-4a56-b8d4-807caf4eeaaf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:38:33.620666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:33.620666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:33.620666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:33.620666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:33.620666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:33.620666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:33.620666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:33.620666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:33.620666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:33.620666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:33.620666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:33.620666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:33.620666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:33.620666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:33.620666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:33.621563 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:33.621563 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:33.621563 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:33.621563 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:33.621563 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:33.621563 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:33.621563 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:33.621563 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:33.621563 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:33.621563 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:33.621563 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:33.621563 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:33.621563 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:33.621563 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:33.621563 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:33.621563 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:33.622998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:33.622998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:33.622998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:33.622998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:33.622998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:33.622998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:33.622998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:33.622998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:33.622998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:33.622998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:33.622998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:38:33.622998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:33.622998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 237/483] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 3 12:38:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:33.628480 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa49eb-55c1-4b45-8ad7-87cbb8e4667e None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:33.725235 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e914755-3d75-4d79-970c-fdcfe024e984 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:33.725882 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e914755-3d75-4d79-970c-fdcfe024e984 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:33.726374 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e914755-3d75-4d79-970c-fdcfe024e984 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:33.728158 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 238/484] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:38:33.734069 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2371d94-90d5-4425-bc0e-28cd75effba0 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:33.734602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2371d94-90d5-4425-bc0e-28cd75effba0 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:33.735066 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2371d94-90d5-4425-bc0e-28cd75effba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:33.754577 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-a2371d94-90d5-4425-bc0e-28cd75effba0 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:33.756096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-a2371d94-90d5-4425-bc0e-28cd75effba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:33.768595 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa49eb-55c1-4b45-8ad7-87cbb8e4667e None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:33.814564 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0cf53-02fa-4060-85a9-e3523a486d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:33.815515 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0cf53-02fa-4060-85a9-e3523a486d7b None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:33.816005 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0cf53-02fa-4060-85a9-e3523a486d7b None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:33.816464 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0cf53-02fa-4060-85a9-e3523a486d7b None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:33.817370 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0cf53-02fa-4060-85a9-e3523a486d7b None admin] RBAC: Adding query filter params (name=service) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:33.817888 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0cf53-02fa-4060-85a9-e3523a486d7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:33.819437 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0cf53-02fa-4060-85a9-e3523a486d7b None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:33.830081 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 247/485] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 3 12:38:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:33.831620 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444fbba-2808-4319-b1c6-82f68a8ab4bd None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:33.832093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444fbba-2808-4319-b1c6-82f68a8ab4bd None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:33.832552 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444fbba-2808-4319-b1c6-82f68a8ab4bd None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:33.834237 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 248/486] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:33.835130 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444fbba-2808-4319-b1c6-82f68a8ab4bd None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:33.859224 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 239/487] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:38:33.865516 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1a147-af2f-4ca3-babf-dbcdac70b637 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:33.865516 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1a147-af2f-4ca3-babf-dbcdac70b637 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:33.865516 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1a147-af2f-4ca3-babf-dbcdac70b637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:33.892829 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-dfe1a147-af2f-4ca3-babf-dbcdac70b637 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:33.894107 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-dfe1a147-af2f-4ca3-babf-dbcdac70b637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:33.906714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:33.953529 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:33.971709 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444fbba-2808-4319-b1c6-82f68a8ab4bd None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:33.973573 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 240/488] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:33.974626 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1a147-af2f-4ca3-babf-dbcdac70b637 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:34.029810 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21091c65-d78b-4b36-94cf-c82fe8dab9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:34.030483 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21091c65-d78b-4b36-94cf-c82fe8dab9e0 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:34.030808 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21091c65-d78b-4b36-94cf-c82fe8dab9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:34.031084 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21091c65-d78b-4b36-94cf-c82fe8dab9e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:34.045882 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21091c65-d78b-4b36-94cf-c82fe8dab9e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:34.047838 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21091c65-d78b-4b36-94cf-c82fe8dab9e0 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:34.068530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-21091c65-d78b-4b36-94cf-c82fe8dab9e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:34.068530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:34.068530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:34.068530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:34.068530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:34.068530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:34.068530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:34.068530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:34.068530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:34.068530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:34.068530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:34.068530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:34.068530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:34.068530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:34.068530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:34.069381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:34.069381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:34.069381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:34.069381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:34.069381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:34.069381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:34.069381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:34.069381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:34.069381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:34.069381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:34.069381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:34.069381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:34.069381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:34.069381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:34.069381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:34.069381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:34.069381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:34.070258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:34.070258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:34.070258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:34.070258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:34.070258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 249/489] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:34.071131 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21091c65-d78b-4b36-94cf-c82fe8dab9e0 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:34.099460 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1a147-af2f-4ca3-babf-dbcdac70b637 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:34.148566 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70732d74-1f3a-438f-a825-1078b049dad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:34.149525 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70732d74-1f3a-438f-a825-1078b049dad5 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:34.149970 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70732d74-1f3a-438f-a825-1078b049dad5 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:34.150247 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70732d74-1f3a-438f-a825-1078b049dad5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:34.165230 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70732d74-1f3a-438f-a825-1078b049dad5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:34.173189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-70732d74-1f3a-438f-a825-1078b049dad5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:38:34.173189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:34.173189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:34.173189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:34.173189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:34.173189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:34.173189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:34.173189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:34.173189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:34.173189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:34.173189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:34.173189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:34.173189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:34.173189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:34.173189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:34.173189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:34.174101 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:34.174101 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:34.174101 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:34.174101 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:34.174101 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:34.174101 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:34.174101 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:34.174101 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:34.174101 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:34.174101 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:34.174101 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:34.174101 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:34.174101 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:34.174101 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:34.174101 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:34.174101 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:34.174882 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:34.174882 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:34.174882 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:34.174882 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:34.174882 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:34.174882 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:34.174882 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:34.174882 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:34.174882 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:34.174882 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:34.174882 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:38:34.174882 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:34.174882 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 241/490] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 3 12:38:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:34.180590 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70732d74-1f3a-438f-a825-1078b049dad5 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:34.189721 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:34.198399 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21091c65-d78b-4b36-94cf-c82fe8dab9e0 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:34.237948 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fced29a-60ee-45ce-9854-ec3b95655615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:34.239023 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fced29a-60ee-45ce-9854-ec3b95655615 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:34.239751 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fced29a-60ee-45ce-9854-ec3b95655615 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:34.240217 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fced29a-60ee-45ce-9854-ec3b95655615 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:34.243439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:34.252102 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fced29a-60ee-45ce-9854-ec3b95655615 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:34.257775 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-2fced29a-60ee-45ce-9854-ec3b95655615 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:38:34.257775 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:34.257775 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:34.257775 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:34.257775 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:34.257775 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:34.257775 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:34.257775 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:34.257775 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:34.257775 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:34.257775 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:34.257775 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:34.257775 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:34.257775 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:34.257775 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:34.257775 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:34.258650 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:34.258650 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:34.258650 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:34.258650 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:34.258650 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:34.258650 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:34.258650 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:34.258650 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:34.258650 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:34.258650 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:34.258650 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:34.258650 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:34.258650 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:34.258650 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:34.258650 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:34.258650 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:34.259435 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:34.259435 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:34.259435 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:34.259435 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:34.259435 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:34.259435 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:34.259435 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:34.259435 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:34.259435 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:34.259435 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:34.259435 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:38:34.259435 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:34.262017 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 250/491] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 3 12:38:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:34.263074 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fced29a-60ee-45ce-9854-ec3b95655615 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:34.316870 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70732d74-1f3a-438f-a825-1078b049dad5 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:34.351770 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2550a2-eaeb-462e-8927-512753621dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:34.352603 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2550a2-eaeb-462e-8927-512753621dad None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:34.352603 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2550a2-eaeb-462e-8927-512753621dad None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:34.352854 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2550a2-eaeb-462e-8927-512753621dad None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:34.353539 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2550a2-eaeb-462e-8927-512753621dad None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:34.353858 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2550a2-eaeb-462e-8927-512753621dad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:34.355213 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2550a2-eaeb-462e-8927-512753621dad None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:34.368239 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 242/492] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:34.369136 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2550a2-eaeb-462e-8927-512753621dad None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:34.392297 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fced29a-60ee-45ce-9854-ec3b95655615 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:34.432037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5a62a-ba75-442c-af68-fedd4cc05f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:34.433049 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5a62a-ba75-442c-af68-fedd4cc05f2e None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:34.433704 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5a62a-ba75-442c-af68-fedd4cc05f2e None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:34.434750 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5a62a-ba75-442c-af68-fedd4cc05f2e None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:34.435749 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5a62a-ba75-442c-af68-fedd4cc05f2e None admin] RBAC: Adding query filter params (name=service) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:34.436366 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5a62a-ba75-442c-af68-fedd4cc05f2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:34.438152 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5a62a-ba75-442c-af68-fedd4cc05f2e None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:34.447236 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 251/493] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 3 12:38:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:34.448540 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5a62a-ba75-442c-af68-fedd4cc05f2e None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:34.475901 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:34.485099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2550a2-eaeb-462e-8927-512753621dad None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:34.499895 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:34.534293 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344dc09-5760-45cd-8941-a8cdb57f3c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:34.535271 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344dc09-5760-45cd-8941-a8cdb57f3c49 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:34.535975 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344dc09-5760-45cd-8941-a8cdb57f3c49 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:34.536498 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344dc09-5760-45cd-8941-a8cdb57f3c49 None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:34.538108 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344dc09-5760-45cd-8941-a8cdb57f3c49 None admin] RBAC: Adding query filter params (name=service) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:34.538859 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344dc09-5760-45cd-8941-a8cdb57f3c49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:34.541592 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344dc09-5760-45cd-8941-a8cdb57f3c49 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:34.552712 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 243/494] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 3 12:38:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:34.554070 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344dc09-5760-45cd-8941-a8cdb57f3c49 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:34.575375 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5a62a-ba75-442c-af68-fedd4cc05f2e None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:34.612052 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e39e37-c4c7-4a99-bbeb-e2a2bd053a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:34.612617 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e39e37-c4c7-4a99-bbeb-e2a2bd053a6f None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:34.612904 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e39e37-c4c7-4a99-bbeb-e2a2bd053a6f None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:34.613178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e39e37-c4c7-4a99-bbeb-e2a2bd053a6f None admin] PATH_INFO: `/v3/users/nova` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:34.620934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e39e37-c4c7-4a99-bbeb-e2a2bd053a6f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:34.623055 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e39e37-c4c7-4a99-bbeb-e2a2bd053a6f None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:34.635515 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-78e39e37-c4c7-4a99-bbeb-e2a2bd053a6f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:38:34.635515 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:34.635515 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:34.635515 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:34.635515 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:34.635515 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:34.635515 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:34.635515 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:34.635515 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:34.635515 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:34.635515 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:34.635515 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:34.635515 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:38:34.635515 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:38:34.635515 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:38:34.635515 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:38:34.636438 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:34.636438 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:34.636438 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:38:34.636438 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:38:34.636438 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:38:34.636438 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:38:34.636438 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:34.636438 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:34.636438 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:34.636438 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:34.636438 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:34.636438 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:34.636438 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:34.636438 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:34.636438 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:34.636438 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:34.636438 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:34.636438 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:34.637358 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:34.637358 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:34.637358 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:38:34.637358 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:38:34.637358 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:38:34.637358 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:38:34.637358 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:38:34.637358 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:38:34.637358 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:38:34.637358 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:34.637358 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 252/495] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Aug 3 12:38:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:34.638559 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa74aab-b3e5-4967-b203-7fd8e08ca0de None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:34.638559 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa74aab-b3e5-4967-b203-7fd8e08ca0de None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:34.638559 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa74aab-b3e5-4967-b203-7fd8e08ca0de None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:34.643553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 253/496] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:34.644331 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa74aab-b3e5-4967-b203-7fd8e08ca0de None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:34.670361 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344dc09-5760-45cd-8941-a8cdb57f3c49 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:34.707840 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4ca5f-fc35-4725-960d-9b012afa8ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:34.708787 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4ca5f-fc35-4725-960d-9b012afa8ee0 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:34.709218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4ca5f-fc35-4725-960d-9b012afa8ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:34.709766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4ca5f-fc35-4725-960d-9b012afa8ee0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:34.721296 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:34.722554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4ca5f-fc35-4725-960d-9b012afa8ee0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:34.724241 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4ca5f-fc35-4725-960d-9b012afa8ee0 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:34.739998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-7fe4ca5f-fc35-4725-960d-9b012afa8ee0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:34.739998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:34.739998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:34.739998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:34.739998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:34.739998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:34.739998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:34.739998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:34.739998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:34.739998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:34.739998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:34.739998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:34.739998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:34.739998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:34.739998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:34.740843 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:34.740843 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:34.740843 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:34.740843 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:34.740843 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:34.740843 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:34.740843 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:34.740843 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:34.740843 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:34.740843 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:34.740843 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:34.740843 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:34.740843 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:34.740843 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:34.740843 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:34.740843 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:34.740843 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:34.746198 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:34.746198 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:34.746198 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:34.746198 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:34.746198 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 244/497] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:34.746198 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4ca5f-fc35-4725-960d-9b012afa8ee0 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:34.754659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa74aab-b3e5-4967-b203-7fd8e08ca0de None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:34.770927 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:34.792019 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097ff80-e934-4d0a-89bd-e87a6dbc6264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:34.793037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097ff80-e934-4d0a-89bd-e87a6dbc6264 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:34.793432 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097ff80-e934-4d0a-89bd-e87a6dbc6264 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:34.794383 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097ff80-e934-4d0a-89bd-e87a6dbc6264 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:34.808483 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097ff80-e934-4d0a-89bd-e87a6dbc6264 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:34.810698 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097ff80-e934-4d0a-89bd-e87a6dbc6264 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:34.825089 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-a097ff80-e934-4d0a-89bd-e87a6dbc6264 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:34.825089 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:34.825089 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:34.825089 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:34.825089 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:34.825089 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:34.825089 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:34.825089 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:34.825089 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:34.825089 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:34.825089 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:34.825089 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:34.825089 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:34.825089 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:34.825089 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:34.826237 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:34.826237 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:34.826237 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:34.826237 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:34.826237 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:34.826237 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:34.826237 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:34.826237 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:34.826237 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:34.826237 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:34.826237 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:34.826237 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:34.826237 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:34.826237 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:34.826237 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:34.826237 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:34.826237 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:34.827121 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:34.827121 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:34.827121 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:34.827121 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:34.827121 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 254/498] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:34.827736 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb5c2a-ebda-4f9d-abff-27d67af5dbf2 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:34.828091 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb5c2a-ebda-4f9d-abff-27d67af5dbf2 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:34.828296 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb5c2a-ebda-4f9d-abff-27d67af5dbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:34.847701 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-60eb5c2a-ebda-4f9d-abff-27d67af5dbf2 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:34.848908 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-60eb5c2a-ebda-4f9d-abff-27d67af5dbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:34.862142 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4ca5f-fc35-4725-960d-9b012afa8ee0 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:34.897257 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e844e-da6d-46d0-a222-8ed0eee51f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:34.897904 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e844e-da6d-46d0-a222-8ed0eee51f54 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:34.898202 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e844e-da6d-46d0-a222-8ed0eee51f54 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:34.898479 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e844e-da6d-46d0-a222-8ed0eee51f54 None admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:34.899273 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e844e-da6d-46d0-a222-8ed0eee51f54 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:34.899582 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e844e-da6d-46d0-a222-8ed0eee51f54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:34.901017 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e844e-da6d-46d0-a222-8ed0eee51f54 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:34.915796 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 255/499] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:34.916665 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb5c2a-ebda-4f9d-abff-27d67af5dbf2 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:34.945347 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 245/500] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Aug 3 12:38:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:34.945347 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3511fd-817b-4936-bce6-4efdfa83356b None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:34.945347 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3511fd-817b-4936-bce6-4efdfa83356b None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:34.945347 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3511fd-817b-4936-bce6-4efdfa83356b None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:34.945347 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 246/501] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:34.945347 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3511fd-817b-4936-bce6-4efdfa83356b None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:34.984730 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:35.024911 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:35.026820 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb5c2a-ebda-4f9d-abff-27d67af5dbf2 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:35.046954 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3511fd-817b-4936-bce6-4efdfa83356b None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:35.061356 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439378b-c1cc-4f3f-a29c-4d5163294708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:35.062190 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439378b-c1cc-4f3f-a29c-4d5163294708 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:35.062482 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439378b-c1cc-4f3f-a29c-4d5163294708 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:35.062761 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439378b-c1cc-4f3f-a29c-4d5163294708 None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:35.063466 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a439378b-c1cc-4f3f-a29c-4d5163294708 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:35.063772 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a439378b-c1cc-4f3f-a29c-4d5163294708 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:35.065150 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a439378b-c1cc-4f3f-a29c-4d5163294708 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:35.076425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 256/502] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:35.077222 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439378b-c1cc-4f3f-a29c-4d5163294708 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:35.085039 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d300029-ca18-43bd-85d6-411a26f1c020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:35.085694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d300029-ca18-43bd-85d6-411a26f1c020 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:35.085979 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d300029-ca18-43bd-85d6-411a26f1c020 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:35.086259 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d300029-ca18-43bd-85d6-411a26f1c020 None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:35.086990 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d300029-ca18-43bd-85d6-411a26f1c020 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:35.087303 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d300029-ca18-43bd-85d6-411a26f1c020 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:35.088682 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d300029-ca18-43bd-85d6-411a26f1c020 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:35.100699 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 247/503] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:35.101488 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d300029-ca18-43bd-85d6-411a26f1c020 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:35.177443 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439378b-c1cc-4f3f-a29c-4d5163294708 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:35.193628 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:35.201703 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d300029-ca18-43bd-85d6-411a26f1c020 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:35.210709 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86585f89-ca55-4915-b69c-f0ff6a9a74fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:35.211342 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86585f89-ca55-4915-b69c-f0ff6a9a74fd None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:35.211883 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86585f89-ca55-4915-b69c-f0ff6a9a74fd None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:35.211883 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86585f89-ca55-4915-b69c-f0ff6a9a74fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:35.222466 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86585f89-ca55-4915-b69c-f0ff6a9a74fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:35.227821 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-86585f89-ca55-4915-b69c-f0ff6a9a74fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:38:35.227821 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:35.227821 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:35.227821 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:35.227821 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:35.227821 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:35.227821 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:35.227821 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:35.227821 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:35.227821 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:35.227821 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:35.227821 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:35.227821 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:35.227821 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:35.227821 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:35.227821 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:35.228873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:35.228873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:35.228873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:35.228873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:35.228873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:35.228873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:35.228873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:35.228873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:35.228873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:35.228873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:35.228873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:35.228873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:35.228873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:35.228873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:35.228873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:35.228873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:35.229857 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:35.229857 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:35.229857 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:35.229857 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:35.229857 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:35.229857 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:35.229857 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:35.229857 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:35.229857 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:35.229857 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:35.229857 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:38:35.229857 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:35.229857 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 257/504] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 3 12:38:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:35.230639 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc2e82-956a-461c-8096-8df90e842ef7 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:35.230639 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc2e82-956a-461c-8096-8df90e842ef7 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:35.230639 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc2e82-956a-461c-8096-8df90e842ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:35.238328 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644cb331-db43-48f3-8eef-6d6e9b1abfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:35.238946 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cb331-db43-48f3-8eef-6d6e9b1abfec None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:35.239229 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cb331-db43-48f3-8eef-6d6e9b1abfec None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:35.239747 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cb331-db43-48f3-8eef-6d6e9b1abfec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:35.248525 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-4acc2e82-956a-461c-8096-8df90e842ef7 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:35.249781 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-4acc2e82-956a-461c-8096-8df90e842ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:35.250162 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:35.312600 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644cb331-db43-48f3-8eef-6d6e9b1abfec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:35.314105 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644cb331-db43-48f3-8eef-6d6e9b1abfec None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:35.317736 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 258/505] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:35.318569 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc2e82-956a-461c-8096-8df90e842ef7 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:35.418730 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 248/506] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:38:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:38:35.419565 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644cb331-db43-48f3-8eef-6d6e9b1abfec None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:35.426588 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc2e82-956a-461c-8096-8df90e842ef7 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:35.437200 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:35.460341 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:35.462817 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b1754-cc29-458c-a214-1b5a12899ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:35.463465 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b1754-cc29-458c-a214-1b5a12899ba8 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:35.463750 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b1754-cc29-458c-a214-1b5a12899ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:35.464028 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b1754-cc29-458c-a214-1b5a12899ba8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:35.471753 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b1754-cc29-458c-a214-1b5a12899ba8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:35.473213 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b1754-cc29-458c-a214-1b5a12899ba8 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:35.485984 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-9c9b1754-cc29-458c-a214-1b5a12899ba8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 03 12:38:35.485984 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:35.485984 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:35.485984 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:35.485984 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:35.485984 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:35.485984 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:35.485984 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:35.485984 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:35.485984 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:35.485984 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:35.485984 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:35.485984 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:38:35.485984 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:38:35.485984 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:38:35.485984 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:38:35.486912 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:35.486912 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:35.486912 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:38:35.486912 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:38:35.486912 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:38:35.486912 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:38:35.486912 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:35.486912 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:35.486912 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:35.486912 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:35.486912 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:35.486912 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:35.486912 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:35.486912 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:35.486912 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:35.486912 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:35.486912 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:35.486912 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:35.487800 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:35.487800 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:35.487800 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:38:35.487800 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:38:35.487800 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:38:35.487800 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:38:35.487800 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:38:35.487800 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:38:35.487800 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 03 12:38:35.487800 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:35.487800 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 259/507] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:38:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:35.488488 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b1754-cc29-458c-a214-1b5a12899ba8 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:35.520447 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644cb331-db43-48f3-8eef-6d6e9b1abfec None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:35.553918 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a75002-8ed4-4c24-a824-9cc5679b7e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:35.554549 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a75002-8ed4-4c24-a824-9cc5679b7e4e None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:35.554831 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a75002-8ed4-4c24-a824-9cc5679b7e4e None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:35.555105 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a75002-8ed4-4c24-a824-9cc5679b7e4e None admin] PATH_INFO: `/v3/users/glance` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:35.562433 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a75002-8ed4-4c24-a824-9cc5679b7e4e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:35.563885 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a75002-8ed4-4c24-a824-9cc5679b7e4e None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:35.577144 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-e3a75002-8ed4-4c24-a824-9cc5679b7e4e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 03 12:38:35.577144 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:35.577144 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:35.577144 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:35.577144 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:35.577144 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:35.577144 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:35.577144 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:35.577144 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:35.577144 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:35.577144 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:35.577144 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:35.577144 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:38:35.577144 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:38:35.577144 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:38:35.577144 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:38:35.578071 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:35.578071 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:35.578071 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:38:35.578071 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:38:35.578071 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:38:35.578071 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:38:35.578071 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:35.578071 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:35.578071 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:35.578071 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:35.578071 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:35.578071 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:35.578071 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:35.578071 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:35.578071 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:35.578071 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:35.578071 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:35.578071 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:35.579163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:35.579163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:35.579163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:38:35.579163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:38:35.579163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:38:35.579163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:38:35.579163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:38:35.579163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:38:35.579163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 03 12:38:35.579163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:35.579163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 249/508] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:38:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:35.579944 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a75002-8ed4-4c24-a824-9cc5679b7e4e None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:35.596204 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b1754-cc29-458c-a214-1b5a12899ba8 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:35.629567 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77ae3e-4f15-4f74-9a1b-4ce9ed91f266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:35.630178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77ae3e-4f15-4f74-9a1b-4ce9ed91f266 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:35.630461 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77ae3e-4f15-4f74-9a1b-4ce9ed91f266 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:35.630738 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77ae3e-4f15-4f74-9a1b-4ce9ed91f266 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:35.631461 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77ae3e-4f15-4f74-9a1b-4ce9ed91f266 None admin] RBAC: Adding query filter params (name=service) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:35.631767 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77ae3e-4f15-4f74-9a1b-4ce9ed91f266 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:35.633167 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77ae3e-4f15-4f74-9a1b-4ce9ed91f266 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:35.641620 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 260/509] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 3 12:38:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:35.642418 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77ae3e-4f15-4f74-9a1b-4ce9ed91f266 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:35.672567 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:35.678287 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:35.681250 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a75002-8ed4-4c24-a824-9cc5679b7e4e None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:35.716687 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13940df6-d212-4b53-b901-9b53e65f428f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:35.717231 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13940df6-d212-4b53-b901-9b53e65f428f None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:35.717536 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13940df6-d212-4b53-b901-9b53e65f428f None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:35.717807 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13940df6-d212-4b53-b901-9b53e65f428f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:35.727830 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13940df6-d212-4b53-b901-9b53e65f428f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:35.729275 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13940df6-d212-4b53-b901-9b53e65f428f None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:35.743444 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77ae3e-4f15-4f74-9a1b-4ce9ed91f266 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:35.744488 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-13940df6-d212-4b53-b901-9b53e65f428f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:35.744488 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:35.744488 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:35.744488 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:35.744488 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:35.744488 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:35.744488 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:35.744488 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:35.744488 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:35.744488 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:35.744488 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:35.744488 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:35.744488 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:35.744488 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:35.744488 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:35.745316 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:35.745316 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:35.745316 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:35.745316 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:35.745316 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:35.745316 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:35.745316 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:35.745316 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:35.745316 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:35.745316 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:35.745316 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:35.745316 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:35.745316 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:35.745316 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:35.745316 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:35.745316 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:35.745316 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:35.746189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:35.746189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:35.746189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:35.746189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:35.746189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 250/510] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:35.746444 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13940df6-d212-4b53-b901-9b53e65f428f None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:35.779721 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086658d-5d59-4259-9dfa-4a77ce3fcf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:35.780355 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086658d-5d59-4259-9dfa-4a77ce3fcf14 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:35.780634 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086658d-5d59-4259-9dfa-4a77ce3fcf14 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:35.780910 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086658d-5d59-4259-9dfa-4a77ce3fcf14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:35.791115 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086658d-5d59-4259-9dfa-4a77ce3fcf14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:35.792555 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086658d-5d59-4259-9dfa-4a77ce3fcf14 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:35.807046 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-0086658d-5d59-4259-9dfa-4a77ce3fcf14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:35.807046 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:35.807046 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:35.807046 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:35.807046 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:35.807046 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:35.807046 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:35.807046 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:35.807046 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:35.807046 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:35.807046 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:35.807046 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:35.807046 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:35.807046 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:35.807046 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:35.808107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:35.808107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:35.808107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:35.808107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:35.808107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:35.808107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:35.808107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:35.808107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:35.808107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:35.808107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:35.808107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:35.808107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:35.808107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:35.808107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:35.808107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:35.808107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:35.808107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:35.808977 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:35.808977 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:35.808977 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:35.808977 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:35.808977 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 261/511] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:35.809267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086658d-5d59-4259-9dfa-4a77ce3fcf14 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:35.844466 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13940df6-d212-4b53-b901-9b53e65f428f None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:35.877766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a553c5a-10fc-4286-b05c-90de84617593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:35.878644 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a553c5a-10fc-4286-b05c-90de84617593 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:35.878937 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a553c5a-10fc-4286-b05c-90de84617593 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:35.879211 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a553c5a-10fc-4286-b05c-90de84617593 None admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:35.880004 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a553c5a-10fc-4286-b05c-90de84617593 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:35.880311 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a553c5a-10fc-4286-b05c-90de84617593 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:35.881779 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a553c5a-10fc-4286-b05c-90de84617593 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:35.892293 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:35.898766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 251/512] 10.222.0.46 () {56 vars in 1137 bytes} [Wed Aug 3 12:38:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:35.899573 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a553c5a-10fc-4286-b05c-90de84617593 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:35.912115 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:35.912501 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086658d-5d59-4259-9dfa-4a77ce3fcf14 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:35.946127 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e84bc4-2d5f-42af-b754-ee403de7a6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:35.946747 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e84bc4-2d5f-42af-b754-ee403de7a6e6 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:35.947027 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e84bc4-2d5f-42af-b754-ee403de7a6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:35.947308 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e84bc4-2d5f-42af-b754-ee403de7a6e6 None admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:35.948130 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e84bc4-2d5f-42af-b754-ee403de7a6e6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:35.948441 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e84bc4-2d5f-42af-b754-ee403de7a6e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:35.950445 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e84bc4-2d5f-42af-b754-ee403de7a6e6 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:35.986686 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 262/513] 10.222.0.46 () {56 vars in 1137 bytes} [Wed Aug 3 12:38:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:35.987436 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e84bc4-2d5f-42af-b754-ee403de7a6e6 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:36.003543 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a553c5a-10fc-4286-b05c-90de84617593 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:36.038164 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f44e7f-50ea-4ea7-be58-1b34daf99f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:36.038801 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f44e7f-50ea-4ea7-be58-1b34daf99f6f None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:36.039089 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f44e7f-50ea-4ea7-be58-1b34daf99f6f None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:36.039366 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f44e7f-50ea-4ea7-be58-1b34daf99f6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:36.049792 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f44e7f-50ea-4ea7-be58-1b34daf99f6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:36.051271 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f44e7f-50ea-4ea7-be58-1b34daf99f6f None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:36.066334 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-37f44e7f-50ea-4ea7-be58-1b34daf99f6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:36.066334 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:36.066334 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:36.066334 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:36.066334 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:36.066334 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:36.066334 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:36.066334 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:36.066334 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:36.066334 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:36.066334 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:36.066334 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:36.066334 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:36.066334 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:36.066334 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:36.067206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:36.067206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:36.067206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:36.067206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:36.067206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:36.067206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:36.067206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:36.067206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:36.067206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:36.067206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:36.067206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:36.067206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:36.067206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:36.067206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:36.067206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:36.067206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:36.067206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:36.068054 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:36.068054 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:36.068054 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:36.068054 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:36.068054 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 252/514] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:36.068319 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f44e7f-50ea-4ea7-be58-1b34daf99f6f None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:36.091564 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e84bc4-2d5f-42af-b754-ee403de7a6e6 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:36.126468 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad28fd-463d-4780-8216-5826fb6e545d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:36.127085 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad28fd-463d-4780-8216-5826fb6e545d None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:36.127368 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad28fd-463d-4780-8216-5826fb6e545d None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:36.127645 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad28fd-463d-4780-8216-5826fb6e545d None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:36.128308 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:36.128431 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad28fd-463d-4780-8216-5826fb6e545d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:36.128638 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad28fd-463d-4780-8216-5826fb6e545d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:36.130107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad28fd-463d-4780-8216-5826fb6e545d None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:36.138553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:36.142845 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 263/515] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:36.143909 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad28fd-463d-4780-8216-5826fb6e545d None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:36.168085 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f44e7f-50ea-4ea7-be58-1b34daf99f6f None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:36.202255 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aaa856-a4f6-42c7-b2a8-0100c041267b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:36.202860 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aaa856-a4f6-42c7-b2a8-0100c041267b None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:36.203141 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aaa856-a4f6-42c7-b2a8-0100c041267b None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:36.203417 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aaa856-a4f6-42c7-b2a8-0100c041267b None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:36.204105 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aaa856-a4f6-42c7-b2a8-0100c041267b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:36.204412 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aaa856-a4f6-42c7-b2a8-0100c041267b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:36.205787 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aaa856-a4f6-42c7-b2a8-0100c041267b None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:36.217410 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 253/516] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:36.218635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aaa856-a4f6-42c7-b2a8-0100c041267b None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:36.243909 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad28fd-463d-4780-8216-5826fb6e545d None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:36.280608 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc2759-24c1-4c0a-8e13-57e1e8f2261e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:36.281231 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc2759-24c1-4c0a-8e13-57e1e8f2261e None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:36.281529 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc2759-24c1-4c0a-8e13-57e1e8f2261e None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:36.281817 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc2759-24c1-4c0a-8e13-57e1e8f2261e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:36.325427 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aaa856-a4f6-42c7-b2a8-0100c041267b None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:36.348087 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:36.348329 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:36.350973 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc2759-24c1-4c0a-8e13-57e1e8f2261e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:36.353328 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc2759-24c1-4c0a-8e13-57e1e8f2261e None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:36.361593 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec4e75-7a84-4232-866b-b9d605ee4bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:36.362210 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec4e75-7a84-4232-866b-b9d605ee4bcc None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:36.362495 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec4e75-7a84-4232-866b-b9d605ee4bcc None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:36.362775 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec4e75-7a84-4232-866b-b9d605ee4bcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:36.428607 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec4e75-7a84-4232-866b-b9d605ee4bcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:36.430090 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec4e75-7a84-4232-866b-b9d605ee4bcc None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:36.452336 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 264/517] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:38:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:38:36.453177 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc2759-24c1-4c0a-8e13-57e1e8f2261e None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:36.531325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 254/518] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:38:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:38:36.532069 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec4e75-7a84-4232-866b-b9d605ee4bcc None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:36.549675 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:36.552808 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc2759-24c1-4c0a-8e13-57e1e8f2261e None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:36.555564 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:36.586815 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae909714-f266-4e1d-88f3-bb1d4bde5b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:36.587427 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae909714-f266-4e1d-88f3-bb1d4bde5b0e None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:36.587709 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae909714-f266-4e1d-88f3-bb1d4bde5b0e None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:36.587975 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae909714-f266-4e1d-88f3-bb1d4bde5b0e None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:36.588673 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae909714-f266-4e1d-88f3-bb1d4bde5b0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:36.588977 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae909714-f266-4e1d-88f3-bb1d4bde5b0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:36.590894 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae909714-f266-4e1d-88f3-bb1d4bde5b0e None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:36.602755 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 265/519] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:36.603545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae909714-f266-4e1d-88f3-bb1d4bde5b0e None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:36.629970 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec4e75-7a84-4232-866b-b9d605ee4bcc None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:36.663564 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f57c6-d4bc-48b3-9c13-811aa2f7032f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:36.664171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f57c6-d4bc-48b3-9c13-811aa2f7032f None admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:36.664451 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f57c6-d4bc-48b3-9c13-811aa2f7032f None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:36.664726 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f57c6-d4bc-48b3-9c13-811aa2f7032f None admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:36.665402 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f57c6-d4bc-48b3-9c13-811aa2f7032f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:36.666859 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f57c6-d4bc-48b3-9c13-811aa2f7032f None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:36.688071 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 255/520] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Aug 3 12:38:36 2022] POST /identity/v3/users => generated 247 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:38:36.688877 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f57c6-d4bc-48b3-9c13-811aa2f7032f None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:36.722104 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae909714-f266-4e1d-88f3-bb1d4bde5b0e None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:36.762429 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3728c60-3bae-4ca5-8002-484873beb58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:36.763253 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3728c60-3bae-4ca5-8002-484873beb58d None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:36.763558 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3728c60-3bae-4ca5-8002-484873beb58d None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:36.763835 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3728c60-3bae-4ca5-8002-484873beb58d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:36.771399 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3728c60-3bae-4ca5-8002-484873beb58d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:36.772914 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3728c60-3bae-4ca5-8002-484873beb58d None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:36.783822 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:36.786114 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-e3728c60-3bae-4ca5-8002-484873beb58d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:38:36.786114 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:36.786114 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:36.786114 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:36.786114 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:36.786114 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:36.786114 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:36.786114 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:36.786114 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:36.786114 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:36.786114 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:36.786114 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:36.786114 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:38:36.786114 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:38:36.786114 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:38:36.787184 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:38:36.787184 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:36.787184 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:36.787184 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:36.787184 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:36.787184 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:36.787184 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:36.787184 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:36.787184 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:36.787184 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:36.787184 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:36.787184 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:36.787184 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:36.787184 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:36.787184 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:36.787184 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:36.787184 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:36.788026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:38:36.788026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:38:36.788026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:38:36.788026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:38:36.788026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:38:36.788026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:38:36.788026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:38:36.788026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:36.788026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 266/521] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:38:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:36.788504 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3728c60-3bae-4ca5-8002-484873beb58d None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:36.815381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:36.826198 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f57c6-d4bc-48b3-9c13-811aa2f7032f None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:36.871335 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3cf3c-500c-435b-8840-85ca2526ddfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:36.872414 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3cf3c-500c-435b-8840-85ca2526ddfd None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:36.872695 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3cf3c-500c-435b-8840-85ca2526ddfd None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:36.872970 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3cf3c-500c-435b-8840-85ca2526ddfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:36.885395 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3cf3c-500c-435b-8840-85ca2526ddfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:36.887043 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3cf3c-500c-435b-8840-85ca2526ddfd None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:36.904754 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-49a3cf3c-500c-435b-8840-85ca2526ddfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:36.904754 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:36.904754 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:36.904754 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:36.904754 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:36.904754 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:36.904754 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:36.904754 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:36.904754 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:36.904754 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:36.904754 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:36.904754 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:36.904754 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:36.904754 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:36.904754 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:36.905694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:36.905694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:36.905694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:36.905694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:36.905694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:36.905694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:36.905694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:36.905694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:36.905694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:36.905694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:36.905694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:36.905694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:36.905694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:36.905694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:36.905694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:36.905694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:36.905694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:36.906550 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:36.906550 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:36.906550 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:36.906550 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:36.906550 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 256/522] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:36.906803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3cf3c-500c-435b-8840-85ca2526ddfd None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:36.917012 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3728c60-3bae-4ca5-8002-484873beb58d None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:36.955424 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6a39b-8f4e-4ff5-9c48-14c1e7e47ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:36.956049 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6a39b-8f4e-4ff5-9c48-14c1e7e47ea1 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:36.956331 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6a39b-8f4e-4ff5-9c48-14c1e7e47ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:36.956635 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6a39b-8f4e-4ff5-9c48-14c1e7e47ea1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:36.969906 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6a39b-8f4e-4ff5-9c48-14c1e7e47ea1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:36.971371 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6a39b-8f4e-4ff5-9c48-14c1e7e47ea1 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:36.986618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-1be6a39b-8f4e-4ff5-9c48-14c1e7e47ea1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:36.986618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:36.986618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:36.986618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:36.986618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:36.986618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:36.986618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:36.986618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:36.986618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:36.986618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:36.986618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:36.986618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:36.986618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:36.986618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:36.986618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:36.987498 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:36.987498 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:36.987498 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:36.987498 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:36.987498 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:36.987498 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:36.987498 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:36.987498 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:36.987498 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:36.987498 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:36.987498 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:36.987498 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:36.987498 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:36.987498 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:36.987498 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:36.987498 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:36.987498 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:36.988327 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:36.988327 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:36.988327 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:36.988327 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:36.988327 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 267/523] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:36.993236 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6a39b-8f4e-4ff5-9c48-14c1e7e47ea1 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:37.017909 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3cf3c-500c-435b-8840-85ca2526ddfd None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:37.048687 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:37.055018 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77dd119-602d-4c42-aa8f-1906e55127bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:37.055729 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77dd119-602d-4c42-aa8f-1906e55127bb None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:37.055934 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77dd119-602d-4c42-aa8f-1906e55127bb None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:37.056198 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77dd119-602d-4c42-aa8f-1906e55127bb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:37.065462 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77dd119-602d-4c42-aa8f-1906e55127bb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:37.067455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77dd119-602d-4c42-aa8f-1906e55127bb None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:37.073851 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:37.082335 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-b77dd119-602d-4c42-aa8f-1906e55127bb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 03 12:38:37.082335 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:37.082335 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:37.082335 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:37.082335 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:37.082335 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:37.082335 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:37.082335 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:37.082335 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:37.082335 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:37.082335 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:37.082335 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:37.082335 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:38:37.082335 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:38:37.082335 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:38:37.082335 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:38:37.083284 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:37.083284 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:37.083284 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:38:37.083284 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:38:37.083284 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:38:37.083284 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:38:37.083284 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:37.083284 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:37.083284 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:37.083284 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:37.083284 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:37.083284 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:37.083284 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:37.083284 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:37.083284 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:37.083284 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:37.083284 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:37.083284 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:37.084163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:37.084163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:37.084163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:38:37.084163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:38:37.084163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:38:37.084163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:38:37.084163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:38:37.084163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:38:37.084163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 03 12:38:37.084163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:37.084163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 257/524] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 3 12:38:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:37.085757 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77dd119-602d-4c42-aa8f-1906e55127bb None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:37.112715 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6a39b-8f4e-4ff5-9c48-14c1e7e47ea1 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:37.149911 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cab31b-f552-42d5-bd67-9c2c554f367d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:37.150584 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cab31b-f552-42d5-bd67-9c2c554f367d None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:37.150866 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cab31b-f552-42d5-bd67-9c2c554f367d None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:37.151145 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cab31b-f552-42d5-bd67-9c2c554f367d None admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:37.151949 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cab31b-f552-42d5-bd67-9c2c554f367d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:37.152255 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cab31b-f552-42d5-bd67-9c2c554f367d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:37.153765 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cab31b-f552-42d5-bd67-9c2c554f367d None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:37.177104 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 268/525] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 3 12:38:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:37.177104 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cab31b-f552-42d5-bd67-9c2c554f367d None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:37.203441 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77dd119-602d-4c42-aa8f-1906e55127bb None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:37.239514 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62625b26-9727-4091-ba8d-4f8d424b26d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:37.240434 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62625b26-9727-4091-ba8d-4f8d424b26d3 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:37.240716 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62625b26-9727-4091-ba8d-4f8d424b26d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:37.241152 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62625b26-9727-4091-ba8d-4f8d424b26d3 None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:37.241778 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62625b26-9727-4091-ba8d-4f8d424b26d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:37.242084 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62625b26-9727-4091-ba8d-4f8d424b26d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:37.243446 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62625b26-9727-4091-ba8d-4f8d424b26d3 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:37.256900 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 258/526] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:37.257738 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62625b26-9727-4091-ba8d-4f8d424b26d3 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:37.288593 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cab31b-f552-42d5-bd67-9c2c554f367d None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:37.314482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:37.321547 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:37.328885 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5535ce-968c-498e-8f9f-d6c7f3b2002e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:37.329938 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5535ce-968c-498e-8f9f-d6c7f3b2002e None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:37.330497 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5535ce-968c-498e-8f9f-d6c7f3b2002e None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:37.330780 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5535ce-968c-498e-8f9f-d6c7f3b2002e None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:37.331489 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5535ce-968c-498e-8f9f-d6c7f3b2002e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:37.331796 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5535ce-968c-498e-8f9f-d6c7f3b2002e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:37.333466 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5535ce-968c-498e-8f9f-d6c7f3b2002e None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:37.348694 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 269/527] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:37.349455 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5535ce-968c-498e-8f9f-d6c7f3b2002e None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:37.373812 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62625b26-9727-4091-ba8d-4f8d424b26d3 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:37.409965 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59456db4-545f-4a8e-b00f-51e10e66f2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:37.410846 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59456db4-545f-4a8e-b00f-51e10e66f2ec None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:37.411132 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59456db4-545f-4a8e-b00f-51e10e66f2ec None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:37.411405 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59456db4-545f-4a8e-b00f-51e10e66f2ec None admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:37.412205 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59456db4-545f-4a8e-b00f-51e10e66f2ec None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:37.412513 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59456db4-545f-4a8e-b00f-51e10e66f2ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:37.413962 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59456db4-545f-4a8e-b00f-51e10e66f2ec None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:37.434027 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 259/528] 10.222.0.46 () {56 vars in 1139 bytes} [Wed Aug 3 12:38:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:37.436235 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59456db4-545f-4a8e-b00f-51e10e66f2ec None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:37.461336 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5535ce-968c-498e-8f9f-d6c7f3b2002e None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:37.498092 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734495bb-ea77-4cde-b835-9e573baab650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:37.498704 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734495bb-ea77-4cde-b835-9e573baab650 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:37.498991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734495bb-ea77-4cde-b835-9e573baab650 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:37.499271 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734495bb-ea77-4cde-b835-9e573baab650 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:37.500081 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734495bb-ea77-4cde-b835-9e573baab650 None admin] RBAC: Adding query filter params (role.id=39d74def259b415ca634ad9c715e1332, scope.project.id=6ac833dfff634496816842c851545d21, user.id=dcf670ff4f62486dbf70cf6ea0f08bbb) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:37.500395 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734495bb-ea77-4cde-b835-9e573baab650 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:37.501869 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734495bb-ea77-4cde-b835-9e573baab650 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:37.507465 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 270/529] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:38:37 2022] GET /identity/v3/role_assignments?user.id=dcf670ff4f62486dbf70cf6ea0f08bbb&scope.project.id=6ac833dfff634496816842c851545d21&role.id=39d74def259b415ca634ad9c715e1332 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:37.508233 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734495bb-ea77-4cde-b835-9e573baab650 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:37.575422 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:37.578419 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59456db4-545f-4a8e-b00f-51e10e66f2ec None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:37.594911 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:37.634168 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67aa01-2f1e-486d-a3c1-66f2655b67e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:37.635216 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67aa01-2f1e-486d-a3c1-66f2655b67e9 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:37.635699 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67aa01-2f1e-486d-a3c1-66f2655b67e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:37.635804 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734495bb-ea77-4cde-b835-9e573baab650 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:37.636292 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67aa01-2f1e-486d-a3c1-66f2655b67e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:37.647163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67aa01-2f1e-486d-a3c1-66f2655b67e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:37.649731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67aa01-2f1e-486d-a3c1-66f2655b67e9 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:37.669049 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-4c67aa01-2f1e-486d-a3c1-66f2655b67e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:38:37.669049 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:37.669049 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:37.669049 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:37.669049 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:37.669049 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:37.669049 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:37.669049 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:37.669049 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:37.669049 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:37.669049 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:37.669049 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:37.669049 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:38:37.669049 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:38:37.669049 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:38:37.670128 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:38:37.670128 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:37.670128 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:37.670128 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:37.670128 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:37.670128 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:37.670128 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:37.670128 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:37.670128 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:37.670128 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:37.670128 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:37.670128 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:37.670128 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:37.670128 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:37.670128 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:37.670128 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:37.670128 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:37.670949 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:38:37.670949 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:38:37.670949 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:38:37.670949 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:38:37.670949 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:38:37.670949 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:38:37.670949 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:38:37.670949 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:37.671351 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 260/530] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:38:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:37.672874 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67aa01-2f1e-486d-a3c1-66f2655b67e9 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:37.679916 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cbd330-23a8-4fd7-b5bd-bf3b967ffbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:37.680570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbd330-23a8-4fd7-b5bd-bf3b967ffbb3 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:37.680855 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbd330-23a8-4fd7-b5bd-bf3b967ffbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:37.681133 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbd330-23a8-4fd7-b5bd-bf3b967ffbb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:37.692998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cbd330-23a8-4fd7-b5bd-bf3b967ffbb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:37.694962 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cbd330-23a8-4fd7-b5bd-bf3b967ffbb3 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:37.710206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-b1cbd330-23a8-4fd7-b5bd-bf3b967ffbb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:38:37.710206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:37.710206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:37.710206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:37.710206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:37.710206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:37.710206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:37.710206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:37.710206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:37.710206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:37.710206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:37.710206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:37.710206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:38:37.710206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:38:37.710206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:38:37.711066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:38:37.711066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:37.711066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:37.711066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:37.711066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:37.711066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:37.711066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:37.711066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:37.711066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:37.711066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:37.711066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:37.711066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:37.711066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:37.711066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:37.711066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:37.711066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:37.711066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:37.711912 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:38:37.711912 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:38:37.711912 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:38:37.711912 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:38:37.711912 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:38:37.711912 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:38:37.711912 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:38:37.711912 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:37.719164 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 271/531] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:38:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:37.720067 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cbd330-23a8-4fd7-b5bd-bf3b967ffbb3 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:37.799160 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67aa01-2f1e-486d-a3c1-66f2655b67e9 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:37.836040 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ad936-99f0-4176-bb2d-e7028d41bfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:37.836679 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ad936-99f0-4176-bb2d-e7028d41bfdf None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:37.837141 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ad936-99f0-4176-bb2d-e7028d41bfdf None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:37.837421 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ad936-99f0-4176-bb2d-e7028d41bfdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:37.850148 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cbd330-23a8-4fd7-b5bd-bf3b967ffbb3 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:37.870093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:37.883502 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:37.893048 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41317ba-1095-4af8-92d4-ce23d9abcb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:37.893897 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41317ba-1095-4af8-92d4-ce23d9abcb95 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:37.894420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41317ba-1095-4af8-92d4-ce23d9abcb95 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:37.894840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41317ba-1095-4af8-92d4-ce23d9abcb95 None admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:37.895809 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41317ba-1095-4af8-92d4-ce23d9abcb95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:37.896299 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41317ba-1095-4af8-92d4-ce23d9abcb95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:37.898209 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41317ba-1095-4af8-92d4-ce23d9abcb95 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:37.917901 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 272/532] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 3 12:38:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:37.919644 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41317ba-1095-4af8-92d4-ce23d9abcb95 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:37.924086 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ad936-99f0-4176-bb2d-e7028d41bfdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:37.926315 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ad936-99f0-4176-bb2d-e7028d41bfdf None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:38.051543 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41317ba-1095-4af8-92d4-ce23d9abcb95 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:38.057647 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 261/533] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:38:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:38:38.058522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ad936-99f0-4176-bb2d-e7028d41bfdf None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:38.100528 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f6e9c-4f2b-4b61-bb02-6371847d2231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:38.101116 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f6e9c-4f2b-4b61-bb02-6371847d2231 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:38.101402 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f6e9c-4f2b-4b61-bb02-6371847d2231 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:38.101855 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f6e9c-4f2b-4b61-bb02-6371847d2231 None admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:38.103373 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f6e9c-4f2b-4b61-bb02-6371847d2231 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:38.103691 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f6e9c-4f2b-4b61-bb02-6371847d2231 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:38.105130 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f6e9c-4f2b-4b61-bb02-6371847d2231 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:38.120524 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 273/534] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 3 12:38:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:38.121339 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f6e9c-4f2b-4b61-bb02-6371847d2231 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:38.146735 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:38.165326 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:38.195523 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ad936-99f0-4176-bb2d-e7028d41bfdf None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:38.239964 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164325e6-7f3d-4088-b2fb-ed2a850f0d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:38.241085 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164325e6-7f3d-4088-b2fb-ed2a850f0d02 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:38.241562 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164325e6-7f3d-4088-b2fb-ed2a850f0d02 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:38.242221 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164325e6-7f3d-4088-b2fb-ed2a850f0d02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:38.243835 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164325e6-7f3d-4088-b2fb-ed2a850f0d02 None admin] RBAC: Adding query filter params (role.id=39d74def259b415ca634ad9c715e1332, scope.project.id=6ac833dfff634496816842c851545d21, user.id=603adceaefb94e218cc1e683529a60b5) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:38.244295 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164325e6-7f3d-4088-b2fb-ed2a850f0d02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:38.247581 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164325e6-7f3d-4088-b2fb-ed2a850f0d02 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:38.251633 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f6e9c-4f2b-4b61-bb02-6371847d2231 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:38.258454 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 262/535] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:38:38 2022] GET /identity/v3/role_assignments?user.id=603adceaefb94e218cc1e683529a60b5&scope.project.id=6ac833dfff634496816842c851545d21&role.id=39d74def259b415ca634ad9c715e1332 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:38.258454 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164325e6-7f3d-4088-b2fb-ed2a850f0d02 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:38.309093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a054233-ed5b-43d5-8a14-a0a38355d702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:38.310131 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a054233-ed5b-43d5-8a14-a0a38355d702 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:38.310607 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a054233-ed5b-43d5-8a14-a0a38355d702 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:38.311096 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a054233-ed5b-43d5-8a14-a0a38355d702 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:38.337984 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a054233-ed5b-43d5-8a14-a0a38355d702 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:38.342036 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a054233-ed5b-43d5-8a14-a0a38355d702 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:38.369198 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-3a054233-ed5b-43d5-8a14-a0a38355d702 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:38.369198 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:38.369198 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:38.369198 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:38.369198 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:38.369198 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:38.369198 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:38.369198 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:38.369198 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:38.369198 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:38.369198 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:38.369198 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:38.369198 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:38.369198 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:38.369198 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:38.370104 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:38.370104 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:38.370104 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:38.370104 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:38.370104 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:38.370104 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:38.370104 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:38.370104 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:38.370104 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:38.370104 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:38.370104 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:38.370104 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:38.370104 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:38.370104 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:38.370104 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:38.370104 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:38.370104 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:38.370924 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:38.370924 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:38.370924 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:38.370924 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:38.377887 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 274/536] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:38.379682 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a054233-ed5b-43d5-8a14-a0a38355d702 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:38.469657 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164325e6-7f3d-4088-b2fb-ed2a850f0d02 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:38.502862 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:38.505100 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:38.511434 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d94632-8ade-4764-86fa-b5f0ed4804bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:38.512665 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d94632-8ade-4764-86fa-b5f0ed4804bc None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:38.512956 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d94632-8ade-4764-86fa-b5f0ed4804bc None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:38.513231 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d94632-8ade-4764-86fa-b5f0ed4804bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:38.514344 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d94632-8ade-4764-86fa-b5f0ed4804bc None admin] RBAC: Adding query filter params (role.id=39d74def259b415ca634ad9c715e1332, scope.project.id=6ac833dfff634496816842c851545d21, user.id=a2f23f4936684b63afc095986e43ec37) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:38.514660 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d94632-8ade-4764-86fa-b5f0ed4804bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:38.516104 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d94632-8ade-4764-86fa-b5f0ed4804bc None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:38.520244 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a054233-ed5b-43d5-8a14-a0a38355d702 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:38.522376 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 263/537] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:38:38 2022] GET /identity/v3/role_assignments?user.id=a2f23f4936684b63afc095986e43ec37&scope.project.id=6ac833dfff634496816842c851545d21&role.id=39d74def259b415ca634ad9c715e1332 => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:38.560424 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35def557-d2ad-4866-8b16-362866d08c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:38.561318 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35def557-d2ad-4866-8b16-362866d08c84 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:38.561772 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35def557-d2ad-4866-8b16-362866d08c84 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:38.562188 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35def557-d2ad-4866-8b16-362866d08c84 None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:38.563035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35def557-d2ad-4866-8b16-362866d08c84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:38.563501 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35def557-d2ad-4866-8b16-362866d08c84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:38.565044 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35def557-d2ad-4866-8b16-362866d08c84 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:38.579975 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 275/538] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:38.586910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d94632-8ade-4764-86fa-b5f0ed4804bc None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:38.733657 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d94632-8ade-4764-86fa-b5f0ed4804bc None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:38.777117 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19977266-a598-488d-9afd-5cf7e3ff04db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:38.777829 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19977266-a598-488d-9afd-5cf7e3ff04db None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:38.778118 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19977266-a598-488d-9afd-5cf7e3ff04db None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:38.778396 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19977266-a598-488d-9afd-5cf7e3ff04db None admin] PATH_INFO: `/v3/projects/service` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:38.785985 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19977266-a598-488d-9afd-5cf7e3ff04db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:38.787450 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19977266-a598-488d-9afd-5cf7e3ff04db None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:38.806226 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-19977266-a598-488d-9afd-5cf7e3ff04db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:38:38.806226 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:38.806226 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:38.806226 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:38.806226 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:38.806226 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:38.806226 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:38.806226 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:38.806226 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:38.806226 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:38.806226 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:38.806226 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:38.806226 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:38:38.806226 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:38:38.806226 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:38:38.807106 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:38:38.807106 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:38.807106 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:38.807106 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:38.807106 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:38.807106 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:38.807106 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:38.807106 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:38.807106 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:38.807106 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:38.807106 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:38.807106 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:38.807106 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:38.807106 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:38.807106 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:38.807106 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:38.807106 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:38.807935 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:38:38.807935 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:38:38.807935 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:38:38.807935 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:38:38.807935 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:38:38.807935 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:38:38.807935 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:38:38.807935 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:38.807935 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 264/539] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:38:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:38.816015 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35def557-d2ad-4866-8b16-362866d08c84 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:38.906475 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6260e6-2a51-4a2c-9304-ad7433801f30 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:38.906798 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6260e6-2a51-4a2c-9304-ad7433801f30 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:38.907044 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6260e6-2a51-4a2c-9304-ad7433801f30 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:38.908540 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 265/540] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:38:38.920826 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eea6d6-309b-4270-97a9-a01982055f44 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:38.921101 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eea6d6-309b-4270-97a9-a01982055f44 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:38.921362 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eea6d6-309b-4270-97a9-a01982055f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:38.956238 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35def557-d2ad-4866-8b16-362866d08c84 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:38.958624 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-90eea6d6-309b-4270-97a9-a01982055f44 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:38.959814 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-90eea6d6-309b-4270-97a9-a01982055f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:39.024062 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a089d7d-595b-40f7-9092-679b191cb58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:39.024685 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a089d7d-595b-40f7-9092-679b191cb58e None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:39.025321 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a089d7d-595b-40f7-9092-679b191cb58e None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:39.025630 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a089d7d-595b-40f7-9092-679b191cb58e None admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:39.026709 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a089d7d-595b-40f7-9092-679b191cb58e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:39.027021 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a089d7d-595b-40f7-9092-679b191cb58e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:39.029291 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a089d7d-595b-40f7-9092-679b191cb58e None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:39.039208 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:39.051090 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 276/541] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 3 12:38:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:39.057712 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a089d7d-595b-40f7-9092-679b191cb58e None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:39.073871 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:39.078400 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 266/542] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:39.117503 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eea6d6-309b-4270-97a9-a01982055f44 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:39.193783 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a089d7d-595b-40f7-9092-679b191cb58e None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:39.265425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0997bf-9608-47c6-8372-93990567d134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:39.266226 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0997bf-9608-47c6-8372-93990567d134 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:39.266631 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0997bf-9608-47c6-8372-93990567d134 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:39.267006 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0997bf-9608-47c6-8372-93990567d134 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:39.268080 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0997bf-9608-47c6-8372-93990567d134 None admin] RBAC: Adding query filter params (role.id=39d74def259b415ca634ad9c715e1332, scope.project.id=6ac833dfff634496816842c851545d21, user.id=e0cd747cb5f64ff7b5f8d67d3d640fc5) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:39.268493 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0997bf-9608-47c6-8372-93990567d134 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:39.270195 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0997bf-9608-47c6-8372-93990567d134 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:39.276717 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 277/543] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:38:39 2022] GET /identity/v3/role_assignments?user.id=e0cd747cb5f64ff7b5f8d67d3d640fc5&scope.project.id=6ac833dfff634496816842c851545d21&role.id=39d74def259b415ca634ad9c715e1332 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:39.345983 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eea6d6-309b-4270-97a9-a01982055f44 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:39.414184 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eadbb4-0d5d-45cc-857b-af1784f6654b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:39.414856 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eadbb4-0d5d-45cc-857b-af1784f6654b None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:39.415142 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eadbb4-0d5d-45cc-857b-af1784f6654b None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:39.415421 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eadbb4-0d5d-45cc-857b-af1784f6654b None admin] PATH_INFO: `/v3/roles/service` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:39.433467 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eadbb4-0d5d-45cc-857b-af1784f6654b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:39.439148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-f5eadbb4-0d5d-45cc-857b-af1784f6654b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:38:39.439148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:39.439148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:39.439148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:39.439148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:39.439148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:39.439148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:39.439148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:39.439148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:39.439148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:39.439148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:39.439148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:39.439148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:39.439148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:39.439148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:39.439148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:39.440131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:39.440131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:39.440131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:39.440131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:39.440131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:39.440131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:39.440131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:39.440131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:39.440131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:39.440131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:39.440131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:39.440131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:39.440131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:39.440131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:39.440131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:39.440131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:39.440915 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:39.440915 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:39.440915 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:39.440915 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:39.440915 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:39.440915 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:39.440915 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:39.440915 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:39.440915 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:39.440915 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:39.440915 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:38:39.440915 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:39.445421 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 267/544] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 3 12:38:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:39.446719 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0997bf-9608-47c6-8372-93990567d134 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:39.548323 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:39.582113 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0997bf-9608-47c6-8372-93990567d134 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:39.637224 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422cd6d-e9fd-4c98-bf48-ade16380c37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:39.638390 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422cd6d-e9fd-4c98-bf48-ade16380c37b None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:39.638681 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422cd6d-e9fd-4c98-bf48-ade16380c37b None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:39.638997 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422cd6d-e9fd-4c98-bf48-ade16380c37b None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:39.639693 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5422cd6d-e9fd-4c98-bf48-ade16380c37b None admin] RBAC: Adding query filter params (name=service) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:39.639997 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5422cd6d-e9fd-4c98-bf48-ade16380c37b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:39.641462 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5422cd6d-e9fd-4c98-bf48-ade16380c37b None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:39.654230 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 278/545] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 3 12:38:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:39.660188 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eadbb4-0d5d-45cc-857b-af1784f6654b None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:39.749912 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:39.834211 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eadbb4-0d5d-45cc-857b-af1784f6654b None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:39.883321 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e4d72-52c6-4c47-a80b-442aea9bf68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:39.883986 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e4d72-52c6-4c47-a80b-442aea9bf68c None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:39.884296 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e4d72-52c6-4c47-a80b-442aea9bf68c None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:39.884765 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e4d72-52c6-4c47-a80b-442aea9bf68c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:39.901178 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e4d72-52c6-4c47-a80b-442aea9bf68c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:39.903421 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e4d72-52c6-4c47-a80b-442aea9bf68c None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:39.932042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-6f3e4d72-52c6-4c47-a80b-442aea9bf68c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:39.932042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:39.932042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:39.932042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:39.932042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:39.932042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:39.932042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:39.932042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:39.932042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:39.932042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:39.932042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:39.932042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:39.932042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:39.932042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:39.932042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:39.932962 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:39.932962 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:39.932962 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:39.932962 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:39.932962 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:39.932962 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:39.932962 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:39.932962 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:39.932962 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:39.932962 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:39.932962 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:39.932962 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:39.932962 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:39.932962 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:39.932962 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:39.932962 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:39.932962 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:39.933819 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:39.933819 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:39.933819 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:39.933819 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:39.937039 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 268/546] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:39.940113 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422cd6d-e9fd-4c98-bf48-ade16380c37b None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:40.034349 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197c449-018a-450d-bdc2-239ae8f09a81 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:40.035589 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197c449-018a-450d-bdc2-239ae8f09a81 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:40.035872 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197c449-018a-450d-bdc2-239ae8f09a81 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:40.038786 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 269/547] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:38:40.048003 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b987d6-b258-4c4e-b68b-d24419a98827 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:40.051004 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b987d6-b258-4c4e-b68b-d24419a98827 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:40.051004 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b987d6-b258-4c4e-b68b-d24419a98827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:40.082930 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-c3b987d6-b258-4c4e-b68b-d24419a98827 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:40.084570 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-c3b987d6-b258-4c4e-b68b-d24419a98827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:40.141430 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422cd6d-e9fd-4c98-bf48-ade16380c37b None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:40.219293 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e33292-747e-451a-8c56-5bb2c6c97c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:40.220470 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e33292-747e-451a-8c56-5bb2c6c97c82 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:40.220974 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e33292-747e-451a-8c56-5bb2c6c97c82 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:40.221472 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e33292-747e-451a-8c56-5bb2c6c97c82 None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:40.226245 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 270/548] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:38:40.226752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e33292-747e-451a-8c56-5bb2c6c97c82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:40.227267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e33292-747e-451a-8c56-5bb2c6c97c82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:40.228889 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e33292-747e-451a-8c56-5bb2c6c97c82 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:40.234928 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:40.248762 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 279/549] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:40.259182 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b987d6-b258-4c4e-b68b-d24419a98827 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:40.274177 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e33292-747e-451a-8c56-5bb2c6c97c82 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:40.311544 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:40.414601 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e33292-747e-451a-8c56-5bb2c6c97c82 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:40.470898 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef531a5-c7f5-4e97-8b23-886d2bf4083a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:40.471914 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef531a5-c7f5-4e97-8b23-886d2bf4083a None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:40.472404 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef531a5-c7f5-4e97-8b23-886d2bf4083a None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:40.472906 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef531a5-c7f5-4e97-8b23-886d2bf4083a None admin] PATH_INFO: `/v3/roles/service` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:40.500449 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef531a5-c7f5-4e97-8b23-886d2bf4083a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:40.512456 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b987d6-b258-4c4e-b68b-d24419a98827 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:40.513420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-6ef531a5-c7f5-4e97-8b23-886d2bf4083a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:38:40.513420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:40.513420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:40.513420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:40.513420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:40.513420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:40.513420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:40.513420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:40.513420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:40.513420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:40.513420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:40.513420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:40.513420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:40.513420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:40.513420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:40.513420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:40.514860 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:40.514860 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:40.514860 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:40.514860 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:40.514860 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:40.514860 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:40.514860 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:40.514860 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:40.514860 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:40.514860 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:40.514860 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:40.514860 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:40.514860 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:40.514860 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:40.514860 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:40.514860 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:40.516035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:40.516035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:40.516035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:40.516035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:40.516035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:40.516035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:40.516035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:40.516035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:40.516035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:40.516035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:40.516035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:38:40.516035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:40.518886 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 280/550] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 3 12:38:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:40.527612 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef531a5-c7f5-4e97-8b23-886d2bf4083a None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:40.614269 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2305eed-b57d-4f4f-826e-be5d1b57124c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:40.615422 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2305eed-b57d-4f4f-826e-be5d1b57124c None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:40.615534 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2305eed-b57d-4f4f-826e-be5d1b57124c None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:40.615719 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2305eed-b57d-4f4f-826e-be5d1b57124c None admin] PATH_INFO: `/v3/users/swift` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:40.631696 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:40.638036 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2305eed-b57d-4f4f-826e-be5d1b57124c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:40.642184 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2305eed-b57d-4f4f-826e-be5d1b57124c None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:40.676632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-d2305eed-b57d-4f4f-826e-be5d1b57124c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 03 12:38:40.676632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:40.676632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:40.676632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:40.676632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:40.676632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:40.676632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:40.676632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:40.676632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:40.676632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:40.676632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:40.676632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:40.676632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:38:40.676632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:38:40.676632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:38:40.676632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:38:40.678002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:40.678002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:40.678002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:38:40.678002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:38:40.678002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:38:40.678002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:38:40.678002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:40.678002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:40.678002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:40.678002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:40.678002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:40.678002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:40.678002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:40.678002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:40.678002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:40.678002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:40.678002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:40.678002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:40.678906 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:40.678906 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:40.678906 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:38:40.678906 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:38:40.678906 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:38:40.678906 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:38:40.678906 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:38:40.678906 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:38:40.678906 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 03 12:38:40.678906 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:40.685764 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 271/551] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 3 12:38:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:40.688181 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2305eed-b57d-4f4f-826e-be5d1b57124c None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:40.689058 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef531a5-c7f5-4e97-8b23-886d2bf4083a None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:40.744003 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a611b-5453-4e1c-8c8c-b15863f738ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:40.744996 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a611b-5453-4e1c-8c8c-b15863f738ea None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:40.745484 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a611b-5453-4e1c-8c8c-b15863f738ea None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:40.745988 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a611b-5453-4e1c-8c8c-b15863f738ea None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:40.747876 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a611b-5453-4e1c-8c8c-b15863f738ea None admin] RBAC: Adding query filter params (name=service) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:40.748498 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a611b-5453-4e1c-8c8c-b15863f738ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:40.750200 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a611b-5453-4e1c-8c8c-b15863f738ea None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:40.772458 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 281/552] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 3 12:38:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:40.782166 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a611b-5453-4e1c-8c8c-b15863f738ea None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:40.824921 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:40.852682 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2305eed-b57d-4f4f-826e-be5d1b57124c None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:40.920348 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd0a5a-821d-473b-bf62-680e2f805482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:40.923071 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd0a5a-821d-473b-bf62-680e2f805482 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:40.926013 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd0a5a-821d-473b-bf62-680e2f805482 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:40.926538 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd0a5a-821d-473b-bf62-680e2f805482 None admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:40.927648 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd0a5a-821d-473b-bf62-680e2f805482 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:40.928173 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd0a5a-821d-473b-bf62-680e2f805482 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:40.929836 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd0a5a-821d-473b-bf62-680e2f805482 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:40.966308 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 272/553] 10.222.0.46 () {56 vars in 1135 bytes} [Wed Aug 3 12:38:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:40.968181 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a611b-5453-4e1c-8c8c-b15863f738ea None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:40.971966 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd0a5a-821d-473b-bf62-680e2f805482 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:40.988071 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:41.011864 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e7e20-45c3-485d-b35d-c431eee1d846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:41.013718 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e7e20-45c3-485d-b35d-c431eee1d846 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:41.014382 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e7e20-45c3-485d-b35d-c431eee1d846 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:41.015947 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e7e20-45c3-485d-b35d-c431eee1d846 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:41.036998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e7e20-45c3-485d-b35d-c431eee1d846 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:41.039003 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e7e20-45c3-485d-b35d-c431eee1d846 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:41.066925 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-9e5e7e20-45c3-485d-b35d-c431eee1d846 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:41.066925 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:41.066925 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:41.066925 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:41.066925 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:41.066925 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:41.066925 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:41.066925 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:41.066925 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:41.066925 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:41.066925 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:41.066925 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:41.066925 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:41.066925 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:41.066925 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:41.067939 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:41.067939 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:41.067939 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:41.067939 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:41.067939 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:41.067939 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:41.067939 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:41.067939 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:41.067939 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:41.067939 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:41.067939 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:41.067939 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:41.067939 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:41.067939 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:41.067939 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:41.067939 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:41.067939 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:41.068790 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:41.068790 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:41.068790 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:41.068790 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:41.074562 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 282/554] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:41.084572 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e7e20-45c3-485d-b35d-c431eee1d846 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:41.136618 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd0a5a-821d-473b-bf62-680e2f805482 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:41.173371 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a69b23-12ef-4c0f-93d7-e8370f67d7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:41.174027 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a69b23-12ef-4c0f-93d7-e8370f67d7dc None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:41.174309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a69b23-12ef-4c0f-93d7-e8370f67d7dc None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:41.174586 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a69b23-12ef-4c0f-93d7-e8370f67d7dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:41.194752 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:41.209673 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e7e20-45c3-485d-b35d-c431eee1d846 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:41.249020 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf80bf4-2f8f-4c97-84d3-16f2b66c081c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:41.249817 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf80bf4-2f8f-4c97-84d3-16f2b66c081c None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:41.250101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf80bf4-2f8f-4c97-84d3-16f2b66c081c None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:41.250656 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf80bf4-2f8f-4c97-84d3-16f2b66c081c None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:41.251503 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf80bf4-2f8f-4c97-84d3-16f2b66c081c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:41.251807 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf80bf4-2f8f-4c97-84d3-16f2b66c081c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:41.253158 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf80bf4-2f8f-4c97-84d3-16f2b66c081c None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:41.256732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a69b23-12ef-4c0f-93d7-e8370f67d7dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:41.258209 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a69b23-12ef-4c0f-93d7-e8370f67d7dc None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:41.275001 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 283/555] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:41.275001 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79daf955-3c43-4c58-9d9c-d74f2767017b None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:41.275001 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79daf955-3c43-4c58-9d9c-d74f2767017b None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:41.275001 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79daf955-3c43-4c58-9d9c-d74f2767017b None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:41.276022 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 284/556] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:41.278747 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aea8c7-ce7a-4aaf-973c-ffb9b702cb9b None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:41.278747 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aea8c7-ce7a-4aaf-973c-ffb9b702cb9b None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:41.278747 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aea8c7-ce7a-4aaf-973c-ffb9b702cb9b None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:41.283915 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 285/557] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:41.284578 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aea8c7-ce7a-4aaf-973c-ffb9b702cb9b None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:41.318936 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:41.371357 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 273/558] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:38:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 03 12:38:41.373283 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efeae0e-ad18-4b7f-a148-31357705a010 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:41.373666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efeae0e-ad18-4b7f-a148-31357705a010 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:41.374021 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efeae0e-ad18-4b7f-a148-31357705a010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:41.392381 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-7efeae0e-ad18-4b7f-a148-31357705a010 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:41.393619 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-7efeae0e-ad18-4b7f-a148-31357705a010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:41.402756 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aea8c7-ce7a-4aaf-973c-ffb9b702cb9b None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:41.438375 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:41.439345 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c731c-5427-4e04-b221-e90a0bd44583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:41.439996 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c731c-5427-4e04-b221-e90a0bd44583 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:41.440283 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c731c-5427-4e04-b221-e90a0bd44583 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:41.440558 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c731c-5427-4e04-b221-e90a0bd44583 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:41.448444 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c731c-5427-4e04-b221-e90a0bd44583 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:41.449897 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c731c-5427-4e04-b221-e90a0bd44583 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:41.462072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-ec1c731c-5427-4e04-b221-e90a0bd44583 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:38:41.462072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:41.462072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:41.462072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:41.462072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:41.462072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:41.462072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:41.462072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:41.462072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:41.462072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:41.462072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:41.462072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:41.462072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:38:41.462072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:38:41.462072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:38:41.462072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:38:41.462994 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:41.462994 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:41.462994 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:38:41.462994 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:38:41.462994 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:38:41.462994 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:38:41.462994 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:41.462994 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:41.462994 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:41.462994 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:41.462994 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:41.462994 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:41.462994 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:41.462994 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:41.462994 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:41.462994 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:41.462994 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:41.462994 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:41.463900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:41.463900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:41.463900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:38:41.463900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:38:41.463900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:38:41.463900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:38:41.463900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:38:41.463900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:38:41.463900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:38:41.463900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:41.463900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 286/559] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Aug 3 12:38:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:41.464482 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af576b8-ffde-4169-b595-72b59b20c426 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:41.465107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af576b8-ffde-4169-b595-72b59b20c426 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:41.465107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af576b8-ffde-4169-b595-72b59b20c426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:41.473740 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 274/560] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:41.473740 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efeae0e-ad18-4b7f-a148-31357705a010 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:41.488172 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-0af576b8-ffde-4169-b595-72b59b20c426 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:41.489951 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-0af576b8-ffde-4169-b595-72b59b20c426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:41.573521 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 287/561] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:41.573521 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af576b8-ffde-4169-b595-72b59b20c426 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:41.581935 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:41.595445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efeae0e-ad18-4b7f-a148-31357705a010 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:41.631596 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5bd81-f4af-431f-8fea-9cab6ea946a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:41.632240 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5bd81-f4af-431f-8fea-9cab6ea946a0 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:41.632519 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5bd81-f4af-431f-8fea-9cab6ea946a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:41.632859 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5bd81-f4af-431f-8fea-9cab6ea946a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:41.643874 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5bd81-f4af-431f-8fea-9cab6ea946a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:41.645329 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5bd81-f4af-431f-8fea-9cab6ea946a0 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:41.661625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-ffe5bd81-f4af-431f-8fea-9cab6ea946a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:41.661625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:41.661625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:41.661625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:41.661625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:41.661625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:41.661625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:41.661625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:41.661625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:41.661625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:41.661625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:41.661625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:41.661625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:41.661625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:41.661625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:41.662554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:41.662554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:41.662554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:41.662554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:41.662554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:41.662554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:41.662554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:41.662554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:41.662554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:41.662554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:41.662554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:41.662554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:41.662554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:41.662554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:41.662554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:41.662554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:41.662554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:41.668286 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:41.668286 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:41.668286 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:41.668286 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:41.668286 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 275/562] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:41.668286 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5bd81-f4af-431f-8fea-9cab6ea946a0 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:41.683366 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af576b8-ffde-4169-b595-72b59b20c426 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:41.695472 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:41.721402 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ca4d0-d786-4914-b0c0-8c10c55325db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:41.722263 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ca4d0-d786-4914-b0c0-8c10c55325db None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:41.722542 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ca4d0-d786-4914-b0c0-8c10c55325db None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:41.722808 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ca4d0-d786-4914-b0c0-8c10c55325db None admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:41.723602 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ca4d0-d786-4914-b0c0-8c10c55325db None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:41.723903 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ca4d0-d786-4914-b0c0-8c10c55325db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:41.725329 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ca4d0-d786-4914-b0c0-8c10c55325db None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:41.749073 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 288/563] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Aug 3 12:38:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:41.749073 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ca4d0-d786-4914-b0c0-8c10c55325db None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:41.779627 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5bd81-f4af-431f-8fea-9cab6ea946a0 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:41.814272 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16891d5c-d9bf-4bfc-b3f6-e4d921df7020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:41.814900 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16891d5c-d9bf-4bfc-b3f6-e4d921df7020 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:41.815177 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16891d5c-d9bf-4bfc-b3f6-e4d921df7020 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:41.815445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16891d5c-d9bf-4bfc-b3f6-e4d921df7020 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:41.825291 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16891d5c-d9bf-4bfc-b3f6-e4d921df7020 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:41.826763 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:41.830944 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-16891d5c-d9bf-4bfc-b3f6-e4d921df7020 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:38:41.830944 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:41.830944 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:41.830944 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:41.830944 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:41.830944 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:41.830944 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:41.830944 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:41.830944 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:41.830944 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:41.830944 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:41.830944 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:41.830944 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:41.830944 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:41.830944 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:41.830944 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:41.831913 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:41.831913 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:41.831913 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:41.831913 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:41.831913 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:41.831913 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:41.831913 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:41.831913 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:41.831913 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:41.831913 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:41.831913 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:41.831913 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:41.831913 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:41.831913 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:41.831913 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:41.831913 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:41.832768 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:41.832768 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:41.832768 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:41.832768 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:41.832768 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:41.832768 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:41.832768 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:41.832768 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:41.832768 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:41.832768 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:41.832768 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:38:41.832768 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:41.832768 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 276/564] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 3 12:38:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:41.833439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16891d5c-d9bf-4bfc-b3f6-e4d921df7020 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:41.855801 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ca4d0-d786-4914-b0c0-8c10c55325db None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:41.889763 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817bf53-5bb3-4406-b212-6e101f0fd0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:41.890414 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817bf53-5bb3-4406-b212-6e101f0fd0bc None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:41.890697 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817bf53-5bb3-4406-b212-6e101f0fd0bc None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:41.890971 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817bf53-5bb3-4406-b212-6e101f0fd0bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:41.900974 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817bf53-5bb3-4406-b212-6e101f0fd0bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:41.906426 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-c817bf53-5bb3-4406-b212-6e101f0fd0bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:38:41.906426 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:41.906426 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:41.906426 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:41.906426 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:41.906426 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:41.906426 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:41.906426 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:41.906426 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:41.906426 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:41.906426 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:41.906426 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:41.906426 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:41.906426 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:41.906426 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:41.906426 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:41.907544 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:41.907544 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:41.907544 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:41.907544 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:41.907544 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:41.907544 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:41.907544 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:41.907544 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:41.907544 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:41.907544 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:41.907544 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:41.907544 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:41.907544 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:41.907544 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:41.907544 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:41.907544 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:41.908587 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:41.908587 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:41.908587 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:41.908587 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:41.908587 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:41.908587 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:41.908587 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:41.908587 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:41.908587 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:41.908587 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:41.908587 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:38:41.908587 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:41.908587 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 289/565] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 3 12:38:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:41.909405 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817bf53-5bb3-4406-b212-6e101f0fd0bc None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:41.922338 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:41.935220 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16891d5c-d9bf-4bfc-b3f6-e4d921df7020 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:41.968887 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080bb493-0a8e-4f54-ba71-25f3b2c34b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:41.969751 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bb493-0a8e-4f54-ba71-25f3b2c34b2c None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:41.969866 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bb493-0a8e-4f54-ba71-25f3b2c34b2c None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:41.970081 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bb493-0a8e-4f54-ba71-25f3b2c34b2c None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:41.970774 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080bb493-0a8e-4f54-ba71-25f3b2c34b2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:41.971087 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080bb493-0a8e-4f54-ba71-25f3b2c34b2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:41.972520 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080bb493-0a8e-4f54-ba71-25f3b2c34b2c None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:41.983975 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 277/566] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:41.985177 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6262ae-bc9b-46b1-ac86-26db1b270627 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:41.985584 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6262ae-bc9b-46b1-ac86-26db1b270627 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:41.985864 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6262ae-bc9b-46b1-ac86-26db1b270627 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:41.987295 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 278/567] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:41.987906 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6262ae-bc9b-46b1-ac86-26db1b270627 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:42.010982 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817bf53-5bb3-4406-b212-6e101f0fd0bc None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:42.050570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776b172-d77a-4bcb-8b11-e2cc5545e020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:42.051206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776b172-d77a-4bcb-8b11-e2cc5545e020 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:42.051491 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776b172-d77a-4bcb-8b11-e2cc5545e020 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:42.051770 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776b172-d77a-4bcb-8b11-e2cc5545e020 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:42.054465 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:42.062802 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d776b172-d77a-4bcb-8b11-e2cc5545e020 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:42.064267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d776b172-d77a-4bcb-8b11-e2cc5545e020 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:42.079389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-d776b172-d77a-4bcb-8b11-e2cc5545e020 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:42.079389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:42.079389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:42.079389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:42.079389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:42.079389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:42.079389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:42.079389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:42.079389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:42.079389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:42.079389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:42.079389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:42.079389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:42.079389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:42.079389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:42.080402 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:42.080402 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:42.080402 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:42.080402 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:42.080402 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:42.080402 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:42.080402 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:42.080402 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:42.080402 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:42.080402 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:42.080402 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:42.080402 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:42.080402 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:42.080402 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:42.080402 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:42.080402 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:42.080402 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:42.086219 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:42.086219 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:42.086219 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:42.086219 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:42.086219 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 290/568] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:42.086219 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776b172-d77a-4bcb-8b11-e2cc5545e020 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:42.095513 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6262ae-bc9b-46b1-ac86-26db1b270627 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:42.128839 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc708ceb-fe28-40f8-b6c2-b0cbc8758cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:42.129450 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc708ceb-fe28-40f8-b6c2-b0cbc8758cd9 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:42.129760 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc708ceb-fe28-40f8-b6c2-b0cbc8758cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:42.130037 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc708ceb-fe28-40f8-b6c2-b0cbc8758cd9 None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:42.130748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc708ceb-fe28-40f8-b6c2-b0cbc8758cd9 None admin] RBAC: Adding query filter params (name=service) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:42.131052 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc708ceb-fe28-40f8-b6c2-b0cbc8758cd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:42.132404 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc708ceb-fe28-40f8-b6c2-b0cbc8758cd9 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:42.140960 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 279/569] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 3 12:38:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:42.141763 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc708ceb-fe28-40f8-b6c2-b0cbc8758cd9 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:42.155428 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:42.181960 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776b172-d77a-4bcb-8b11-e2cc5545e020 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:42.215391 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740dedde-1e74-4bee-a87a-7fd0237abca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:42.216003 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740dedde-1e74-4bee-a87a-7fd0237abca1 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:42.216286 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740dedde-1e74-4bee-a87a-7fd0237abca1 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:42.216561 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740dedde-1e74-4bee-a87a-7fd0237abca1 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:42.217277 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740dedde-1e74-4bee-a87a-7fd0237abca1 None admin] RBAC: Adding query filter params (name=service) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:42.217618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740dedde-1e74-4bee-a87a-7fd0237abca1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:42.218993 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740dedde-1e74-4bee-a87a-7fd0237abca1 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:42.226958 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 291/570] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 3 12:38:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:42.228157 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f163a-8b56-4093-acf2-4120d3f27c38 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:42.228512 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f163a-8b56-4093-acf2-4120d3f27c38 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:42.228857 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f163a-8b56-4093-acf2-4120d3f27c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:42.246566 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-484f163a-8b56-4093-acf2-4120d3f27c38 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:42.247327 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc708ceb-fe28-40f8-b6c2-b0cbc8758cd9 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:42.248262 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-484f163a-8b56-4093-acf2-4120d3f27c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:42.286331 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68840b8-2bfe-4f08-b310-9dca6c97613e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:42.286965 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68840b8-2bfe-4f08-b310-9dca6c97613e None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:42.287244 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68840b8-2bfe-4f08-b310-9dca6c97613e None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:42.287515 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68840b8-2bfe-4f08-b310-9dca6c97613e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:42.294863 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68840b8-2bfe-4f08-b310-9dca6c97613e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:42.296302 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68840b8-2bfe-4f08-b310-9dca6c97613e None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:42.298450 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:42.308008 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-f68840b8-2bfe-4f08-b310-9dca6c97613e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:38:42.308008 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:42.308008 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:42.308008 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:42.308008 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:42.308008 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:42.308008 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:42.308008 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:42.308008 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:42.308008 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:42.308008 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:42.308008 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:42.308008 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:38:42.308008 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:38:42.308008 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:38:42.309644 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:38:42.309644 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:42.309644 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:42.309644 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:42.309644 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:42.309644 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:42.309644 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:42.309644 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:42.309644 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:42.309644 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:42.309644 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:42.309644 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:42.309644 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:42.309644 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:42.309644 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:42.309644 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:42.309644 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:42.310685 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:38:42.310685 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:38:42.310685 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:38:42.310685 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:38:42.310685 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:38:42.310685 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:38:42.310685 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:38:42.310685 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:42.310685 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 280/571] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:38:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:42.311164 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68840b8-2bfe-4f08-b310-9dca6c97613e None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:42.322523 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 292/572] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:42.323349 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f163a-8b56-4093-acf2-4120d3f27c38 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:42.380049 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:42.412616 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68840b8-2bfe-4f08-b310-9dca6c97613e None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:42.435224 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f163a-8b56-4093-acf2-4120d3f27c38 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:42.445247 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a1153-b8e1-4ca0-8981-8add1650dc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:42.445882 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a1153-b8e1-4ca0-8981-8add1650dc61 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:42.446163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a1153-b8e1-4ca0-8981-8add1650dc61 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:42.446429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a1153-b8e1-4ca0-8981-8add1650dc61 None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:42.447117 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a1153-b8e1-4ca0-8981-8add1650dc61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:42.447421 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a1153-b8e1-4ca0-8981-8add1650dc61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:42.448781 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a1153-b8e1-4ca0-8981-8add1650dc61 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:42.464543 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 281/573] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:42.464543 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a1153-b8e1-4ca0-8981-8add1650dc61 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:42.473456 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb689d04-200f-43bf-9cd5-9c2d16f3c76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:42.474136 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb689d04-200f-43bf-9cd5-9c2d16f3c76f None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:42.474417 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb689d04-200f-43bf-9cd5-9c2d16f3c76f None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:42.474690 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb689d04-200f-43bf-9cd5-9c2d16f3c76f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:42.485447 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb689d04-200f-43bf-9cd5-9c2d16f3c76f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:42.486867 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb689d04-200f-43bf-9cd5-9c2d16f3c76f None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:42.501539 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-bb689d04-200f-43bf-9cd5-9c2d16f3c76f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:42.501539 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:42.501539 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:42.501539 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:42.501539 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:42.501539 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:42.501539 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:42.501539 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:42.501539 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:42.501539 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:42.501539 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:42.501539 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:42.501539 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:42.501539 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:42.501539 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:42.502411 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:42.502411 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:42.502411 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:42.502411 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:42.502411 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:42.502411 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:42.502411 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:42.502411 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:42.502411 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:42.502411 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:42.502411 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:42.502411 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:42.502411 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:42.502411 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:42.502411 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:42.502411 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:42.502411 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:42.503281 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:42.503281 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:42.503281 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:42.503281 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:42.503281 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 293/574] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:42.503878 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb689d04-200f-43bf-9cd5-9c2d16f3c76f None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:42.534836 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:42.562881 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a1153-b8e1-4ca0-8981-8add1650dc61 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:42.590699 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:42.597213 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdbef50-aad5-450f-a9b2-fb550888c65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:42.597964 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbef50-aad5-450f-a9b2-fb550888c65c None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:42.598160 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbef50-aad5-450f-a9b2-fb550888c65c None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:42.598428 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbef50-aad5-450f-a9b2-fb550888c65c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:42.604059 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb689d04-200f-43bf-9cd5-9c2d16f3c76f None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:42.608781 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdbef50-aad5-450f-a9b2-fb550888c65c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:42.610252 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdbef50-aad5-450f-a9b2-fb550888c65c None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:42.625051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-ffdbef50-aad5-450f-a9b2-fb550888c65c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:42.625051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:42.625051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:42.625051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:42.625051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:42.625051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:42.625051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:42.625051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:42.625051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:42.625051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:42.625051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:42.625051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:42.625051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:42.625051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:42.625051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:42.625955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:42.625955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:42.625955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:42.625955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:42.625955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:42.625955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:42.625955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:42.625955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:42.625955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:42.625955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:42.625955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:42.625955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:42.625955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:42.625955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:42.625955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:42.625955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:42.625955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:42.627116 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:42.627116 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:42.627116 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:42.627116 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:42.627116 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 282/575] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:42.627594 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdbef50-aad5-450f-a9b2-fb550888c65c None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:42.642064 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b3cab-aac0-4976-a621-aca914c06607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:42.642675 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b3cab-aac0-4976-a621-aca914c06607 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:42.642975 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b3cab-aac0-4976-a621-aca914c06607 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:42.643247 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b3cab-aac0-4976-a621-aca914c06607 None admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:42.643992 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b3cab-aac0-4976-a621-aca914c06607 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:42.644302 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b3cab-aac0-4976-a621-aca914c06607 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:42.645861 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b3cab-aac0-4976-a621-aca914c06607 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:42.658514 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 294/576] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 3 12:38:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:42.659457 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b3cab-aac0-4976-a621-aca914c06607 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:42.728123 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdbef50-aad5-450f-a9b2-fb550888c65c None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:42.749105 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:42.758079 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b3cab-aac0-4976-a621-aca914c06607 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:42.762858 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1aee1-2656-4f70-b130-dfa0fff8c838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:42.763498 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1aee1-2656-4f70-b130-dfa0fff8c838 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:42.763774 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1aee1-2656-4f70-b130-dfa0fff8c838 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:42.764046 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1aee1-2656-4f70-b130-dfa0fff8c838 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:42.773830 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1aee1-2656-4f70-b130-dfa0fff8c838 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:42.779622 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-04f1aee1-2656-4f70-b130-dfa0fff8c838 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:38:42.779622 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:42.779622 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:42.779622 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:42.779622 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:42.779622 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:42.779622 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:42.779622 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:42.779622 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:42.779622 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:42.779622 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:42.779622 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:42.779622 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:42.779622 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:42.779622 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:42.779622 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:42.780635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:42.780635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:42.780635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:42.780635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:42.780635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:42.780635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:42.780635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:42.780635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:42.780635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:42.780635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:42.780635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:42.780635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:42.780635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:42.780635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:42.780635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:42.780635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:42.786366 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:42.786366 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:42.786366 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:42.786366 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:42.786366 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:42.786366 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:42.786366 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:42.786366 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:42.786366 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:42.786366 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:42.786366 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:38:42.786366 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:42.786366 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 283/577] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 3 12:38:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:42.786366 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1aee1-2656-4f70-b130-dfa0fff8c838 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:42.793357 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc677b-1cdd-42ef-a7b0-4e69275f6509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:42.794203 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc677b-1cdd-42ef-a7b0-4e69275f6509 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:42.794484 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc677b-1cdd-42ef-a7b0-4e69275f6509 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:42.794787 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc677b-1cdd-42ef-a7b0-4e69275f6509 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:42.801431 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc677b-1cdd-42ef-a7b0-4e69275f6509 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:42.802927 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc677b-1cdd-42ef-a7b0-4e69275f6509 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:42.814093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-16cc677b-1cdd-42ef-a7b0-4e69275f6509 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:38:42.814093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:42.814093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:42.814093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:42.814093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:42.814093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:42.814093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:42.814093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:42.814093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:42.814093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:42.814093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:42.814093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:42.814093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:38:42.814093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:38:42.814093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:38:42.815146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:38:42.815146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:42.815146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:42.815146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:42.815146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:42.815146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:42.815146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:42.815146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:42.815146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:42.815146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:42.815146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:42.815146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:42.815146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:42.815146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:42.815146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:42.815146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:42.815146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:42.816200 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:38:42.816200 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:38:42.816200 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:38:42.816200 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:38:42.816200 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:38:42.816200 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:38:42.816200 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:38:42.816200 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:42.816200 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 295/578] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:38:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:42.816200 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc677b-1cdd-42ef-a7b0-4e69275f6509 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:42.826448 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:42.884440 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1aee1-2656-4f70-b130-dfa0fff8c838 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:42.927066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc677b-1cdd-42ef-a7b0-4e69275f6509 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:42.927638 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31634e6c-9204-4d1a-8774-75f2598e3324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:42.928261 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31634e6c-9204-4d1a-8774-75f2598e3324 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:42.928548 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31634e6c-9204-4d1a-8774-75f2598e3324 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:42.928823 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31634e6c-9204-4d1a-8774-75f2598e3324 None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:42.929543 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31634e6c-9204-4d1a-8774-75f2598e3324 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:42.929850 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31634e6c-9204-4d1a-8774-75f2598e3324 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:42.931242 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31634e6c-9204-4d1a-8774-75f2598e3324 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:42.943030 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 284/579] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:42.943826 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31634e6c-9204-4d1a-8774-75f2598e3324 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:42.966061 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34468999-2605-49a2-aaba-c5ced88ece59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:42.966681 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34468999-2605-49a2-aaba-c5ced88ece59 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:42.966964 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34468999-2605-49a2-aaba-c5ced88ece59 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:42.967240 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34468999-2605-49a2-aaba-c5ced88ece59 None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:42.967934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34468999-2605-49a2-aaba-c5ced88ece59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:42.968234 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34468999-2605-49a2-aaba-c5ced88ece59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:42.969631 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34468999-2605-49a2-aaba-c5ced88ece59 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:42.981046 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 296/580] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:42.981863 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34468999-2605-49a2-aaba-c5ced88ece59 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:42.996008 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:43.045675 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31634e6c-9204-4d1a-8774-75f2598e3324 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:43.047099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:43.081308 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34468999-2605-49a2-aaba-c5ced88ece59 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:43.081903 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50434d20-bc7f-4946-bdbc-4d0248b64b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:43.082508 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50434d20-bc7f-4946-bdbc-4d0248b64b00 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:43.082787 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50434d20-bc7f-4946-bdbc-4d0248b64b00 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:43.083054 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50434d20-bc7f-4946-bdbc-4d0248b64b00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:43.083843 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50434d20-bc7f-4946-bdbc-4d0248b64b00 None admin] RBAC: Adding query filter params (role.id=39d74def259b415ca634ad9c715e1332, scope.project.id=6ac833dfff634496816842c851545d21, user.id=67df369737ea4c83bae134f4bf2de20d) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:43.084146 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50434d20-bc7f-4946-bdbc-4d0248b64b00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:43.085594 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50434d20-bc7f-4946-bdbc-4d0248b64b00 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:43.091160 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 285/581] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:38:42 2022] GET /identity/v3/role_assignments?user.id=67df369737ea4c83bae134f4bf2de20d&scope.project.id=6ac833dfff634496816842c851545d21&role.id=39d74def259b415ca634ad9c715e1332 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:43.091948 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50434d20-bc7f-4946-bdbc-4d0248b64b00 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:43.118257 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c08203-3678-470a-b1c4-f804d30a3a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:43.119498 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c08203-3678-470a-b1c4-f804d30a3a61 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:43.119881 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c08203-3678-470a-b1c4-f804d30a3a61 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:43.120279 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c08203-3678-470a-b1c4-f804d30a3a61 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:43.122010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c08203-3678-470a-b1c4-f804d30a3a61 None admin] RBAC: Adding query filter params (name=service) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:43.122431 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c08203-3678-470a-b1c4-f804d30a3a61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:43.124163 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c08203-3678-470a-b1c4-f804d30a3a61 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:43.133838 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 297/582] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 3 12:38:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:43.134820 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c08203-3678-470a-b1c4-f804d30a3a61 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:43.220660 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50434d20-bc7f-4946-bdbc-4d0248b64b00 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:43.229522 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:43.257721 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61adf2-6cea-429e-aba6-1e254b8edf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:43.258340 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61adf2-6cea-429e-aba6-1e254b8edf4d None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:43.258618 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61adf2-6cea-429e-aba6-1e254b8edf4d None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:43.258887 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61adf2-6cea-429e-aba6-1e254b8edf4d None admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:43.258986 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c08203-3678-470a-b1c4-f804d30a3a61 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:43.259640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61adf2-6cea-429e-aba6-1e254b8edf4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:43.259946 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61adf2-6cea-429e-aba6-1e254b8edf4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:43.261373 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61adf2-6cea-429e-aba6-1e254b8edf4d None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:43.287687 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 286/583] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 3 12:38:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:43.287687 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61adf2-6cea-429e-aba6-1e254b8edf4d None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:43.307488 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e7602-cc5b-4a6a-b656-5fd94e5c471f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:43.308168 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e7602-cc5b-4a6a-b656-5fd94e5c471f None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:43.308519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e7602-cc5b-4a6a-b656-5fd94e5c471f None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:43.308800 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e7602-cc5b-4a6a-b656-5fd94e5c471f None admin] PATH_INFO: `/v3/users/glance` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:43.317127 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e7602-cc5b-4a6a-b656-5fd94e5c471f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:43.318118 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:43.318608 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e7602-cc5b-4a6a-b656-5fd94e5c471f None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:43.333072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-fa3e7602-cc5b-4a6a-b656-5fd94e5c471f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 03 12:38:43.333072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:43.333072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:43.333072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:43.333072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:43.333072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:43.333072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:43.333072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:43.333072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:43.333072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:43.333072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:43.333072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:43.333072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:38:43.333072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:38:43.333072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:38:43.333072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:38:43.334299 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:43.334299 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:43.334299 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:38:43.334299 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:38:43.334299 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:38:43.334299 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:38:43.334299 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:43.334299 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:43.334299 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:43.334299 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:43.334299 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:43.334299 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:43.334299 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:43.334299 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:43.334299 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:43.334299 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:43.334299 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:43.334299 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:43.335428 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:43.335428 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:43.335428 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:38:43.335428 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:38:43.335428 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:38:43.335428 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:38:43.335428 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:38:43.335428 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:38:43.335428 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 03 12:38:43.335428 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:43.336324 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 298/584] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:38:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:43.337275 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e7602-cc5b-4a6a-b656-5fd94e5c471f None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:43.401154 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61adf2-6cea-429e-aba6-1e254b8edf4d None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:43.438821 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6768a-ab9a-49d7-ad9e-d12466f6c5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:43.439460 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6768a-ab9a-49d7-ad9e-d12466f6c5c1 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:43.439745 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6768a-ab9a-49d7-ad9e-d12466f6c5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:43.440021 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6768a-ab9a-49d7-ad9e-d12466f6c5c1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:43.447199 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e7602-cc5b-4a6a-b656-5fd94e5c471f None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:43.447565 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6768a-ab9a-49d7-ad9e-d12466f6c5c1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:43.449000 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc6768a-ab9a-49d7-ad9e-d12466f6c5c1 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:43.462288 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-edc6768a-ab9a-49d7-ad9e-d12466f6c5c1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 03 12:38:43.462288 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:43.462288 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:43.462288 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:43.462288 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:43.462288 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:43.462288 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:43.462288 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:43.462288 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:43.462288 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:43.462288 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:43.462288 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:43.462288 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:38:43.462288 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:38:43.462288 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:38:43.462288 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:38:43.463256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:43.463256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:43.463256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:38:43.463256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:38:43.463256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:38:43.463256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:38:43.463256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:43.463256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:43.463256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:43.463256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:43.463256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:43.463256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:43.463256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:43.463256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:43.463256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:43.463256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:43.463256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:43.463256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:43.464213 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:43.464213 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:43.464213 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:38:43.464213 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:38:43.464213 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:38:43.464213 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:38:43.464213 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:38:43.464213 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:38:43.464213 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 03 12:38:43.464213 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:43.464213 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 287/585] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:38:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:43.464213 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6768a-ab9a-49d7-ad9e-d12466f6c5c1 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:43.491802 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa33df-99f8-4433-ae0c-e9f7ec0c8296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:43.492652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa33df-99f8-4433-ae0c-e9f7ec0c8296 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:43.493266 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa33df-99f8-4433-ae0c-e9f7ec0c8296 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:43.493587 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa33df-99f8-4433-ae0c-e9f7ec0c8296 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:43.495732 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:43.506536 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa33df-99f8-4433-ae0c-e9f7ec0c8296 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:43.507991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa33df-99f8-4433-ae0c-e9f7ec0c8296 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:43.523103 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-3daa33df-99f8-4433-ae0c-e9f7ec0c8296 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:43.523103 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:43.523103 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:43.523103 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:43.523103 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:43.523103 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:43.523103 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:43.523103 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:43.523103 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:43.523103 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:43.523103 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:43.523103 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:43.523103 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:43.523103 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:43.523103 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:43.524006 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:43.524006 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:43.524006 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:43.524006 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:43.524006 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:43.524006 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:43.524006 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:43.524006 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:43.524006 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:43.524006 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:43.524006 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:43.524006 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:43.524006 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:43.524006 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:43.524006 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:43.524006 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:43.524006 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:43.524910 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:43.524910 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:43.524910 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:43.524910 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:43.524910 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 299/586] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:43.525178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa33df-99f8-4433-ae0c-e9f7ec0c8296 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:43.558231 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:43.574271 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc6768a-ab9a-49d7-ad9e-d12466f6c5c1 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:43.613537 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980073a-f3f2-4a19-8f17-da8709ae9be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:43.614568 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980073a-f3f2-4a19-8f17-da8709ae9be9 None admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:43.615110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980073a-f3f2-4a19-8f17-da8709ae9be9 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:43.615386 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980073a-f3f2-4a19-8f17-da8709ae9be9 None admin] PATH_INFO: `/v3/projects/6ac833dfff634496816842c851545d21/users/dcf670ff4f62486dbf70cf6ea0f08bbb/roles/39d74def259b415ca634ad9c715e1332` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:43.630864 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f980073a-f3f2-4a19-8f17-da8709ae9be9 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ac833dfff634496816842c851545d21, user_id=dcf670ff4f62486dbf70cf6ea0f08bbb, role_id=39d74def259b415ca634ad9c715e1332)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:43.632298 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f980073a-f3f2-4a19-8f17-da8709ae9be9 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:43.638004 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa33df-99f8-4433-ae0c-e9f7ec0c8296 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:43.647828 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 288/587] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 3 12:38:43 2022] PUT /identity/v3/projects/6ac833dfff634496816842c851545d21/users/dcf670ff4f62486dbf70cf6ea0f08bbb/roles/39d74def259b415ca634ad9c715e1332 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:38:43.649059 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980073a-f3f2-4a19-8f17-da8709ae9be9 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:43.697802 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c5863-504f-4d23-80a9-54f5ed8545d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:43.698913 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c5863-504f-4d23-80a9-54f5ed8545d9 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:43.699272 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c5863-504f-4d23-80a9-54f5ed8545d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:43.700168 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c5863-504f-4d23-80a9-54f5ed8545d9 None admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:43.701954 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c5863-504f-4d23-80a9-54f5ed8545d9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:43.702482 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c5863-504f-4d23-80a9-54f5ed8545d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:43.704379 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c5863-504f-4d23-80a9-54f5ed8545d9 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:43.733125 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 300/588] 10.222.0.46 () {56 vars in 1137 bytes} [Wed Aug 3 12:38:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:43.734436 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c5863-504f-4d23-80a9-54f5ed8545d9 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:43.801602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980073a-f3f2-4a19-8f17-da8709ae9be9 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:43.803422 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:43.847816 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e30640-08e1-448d-8d48-5e0d4e6a6b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:43.848373 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e30640-08e1-448d-8d48-5e0d4e6a6b0b None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:43.848660 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e30640-08e1-448d-8d48-5e0d4e6a6b0b None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:43.848939 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e30640-08e1-448d-8d48-5e0d4e6a6b0b None admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:43.849806 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e30640-08e1-448d-8d48-5e0d4e6a6b0b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:43.850119 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e30640-08e1-448d-8d48-5e0d4e6a6b0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:43.851563 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e30640-08e1-448d-8d48-5e0d4e6a6b0b None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:43.855684 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:43.879491 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c5863-504f-4d23-80a9-54f5ed8545d9 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:43.880617 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 289/589] 10.222.0.46 () {56 vars in 1137 bytes} [Wed Aug 3 12:38:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:43.881914 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e30640-08e1-448d-8d48-5e0d4e6a6b0b None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:43.925566 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6637d7-f119-4e56-95f3-f513141f9a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:43.926682 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6637d7-f119-4e56-95f3-f513141f9a32 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:43.927112 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6637d7-f119-4e56-95f3-f513141f9a32 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:43.928442 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6637d7-f119-4e56-95f3-f513141f9a32 None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:43.929300 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6637d7-f119-4e56-95f3-f513141f9a32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:43.929777 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6637d7-f119-4e56-95f3-f513141f9a32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:43.931452 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6637d7-f119-4e56-95f3-f513141f9a32 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:43.947978 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 301/590] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:43.953871 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6637d7-f119-4e56-95f3-f513141f9a32 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:44.009898 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e30640-08e1-448d-8d48-5e0d4e6a6b0b None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:44.056266 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd661c-ff98-4a3e-914f-08119596ca52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:44.057595 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd661c-ff98-4a3e-914f-08119596ca52 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:44.057980 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd661c-ff98-4a3e-914f-08119596ca52 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:44.058372 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd661c-ff98-4a3e-914f-08119596ca52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:44.072694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd661c-ff98-4a3e-914f-08119596ca52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:44.075455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd661c-ff98-4a3e-914f-08119596ca52 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:44.088915 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6637d7-f119-4e56-95f3-f513141f9a32 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:44.092434 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:44.096613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-43bd661c-ff98-4a3e-914f-08119596ca52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:44.096613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:44.096613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:44.096613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:44.096613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:44.096613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:44.096613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:44.096613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:44.096613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:44.096613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:44.096613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:44.096613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:44.096613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:44.096613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:44.096613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:44.097729 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:44.097729 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:44.097729 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:44.097729 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:44.097729 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:44.097729 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:44.097729 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:44.097729 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:44.097729 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:44.097729 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:44.097729 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:44.097729 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:44.097729 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:44.097729 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:44.097729 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:44.097729 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:44.097729 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:44.098853 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:44.098853 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:44.098853 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:44.098853 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:44.104475 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 290/591] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:44.104475 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd661c-ff98-4a3e-914f-08119596ca52 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:44.146709 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e4804-f753-47b6-9d1f-1ad5225d272c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:44.147953 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e4804-f753-47b6-9d1f-1ad5225d272c None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:44.148415 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e4804-f753-47b6-9d1f-1ad5225d272c None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:44.148865 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e4804-f753-47b6-9d1f-1ad5225d272c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:44.165609 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e4804-f753-47b6-9d1f-1ad5225d272c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:44.166987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:44.167676 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e4804-f753-47b6-9d1f-1ad5225d272c None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:44.183149 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-f00e4804-f753-47b6-9d1f-1ad5225d272c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:44.183149 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:44.183149 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:44.183149 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:44.183149 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:44.183149 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:44.183149 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:44.183149 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:44.183149 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:44.183149 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:44.183149 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:44.183149 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:44.183149 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:44.183149 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:44.183149 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:44.184599 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:44.184599 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:44.184599 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:44.184599 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:44.184599 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:44.184599 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:44.184599 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:44.184599 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:44.184599 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:44.184599 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:44.184599 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:44.184599 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:44.184599 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:44.184599 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:44.184599 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:44.184599 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:44.184599 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:44.185473 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:44.185473 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:44.185473 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:44.185473 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:44.192304 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 302/592] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:44.193408 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e4804-f753-47b6-9d1f-1ad5225d272c None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:44.237645 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd661c-ff98-4a3e-914f-08119596ca52 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:44.289445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb8c34-97aa-4509-8d9d-9871b29f9ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:44.290112 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb8c34-97aa-4509-8d9d-9871b29f9ccd None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:44.290504 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb8c34-97aa-4509-8d9d-9871b29f9ccd None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:44.290805 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb8c34-97aa-4509-8d9d-9871b29f9ccd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:44.301046 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb8c34-97aa-4509-8d9d-9871b29f9ccd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:44.302699 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb8c34-97aa-4509-8d9d-9871b29f9ccd None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:44.309249 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e4804-f753-47b6-9d1f-1ad5225d272c None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:44.316389 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-bfdb8c34-97aa-4509-8d9d-9871b29f9ccd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 03 12:38:44.316389 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:44.316389 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:44.316389 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:44.316389 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:44.316389 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:44.316389 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:44.316389 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:44.316389 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:44.316389 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:44.316389 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:44.316389 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:44.316389 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:38:44.316389 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:38:44.316389 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:38:44.316389 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:38:44.317309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:44.317309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:44.317309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:38:44.317309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:38:44.317309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:38:44.317309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:38:44.317309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:44.317309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:44.317309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:44.317309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:44.317309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:44.317309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:44.317309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:44.317309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:44.317309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:44.317309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:44.317309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:44.317309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:44.323347 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:44.323347 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:44.323347 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:38:44.323347 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:38:44.323347 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:38:44.323347 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:38:44.323347 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:38:44.323347 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:38:44.323347 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 03 12:38:44.323347 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:44.323347 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 291/593] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 3 12:38:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:44.323347 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb8c34-97aa-4509-8d9d-9871b29f9ccd None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:44.354659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0bafd9-5a09-4189-8c85-786128a3ff22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:44.355629 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bafd9-5a09-4189-8c85-786128a3ff22 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:44.356344 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bafd9-5a09-4189-8c85-786128a3ff22 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:44.356818 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bafd9-5a09-4189-8c85-786128a3ff22 None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:44.357782 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0bafd9-5a09-4189-8c85-786128a3ff22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:44.358286 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0bafd9-5a09-4189-8c85-786128a3ff22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:44.359969 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0bafd9-5a09-4189-8c85-786128a3ff22 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:44.378204 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 303/594] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:44.379413 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0bafd9-5a09-4189-8c85-786128a3ff22 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:44.398324 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:44.444141 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb8c34-97aa-4509-8d9d-9871b29f9ccd None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:44.453856 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:44.486166 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7a2b6-d9a9-4268-988a-5849cf9a390f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:44.487220 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7a2b6-d9a9-4268-988a-5849cf9a390f None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:44.487769 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7a2b6-d9a9-4268-988a-5849cf9a390f None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:44.488243 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7a2b6-d9a9-4268-988a-5849cf9a390f None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:44.489146 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7a2b6-d9a9-4268-988a-5849cf9a390f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:44.490081 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7a2b6-d9a9-4268-988a-5849cf9a390f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:44.491800 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7a2b6-d9a9-4268-988a-5849cf9a390f None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:44.493692 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0bafd9-5a09-4189-8c85-786128a3ff22 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:44.509488 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 292/595] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:44.510746 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7a2b6-d9a9-4268-988a-5849cf9a390f None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:44.534551 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076ffd7-1dcf-4f49-b9fd-b47289e4a6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:44.535170 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076ffd7-1dcf-4f49-b9fd-b47289e4a6c5 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:44.535449 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076ffd7-1dcf-4f49-b9fd-b47289e4a6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:44.535718 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076ffd7-1dcf-4f49-b9fd-b47289e4a6c5 None admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:44.536939 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076ffd7-1dcf-4f49-b9fd-b47289e4a6c5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:44.537246 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076ffd7-1dcf-4f49-b9fd-b47289e4a6c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:44.538999 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076ffd7-1dcf-4f49-b9fd-b47289e4a6c5 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:44.565856 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 304/596] 10.222.0.46 () {56 vars in 1139 bytes} [Wed Aug 3 12:38:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:44.565856 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076ffd7-1dcf-4f49-b9fd-b47289e4a6c5 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:44.626893 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7a2b6-d9a9-4268-988a-5849cf9a390f None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:44.652784 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:44.667052 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7eaa1-b964-4567-9eb9-30888b752e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:44.668100 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7eaa1-b964-4567-9eb9-30888b752e4e None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:44.668899 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7eaa1-b964-4567-9eb9-30888b752e4e None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:44.669377 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7eaa1-b964-4567-9eb9-30888b752e4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:44.677017 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7eaa1-b964-4567-9eb9-30888b752e4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:44.679022 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7eaa1-b964-4567-9eb9-30888b752e4e None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:44.682081 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076ffd7-1dcf-4f49-b9fd-b47289e4a6c5 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:44.692373 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-f0e7eaa1-b964-4567-9eb9-30888b752e4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:38:44.692373 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:44.692373 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:44.692373 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:44.692373 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:44.692373 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:44.692373 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:44.692373 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:44.692373 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:44.692373 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:44.692373 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:44.692373 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:44.692373 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:38:44.692373 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:38:44.692373 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:38:44.693258 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:38:44.693258 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:44.693258 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:44.693258 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:44.693258 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:44.693258 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:44.693258 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:44.693258 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:44.693258 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:44.693258 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:44.693258 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:44.693258 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:44.693258 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:44.693258 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:44.693258 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:44.693258 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:44.693258 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:44.694460 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:38:44.694460 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:38:44.694460 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:38:44.694460 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:38:44.694460 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:38:44.694460 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:38:44.694460 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:38:44.694460 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:44.702017 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 293/597] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:38:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:44.703350 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7eaa1-b964-4567-9eb9-30888b752e4e None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:44.721731 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959a9c1-6ead-4a15-869c-9dad05683738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:44.722371 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959a9c1-6ead-4a15-869c-9dad05683738 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:44.722710 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959a9c1-6ead-4a15-869c-9dad05683738 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:44.722985 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959a9c1-6ead-4a15-869c-9dad05683738 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:44.731511 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959a9c1-6ead-4a15-869c-9dad05683738 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:44.733236 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959a9c1-6ead-4a15-869c-9dad05683738 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:44.734140 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:44.748898 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-4959a9c1-6ead-4a15-869c-9dad05683738 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:38:44.748898 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:44.748898 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:44.748898 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:44.748898 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:44.748898 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:44.748898 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:44.748898 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:44.748898 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:44.748898 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:44.748898 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:44.748898 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:44.748898 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:38:44.748898 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:38:44.748898 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:38:44.749893 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:38:44.749893 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:44.749893 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:44.749893 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:44.749893 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:44.749893 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:44.749893 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:44.749893 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:44.749893 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:44.749893 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:44.749893 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:44.749893 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:44.749893 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:44.749893 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:44.749893 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:44.749893 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:44.749893 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:44.750864 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:38:44.750864 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:38:44.750864 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:38:44.750864 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:38:44.750864 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:38:44.750864 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:38:44.750864 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:38:44.750864 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:44.750864 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 305/598] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:38:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:44.750864 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959a9c1-6ead-4a15-869c-9dad05683738 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:44.826856 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7eaa1-b964-4567-9eb9-30888b752e4e None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:44.867207 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e2f95-829f-4bdf-8a84-e198b8ccb504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:44.868374 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e2f95-829f-4bdf-8a84-e198b8ccb504 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:44.868856 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e2f95-829f-4bdf-8a84-e198b8ccb504 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:44.869348 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e2f95-829f-4bdf-8a84-e198b8ccb504 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:44.877935 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959a9c1-6ead-4a15-869c-9dad05683738 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:44.882174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e2f95-829f-4bdf-8a84-e198b8ccb504 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:44.883954 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e2f95-829f-4bdf-8a84-e198b8ccb504 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:44.901522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-0f3e2f95-829f-4bdf-8a84-e198b8ccb504 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:44.901522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:44.901522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:44.901522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:44.901522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:44.901522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:44.901522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:44.901522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:44.901522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:44.901522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:44.901522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:44.901522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:44.901522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:44.901522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:44.901522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:44.902455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:44.902455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:44.902455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:44.902455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:44.902455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:44.902455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:44.902455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:44.902455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:44.902455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:44.902455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:44.902455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:44.902455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:44.902455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:44.902455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:44.902455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:44.902455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:44.902455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:44.903482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:44.903482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:44.903482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:44.903482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:44.910265 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 294/599] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:44.911546 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e2f95-829f-4bdf-8a84-e198b8ccb504 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:44.917465 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139eca8b-dc38-40da-b0c0-dee2cefb714d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:44.918112 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139eca8b-dc38-40da-b0c0-dee2cefb714d None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:44.918534 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139eca8b-dc38-40da-b0c0-dee2cefb714d None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:44.918963 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139eca8b-dc38-40da-b0c0-dee2cefb714d None admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:44.920108 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139eca8b-dc38-40da-b0c0-dee2cefb714d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:44.920417 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139eca8b-dc38-40da-b0c0-dee2cefb714d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:44.921884 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139eca8b-dc38-40da-b0c0-dee2cefb714d None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:44.924150 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:44.943154 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 306/600] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 3 12:38:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:44.943154 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139eca8b-dc38-40da-b0c0-dee2cefb714d None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:45.010661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:45.036029 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e2f95-829f-4bdf-8a84-e198b8ccb504 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:45.063720 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139eca8b-dc38-40da-b0c0-dee2cefb714d None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:45.074563 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577152c-ea7a-4dc6-9ae7-3e6514586248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:45.075784 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577152c-ea7a-4dc6-9ae7-3e6514586248 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:45.076387 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577152c-ea7a-4dc6-9ae7-3e6514586248 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:45.076864 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577152c-ea7a-4dc6-9ae7-3e6514586248 None admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:45.077863 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577152c-ea7a-4dc6-9ae7-3e6514586248 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:45.078390 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577152c-ea7a-4dc6-9ae7-3e6514586248 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:45.080183 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577152c-ea7a-4dc6-9ae7-3e6514586248 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:45.097992 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 295/601] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 3 12:38:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:45.099153 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577152c-ea7a-4dc6-9ae7-3e6514586248 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:45.101430 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421bdbe-471e-4598-97c3-f8371e5c07e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:45.102076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421bdbe-471e-4598-97c3-f8371e5c07e2 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:45.102354 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421bdbe-471e-4598-97c3-f8371e5c07e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:45.102629 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421bdbe-471e-4598-97c3-f8371e5c07e2 None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:45.103323 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421bdbe-471e-4598-97c3-f8371e5c07e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:45.103622 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421bdbe-471e-4598-97c3-f8371e5c07e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:45.105229 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421bdbe-471e-4598-97c3-f8371e5c07e2 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:45.125005 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 307/602] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:45.125005 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421bdbe-471e-4598-97c3-f8371e5c07e2 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:45.183571 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:45.215454 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577152c-ea7a-4dc6-9ae7-3e6514586248 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:45.232590 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421bdbe-471e-4598-97c3-f8371e5c07e2 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:45.252074 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f23526-b08f-40e4-9034-7da360d94d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:45.252746 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f23526-b08f-40e4-9034-7da360d94d5d None admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:45.253028 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f23526-b08f-40e4-9034-7da360d94d5d None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:45.253303 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f23526-b08f-40e4-9034-7da360d94d5d None admin] PATH_INFO: `/v3/projects/6ac833dfff634496816842c851545d21/users/a2f23f4936684b63afc095986e43ec37/roles/39d74def259b415ca634ad9c715e1332` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:45.262792 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:45.270526 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29c6b8-56b7-4923-93d3-64fd391529d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:45.271230 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29c6b8-56b7-4923-93d3-64fd391529d7 None admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:45.271517 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29c6b8-56b7-4923-93d3-64fd391529d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:45.271801 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29c6b8-56b7-4923-93d3-64fd391529d7 None admin] PATH_INFO: `/v3/projects/6ac833dfff634496816842c851545d21/users/603adceaefb94e218cc1e683529a60b5/roles/39d74def259b415ca634ad9c715e1332` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:45.274598 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f23526-b08f-40e4-9034-7da360d94d5d None admin] RBAC: Authorizing `identity:create_grant(project_id=6ac833dfff634496816842c851545d21, user_id=a2f23f4936684b63afc095986e43ec37, role_id=39d74def259b415ca634ad9c715e1332)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:45.277211 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f23526-b08f-40e4-9034-7da360d94d5d None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:45.287448 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29c6b8-56b7-4923-93d3-64fd391529d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ac833dfff634496816842c851545d21, user_id=603adceaefb94e218cc1e683529a60b5, role_id=39d74def259b415ca634ad9c715e1332)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:45.288910 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29c6b8-56b7-4923-93d3-64fd391529d7 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:45.293996 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 296/603] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 3 12:38:45 2022] PUT /identity/v3/projects/6ac833dfff634496816842c851545d21/users/a2f23f4936684b63afc095986e43ec37/roles/39d74def259b415ca634ad9c715e1332 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:38:45.295722 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f23526-b08f-40e4-9034-7da360d94d5d None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:45.322416 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 308/604] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 3 12:38:45 2022] PUT /identity/v3/projects/6ac833dfff634496816842c851545d21/users/603adceaefb94e218cc1e683529a60b5/roles/39d74def259b415ca634ad9c715e1332 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:38:45.322416 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a4fcb-5922-4938-ac3b-4c90f31765b4 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:45.322416 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a4fcb-5922-4938-ac3b-4c90f31765b4 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:45.322416 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a4fcb-5922-4938-ac3b-4c90f31765b4 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:45.322416 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 309/605] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:45.328888 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b7208-8b27-4397-b49b-d7a388aeda30 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:45.329239 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b7208-8b27-4397-b49b-d7a388aeda30 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:45.329430 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b7208-8b27-4397-b49b-d7a388aeda30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:45.362986 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-162b7208-8b27-4397-b49b-d7a388aeda30 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:45.364249 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-162b7208-8b27-4397-b49b-d7a388aeda30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:45.499015 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f23526-b08f-40e4-9034-7da360d94d5d None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:45.499892 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 310/606] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:38:45.526567 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b7208-8b27-4397-b49b-d7a388aeda30 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:45.541523 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a5dc84-1a9a-4e05-90bc-fa53c4cabc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:45.542170 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5dc84-1a9a-4e05-90bc-fa53c4cabc9e None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:45.542454 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5dc84-1a9a-4e05-90bc-fa53c4cabc9e None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:45.542727 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5dc84-1a9a-4e05-90bc-fa53c4cabc9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:45.550498 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a5dc84-1a9a-4e05-90bc-fa53c4cabc9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:45.552062 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a5dc84-1a9a-4e05-90bc-fa53c4cabc9e None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:45.565110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-30a5dc84-1a9a-4e05-90bc-fa53c4cabc9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:38:45.565110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:45.565110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:45.565110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:45.565110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:45.565110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:45.565110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:45.565110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:45.565110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:45.565110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:45.565110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:45.565110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:45.565110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:38:45.565110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:38:45.565110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:38:45.566102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:38:45.566102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:45.566102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:45.566102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:45.566102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:45.566102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:45.566102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:45.566102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:45.566102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:45.566102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:45.566102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:45.566102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:45.566102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:45.566102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:45.566102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:45.566102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:45.566102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:45.566996 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:38:45.566996 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:38:45.566996 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:38:45.566996 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:38:45.566996 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:38:45.566996 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:38:45.566996 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:38:45.566996 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:45.567416 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:45.568007 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 297/607] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:38:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:45.574342 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a5dc84-1a9a-4e05-90bc-fa53c4cabc9e None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:45.632136 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:45.641014 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b7208-8b27-4397-b49b-d7a388aeda30 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:45.680576 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28415bfc-2538-496e-bfef-a9bf7734f0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:45.681368 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28415bfc-2538-496e-bfef-a9bf7734f0ed None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:45.681684 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28415bfc-2538-496e-bfef-a9bf7734f0ed None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:45.681962 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28415bfc-2538-496e-bfef-a9bf7734f0ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:45.691473 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a5dc84-1a9a-4e05-90bc-fa53c4cabc9e None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:45.694381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28415bfc-2538-496e-bfef-a9bf7734f0ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:45.699394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-28415bfc-2538-496e-bfef-a9bf7734f0ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:38:45.699394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:45.699394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:45.699394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:45.699394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:45.699394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:45.699394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:45.699394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:45.699394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:45.699394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:45.699394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:45.699394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:45.699394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:45.699394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:45.699394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:45.699394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:45.700973 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:45.700973 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:45.700973 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:45.700973 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:45.700973 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:45.700973 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:45.700973 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:45.700973 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:45.700973 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:45.700973 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:45.700973 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:45.700973 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:45.700973 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:45.700973 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:45.700973 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:45.700973 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:45.702028 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:45.702028 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:45.702028 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:45.702028 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:45.702028 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:45.702028 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:45.702028 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:45.702028 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:45.702028 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:45.702028 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:45.702028 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:38:45.702028 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:45.707469 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 311/608] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 3 12:38:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:45.707469 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28415bfc-2538-496e-bfef-a9bf7734f0ed None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:45.733288 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430849c0-4798-43fd-a7c9-296a007809c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:45.734176 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430849c0-4798-43fd-a7c9-296a007809c9 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:45.734482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430849c0-4798-43fd-a7c9-296a007809c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:45.734924 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430849c0-4798-43fd-a7c9-296a007809c9 None admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:45.735792 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430849c0-4798-43fd-a7c9-296a007809c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:45.736241 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430849c0-4798-43fd-a7c9-296a007809c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:45.737958 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430849c0-4798-43fd-a7c9-296a007809c9 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:45.751485 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 298/609] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 3 12:38:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:45.757353 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430849c0-4798-43fd-a7c9-296a007809c9 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:45.834251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:45.842493 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28415bfc-2538-496e-bfef-a9bf7734f0ed None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:45.869920 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430849c0-4798-43fd-a7c9-296a007809c9 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:45.883938 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b7d56-4a03-4e41-8635-11ed902d3d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:45.884736 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b7d56-4a03-4e41-8635-11ed902d3d17 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:45.885146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b7d56-4a03-4e41-8635-11ed902d3d17 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:45.885430 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b7d56-4a03-4e41-8635-11ed902d3d17 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:45.886204 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b7d56-4a03-4e41-8635-11ed902d3d17 None admin] RBAC: Adding query filter params (name=service) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:45.886508 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b7d56-4a03-4e41-8635-11ed902d3d17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:45.888701 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b7d56-4a03-4e41-8635-11ed902d3d17 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:45.899999 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 312/610] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 3 12:38:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:45.901064 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:45.901613 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cec69b-3e4b-459b-82f4-6c2a8ef24dea None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:45.901905 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cec69b-3e4b-459b-82f4-6c2a8ef24dea None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:45.902183 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cec69b-3e4b-459b-82f4-6c2a8ef24dea None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:45.905128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 313/611] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:45.906263 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cec69b-3e4b-459b-82f4-6c2a8ef24dea None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:45.916090 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8c78f-487f-478a-af61-b836961be8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:45.917842 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8c78f-487f-478a-af61-b836961be8ec None admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:45.918477 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8c78f-487f-478a-af61-b836961be8ec None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:45.918976 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8c78f-487f-478a-af61-b836961be8ec None admin] PATH_INFO: `/v3/projects/6ac833dfff634496816842c851545d21/users/e0cd747cb5f64ff7b5f8d67d3d640fc5/roles/39d74def259b415ca634ad9c715e1332` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:45.939076 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8c78f-487f-478a-af61-b836961be8ec None admin] RBAC: Authorizing `identity:create_grant(project_id=6ac833dfff634496816842c851545d21, user_id=e0cd747cb5f64ff7b5f8d67d3d640fc5, role_id=39d74def259b415ca634ad9c715e1332)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:45.941795 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8c78f-487f-478a-af61-b836961be8ec None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:45.965024 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 299/612] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 3 12:38:45 2022] PUT /identity/v3/projects/6ac833dfff634496816842c851545d21/users/e0cd747cb5f64ff7b5f8d67d3d640fc5/roles/39d74def259b415ca634ad9c715e1332 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:38:45.966832 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd0071-cac4-42e4-bb2c-7ba0f12d82f1 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:45.968131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd0071-cac4-42e4-bb2c-7ba0f12d82f1 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:45.968419 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd0071-cac4-42e4-bb2c-7ba0f12d82f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:46.010725 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-96bd0071-cac4-42e4-bb2c-7ba0f12d82f1 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:46.011871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-96bd0071-cac4-42e4-bb2c-7ba0f12d82f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:46.088557 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cec69b-3e4b-459b-82f4-6c2a8ef24dea None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:46.130062 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 300/613] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:46.150727 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127f08a-5e38-47c7-a41f-cab2d0b86e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:46.151370 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127f08a-5e38-47c7-a41f-cab2d0b86e70 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:46.151649 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127f08a-5e38-47c7-a41f-cab2d0b86e70 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:46.151923 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127f08a-5e38-47c7-a41f-cab2d0b86e70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:46.161419 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd0071-cac4-42e4-bb2c-7ba0f12d82f1 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:46.170179 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127f08a-5e38-47c7-a41f-cab2d0b86e70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:46.172016 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127f08a-5e38-47c7-a41f-cab2d0b86e70 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:46.189654 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-1127f08a-5e38-47c7-a41f-cab2d0b86e70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:46.189654 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:46.189654 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:46.189654 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:46.189654 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:46.189654 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:46.189654 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:46.189654 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:46.189654 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:46.189654 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:46.189654 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:46.189654 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:46.189654 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:46.189654 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:46.189654 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:46.190584 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:46.190584 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:46.190584 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:46.190584 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:46.190584 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:46.190584 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:46.190584 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:46.190584 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:46.190584 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:46.190584 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:46.190584 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:46.190584 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:46.190584 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:46.190584 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:46.190584 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:46.190584 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:46.190584 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:46.191465 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:46.191465 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:46.191465 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:46.191465 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:46.193804 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 314/614] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:46.201969 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127f08a-5e38-47c7-a41f-cab2d0b86e70 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:46.221298 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:46.297848 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:46.320471 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd0071-cac4-42e4-bb2c-7ba0f12d82f1 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:46.371038 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127f08a-5e38-47c7-a41f-cab2d0b86e70 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:46.390900 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758b764-78a4-42f1-a9f9-7e2f1561eec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:46.391925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758b764-78a4-42f1-a9f9-7e2f1561eec2 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:46.392982 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758b764-78a4-42f1-a9f9-7e2f1561eec2 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:46.394825 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758b764-78a4-42f1-a9f9-7e2f1561eec2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:46.414043 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758b764-78a4-42f1-a9f9-7e2f1561eec2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:46.420238 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-9758b764-78a4-42f1-a9f9-7e2f1561eec2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:38:46.420238 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:46.420238 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:46.420238 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:46.420238 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:46.420238 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:46.420238 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:46.420238 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:46.420238 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:46.420238 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:46.420238 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:46.420238 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:46.420238 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:46.420238 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:46.420238 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:46.420238 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:46.421348 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:46.421348 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:46.421348 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:46.421348 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:46.421348 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:46.421348 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:46.421348 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:46.421348 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:46.421348 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:46.421348 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:46.421348 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:46.421348 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:46.421348 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:46.421348 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:46.421348 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:46.421348 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:46.422405 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:46.422405 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:46.422405 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:46.422405 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:46.422405 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:46.422405 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:46.422405 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:46.422405 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:46.422405 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:46.422405 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:46.422405 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:38:46.422405 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:46.430250 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 301/615] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 3 12:38:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:38:46.438485 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758b764-78a4-42f1-a9f9-7e2f1561eec2 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:46.452767 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5b555-8fa7-4d8a-830b-d9e651819e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:46.453557 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5b555-8fa7-4d8a-830b-d9e651819e04 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:46.453999 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5b555-8fa7-4d8a-830b-d9e651819e04 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:46.454372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5b555-8fa7-4d8a-830b-d9e651819e04 None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:46.455225 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5b555-8fa7-4d8a-830b-d9e651819e04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:46.455630 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5b555-8fa7-4d8a-830b-d9e651819e04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:46.457097 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5b555-8fa7-4d8a-830b-d9e651819e04 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:46.488002 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 315/616] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:46.493694 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5b555-8fa7-4d8a-830b-d9e651819e04 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:46.562801 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758b764-78a4-42f1-a9f9-7e2f1561eec2 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:46.600487 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed18737-386d-481f-a681-c41c6c6ae84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:46.601110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed18737-386d-481f-a681-c41c6c6ae84d None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:46.601391 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed18737-386d-481f-a681-c41c6c6ae84d None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:46.601893 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed18737-386d-481f-a681-c41c6c6ae84d None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:46.602620 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed18737-386d-481f-a681-c41c6c6ae84d None admin] RBAC: Adding query filter params (name=service) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:46.602925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed18737-386d-481f-a681-c41c6c6ae84d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:46.604381 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed18737-386d-481f-a681-c41c6c6ae84d None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:46.614244 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 302/617] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 3 12:38:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:46.619548 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:46.620507 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed18737-386d-481f-a681-c41c6c6ae84d None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:46.644469 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:46.677377 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5b555-8fa7-4d8a-830b-d9e651819e04 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:46.726289 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed18737-386d-481f-a681-c41c6c6ae84d None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:46.742197 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22aa41-f7dd-4a92-98b4-2436670ef6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:46.742855 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22aa41-f7dd-4a92-98b4-2436670ef6ae None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:46.743139 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22aa41-f7dd-4a92-98b4-2436670ef6ae None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:46.743418 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22aa41-f7dd-4a92-98b4-2436670ef6ae None admin] PATH_INFO: `/v3/users/swift` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:46.755104 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb22aa41-f7dd-4a92-98b4-2436670ef6ae None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:46.756551 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb22aa41-f7dd-4a92-98b4-2436670ef6ae None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:46.763421 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadac246-4072-49a5-a0f4-31b280fdf277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:46.764060 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadac246-4072-49a5-a0f4-31b280fdf277 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:46.764341 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadac246-4072-49a5-a0f4-31b280fdf277 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:46.764617 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadac246-4072-49a5-a0f4-31b280fdf277 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:46.775144 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadac246-4072-49a5-a0f4-31b280fdf277 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:46.776580 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadac246-4072-49a5-a0f4-31b280fdf277 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:46.785710 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-bb22aa41-f7dd-4a92-98b4-2436670ef6ae None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 03 12:38:46.785710 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:46.785710 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:46.785710 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:46.785710 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:46.785710 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:46.785710 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:46.785710 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:46.785710 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:46.785710 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:46.785710 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:46.785710 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:46.785710 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:38:46.785710 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:38:46.785710 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:38:46.785710 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:38:46.787873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:46.787873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:46.787873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:38:46.787873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:38:46.787873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:38:46.787873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:38:46.787873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:46.787873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:46.787873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:46.787873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:46.787873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:46.787873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:46.787873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:46.787873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:46.787873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:46.787873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:46.787873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:46.787873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:46.790128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:46.790128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:46.790128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:38:46.790128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:38:46.790128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:38:46.790128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:38:46.790128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:38:46.790128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:38:46.790128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 03 12:38:46.790128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:46.790128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 316/618] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 3 12:38:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:38:46.793157 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-eadac246-4072-49a5-a0f4-31b280fdf277 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:46.793157 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:46.793157 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:46.793157 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:46.793157 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:46.793157 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:46.793157 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:46.793157 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:46.793157 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:46.793157 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:46.793157 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:46.793157 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:46.793157 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:46.793157 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:46.793157 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:46.799253 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:46.799253 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:46.799253 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:46.799253 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:46.799253 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:46.799253 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:46.799253 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:46.799253 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:46.799253 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:46.799253 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:46.799253 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:46.799253 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:46.799253 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:46.799253 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:46.799253 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:46.799253 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:46.799253 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:46.801622 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:46.801622 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:46.801622 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:46.801622 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:46.801622 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 303/619] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:38:46.808960 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22aa41-f7dd-4a92-98b4-2436670ef6ae None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:46.809144 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadac246-4072-49a5-a0f4-31b280fdf277 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:46.922624 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:46.971670 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadac246-4072-49a5-a0f4-31b280fdf277 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:46.985352 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22aa41-f7dd-4a92-98b4-2436670ef6ae None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:47.007871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2ea80-f75b-4860-bbd4-29f19393819d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:47.008598 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2ea80-f75b-4860-bbd4-29f19393819d None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:47.008894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2ea80-f75b-4860-bbd4-29f19393819d None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:47.009170 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2ea80-f75b-4860-bbd4-29f19393819d None admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:47.010018 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b2ea80-f75b-4860-bbd4-29f19393819d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:47.010322 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b2ea80-f75b-4860-bbd4-29f19393819d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:47.019136 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b2ea80-f75b-4860-bbd4-29f19393819d None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:47.021044 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:47.040630 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 304/620] 10.222.0.46 () {56 vars in 1135 bytes} [Wed Aug 3 12:38:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:47.044233 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d79875-7241-46ef-8052-18fea58ab415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:47.044865 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d79875-7241-46ef-8052-18fea58ab415 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:47.045149 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d79875-7241-46ef-8052-18fea58ab415 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:47.045421 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d79875-7241-46ef-8052-18fea58ab415 None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:47.046155 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d79875-7241-46ef-8052-18fea58ab415 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:47.046458 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d79875-7241-46ef-8052-18fea58ab415 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:47.048317 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2ea80-f75b-4860-bbd4-29f19393819d None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:47.058201 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d79875-7241-46ef-8052-18fea58ab415 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:47.079131 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 317/621] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:47.085898 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d79875-7241-46ef-8052-18fea58ab415 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:47.158229 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2ea80-f75b-4860-bbd4-29f19393819d None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:47.185980 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:47.205899 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cf806-9082-40bb-804a-0cef4a09dd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:47.206755 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cf806-9082-40bb-804a-0cef4a09dd32 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:47.207146 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cf806-9082-40bb-804a-0cef4a09dd32 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:47.207434 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cf806-9082-40bb-804a-0cef4a09dd32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:47.228139 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cf806-9082-40bb-804a-0cef4a09dd32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:47.229649 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cf806-9082-40bb-804a-0cef4a09dd32 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:47.249666 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d79875-7241-46ef-8052-18fea58ab415 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:47.252018 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-bf1cf806-9082-40bb-804a-0cef4a09dd32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:47.252018 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:47.252018 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:47.252018 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:47.252018 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:47.252018 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:47.252018 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:47.252018 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:47.252018 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:47.252018 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:47.252018 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:47.252018 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:47.252018 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:47.252018 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:47.252018 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:47.254079 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:47.254079 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:47.254079 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:47.254079 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:47.254079 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:47.254079 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:47.254079 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:47.254079 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:47.254079 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:47.254079 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:47.254079 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:47.254079 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:47.254079 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:47.254079 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:47.254079 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:47.254079 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:47.254079 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:47.256281 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:47.256281 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:47.256281 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:47.256281 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:47.257871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 305/622] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:47.265539 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cf806-9082-40bb-804a-0cef4a09dd32 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:47.296513 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62a6f2-195a-4e66-990f-b90f2153f5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:47.297162 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62a6f2-195a-4e66-990f-b90f2153f5cc None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:47.297446 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62a6f2-195a-4e66-990f-b90f2153f5cc None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:47.297756 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62a6f2-195a-4e66-990f-b90f2153f5cc None admin] PATH_INFO: `/v3/users/nova` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:47.305213 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c62a6f2-195a-4e66-990f-b90f2153f5cc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:47.306696 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c62a6f2-195a-4e66-990f-b90f2153f5cc None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:47.329243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-5c62a6f2-195a-4e66-990f-b90f2153f5cc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:38:47.329243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:47.329243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:47.329243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:47.329243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:47.329243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:47.329243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:47.329243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:47.329243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:47.329243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:47.329243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:47.329243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:47.329243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:38:47.329243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:38:47.329243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:38:47.329243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:38:47.331441 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:47.331441 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:47.331441 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:38:47.331441 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:38:47.331441 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:38:47.331441 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:38:47.331441 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:47.331441 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:47.331441 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:47.331441 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:47.331441 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:47.331441 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:47.331441 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:47.331441 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:47.331441 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:47.331441 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:47.331441 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:47.331441 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:47.333613 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:47.333613 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:47.333613 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:38:47.333613 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:38:47.333613 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:38:47.333613 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:38:47.333613 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:38:47.333613 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:38:47.333613 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:38:47.333613 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:47.333613 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 318/623] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Aug 3 12:38:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:47.336706 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62a6f2-195a-4e66-990f-b90f2153f5cc None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:47.388976 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cf806-9082-40bb-804a-0cef4a09dd32 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:47.431028 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2819a-4bf6-4cf7-acc1-645c6ebf0f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:47.436161 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2819a-4bf6-4cf7-acc1-645c6ebf0f37 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:47.436492 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2819a-4bf6-4cf7-acc1-645c6ebf0f37 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:47.437028 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2819a-4bf6-4cf7-acc1-645c6ebf0f37 None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:47.437928 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe2819a-4bf6-4cf7-acc1-645c6ebf0f37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:47.438338 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe2819a-4bf6-4cf7-acc1-645c6ebf0f37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:47.439807 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe2819a-4bf6-4cf7-acc1-645c6ebf0f37 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:47.460851 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:47.468307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 306/624] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:47.474917 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2819a-4bf6-4cf7-acc1-645c6ebf0f37 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:47.533982 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:47.535705 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62a6f2-195a-4e66-990f-b90f2153f5cc None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:47.577693 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01956aec-1433-470f-9296-37455e51718a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:47.578497 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01956aec-1433-470f-9296-37455e51718a None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:47.578876 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01956aec-1433-470f-9296-37455e51718a None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:47.579280 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01956aec-1433-470f-9296-37455e51718a None admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:47.580184 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01956aec-1433-470f-9296-37455e51718a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:47.580612 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01956aec-1433-470f-9296-37455e51718a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:47.582352 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01956aec-1433-470f-9296-37455e51718a None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:47.602673 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 319/625] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Aug 3 12:38:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:47.608938 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01956aec-1433-470f-9296-37455e51718a None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:47.672163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2819a-4bf6-4cf7-acc1-645c6ebf0f37 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:47.712086 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785688f-eed8-42ce-aa3c-c4cc15cb5d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:47.712975 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785688f-eed8-42ce-aa3c-c4cc15cb5d79 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:47.713528 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785688f-eed8-42ce-aa3c-c4cc15cb5d79 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:47.713977 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785688f-eed8-42ce-aa3c-c4cc15cb5d79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:47.721141 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785688f-eed8-42ce-aa3c-c4cc15cb5d79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:47.723085 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785688f-eed8-42ce-aa3c-c4cc15cb5d79 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:47.723468 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01956aec-1433-470f-9296-37455e51718a None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:47.732296 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:47.736154 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-a785688f-eed8-42ce-aa3c-c4cc15cb5d79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:38:47.736154 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:47.736154 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:47.736154 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:47.736154 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:47.736154 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:47.736154 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:47.736154 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:47.736154 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:47.736154 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:47.736154 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:47.736154 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:47.736154 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:38:47.736154 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:38:47.736154 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:38:47.737023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:38:47.737023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:47.737023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:47.737023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:47.737023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:47.737023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:47.737023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:47.737023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:47.737023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:47.737023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:47.737023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:47.737023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:47.737023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:47.737023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:47.737023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:47.737023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:47.737023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:47.737943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:38:47.737943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:38:47.737943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:38:47.737943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:38:47.737943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:38:47.737943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:38:47.737943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:38:47.737943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:47.740685 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 307/626] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:38:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:38:47.742227 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5f00f-cee1-4265-b428-20bed64c7455 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:47.742669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5f00f-cee1-4265-b428-20bed64c7455 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:47.743097 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5f00f-cee1-4265-b428-20bed64c7455 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:47.744800 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 308/627] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:47.745887 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5f00f-cee1-4265-b428-20bed64c7455 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:47.779328 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074c896-a396-4770-a4a5-bc9afe5dd527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:47.780251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074c896-a396-4770-a4a5-bc9afe5dd527 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:47.780547 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074c896-a396-4770-a4a5-bc9afe5dd527 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:47.780825 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074c896-a396-4770-a4a5-bc9afe5dd527 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:47.848271 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:47.860820 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5f00f-cee1-4265-b428-20bed64c7455 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:47.866550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074c896-a396-4770-a4a5-bc9afe5dd527 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:47.868040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074c896-a396-4770-a4a5-bc9afe5dd527 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:47.907812 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2fa5c6-f2fb-4c7e-8ad1-9b7694704f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:47.908441 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fa5c6-f2fb-4c7e-8ad1-9b7694704f85 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:47.908720 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fa5c6-f2fb-4c7e-8ad1-9b7694704f85 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:47.908990 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fa5c6-f2fb-4c7e-8ad1-9b7694704f85 None admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:47.909781 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2fa5c6-f2fb-4c7e-8ad1-9b7694704f85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:47.910089 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2fa5c6-f2fb-4c7e-8ad1-9b7694704f85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:47.911935 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2fa5c6-f2fb-4c7e-8ad1-9b7694704f85 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:47.927185 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 309/628] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 3 12:38:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:47.928557 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137e130-3bd7-45dd-a1cd-f90daf31f678 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:47.928850 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137e130-3bd7-45dd-a1cd-f90daf31f678 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:47.929546 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137e130-3bd7-45dd-a1cd-f90daf31f678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:47.952158 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-b137e130-3bd7-45dd-a1cd-f90daf31f678 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:47.954072 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-b137e130-3bd7-45dd-a1cd-f90daf31f678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:47.975773 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 320/629] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:38:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:38:47.981941 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f327dc-d0a6-41b9-a552-e80038ca0d5e None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:47.982226 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f327dc-d0a6-41b9-a552-e80038ca0d5e None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:47.982506 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f327dc-d0a6-41b9-a552-e80038ca0d5e None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:47.984072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 321/630] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:47.984767 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f327dc-d0a6-41b9-a552-e80038ca0d5e None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:47.994505 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:48.035866 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 310/631] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:48.037132 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137e130-3bd7-45dd-a1cd-f90daf31f678 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:48.099253 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f327dc-d0a6-41b9-a552-e80038ca0d5e None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:48.135594 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a8c9b-23a3-47c8-8f7d-d6aa6b47607f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:48.136271 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a8c9b-23a3-47c8-8f7d-d6aa6b47607f None admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:48.136550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a8c9b-23a3-47c8-8f7d-d6aa6b47607f None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:48.136823 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a8c9b-23a3-47c8-8f7d-d6aa6b47607f None admin] PATH_INFO: `/v3/projects/6ac833dfff634496816842c851545d21/users/67df369737ea4c83bae134f4bf2de20d/roles/39d74def259b415ca634ad9c715e1332` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:48.143579 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:48.152520 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a8c9b-23a3-47c8-8f7d-d6aa6b47607f None admin] RBAC: Authorizing `identity:create_grant(project_id=6ac833dfff634496816842c851545d21, user_id=67df369737ea4c83bae134f4bf2de20d, role_id=39d74def259b415ca634ad9c715e1332)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:48.154064 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a8c9b-23a3-47c8-8f7d-d6aa6b47607f None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:48.166456 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137e130-3bd7-45dd-a1cd-f90daf31f678 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:48.173532 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 322/632] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 3 12:38:47 2022] PUT /identity/v3/projects/6ac833dfff634496816842c851545d21/users/67df369737ea4c83bae134f4bf2de20d/roles/39d74def259b415ca634ad9c715e1332 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:38:48.173532 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e74f88-527c-4c9b-ae97-ff652cc138a2 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:48.173532 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e74f88-527c-4c9b-ae97-ff652cc138a2 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:48.173532 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e74f88-527c-4c9b-ae97-ff652cc138a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:48.194757 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-67e74f88-527c-4c9b-ae97-ff652cc138a2 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:48.195988 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-67e74f88-527c-4c9b-ae97-ff652cc138a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:48.220855 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d296e-133c-408f-8028-c14d278069db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:48.221538 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d296e-133c-408f-8028-c14d278069db None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:48.221828 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d296e-133c-408f-8028-c14d278069db None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:48.222106 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d296e-133c-408f-8028-c14d278069db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:48.238655 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6d296e-133c-408f-8028-c14d278069db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:48.240336 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6d296e-133c-408f-8028-c14d278069db None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:48.266463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-fe6d296e-133c-408f-8028-c14d278069db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:48.266463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:48.266463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:48.266463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:48.266463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:48.266463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:48.266463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:48.266463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:48.266463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:48.266463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:48.266463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:48.266463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:48.266463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:48.266463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:48.266463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:48.267592 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:48.267592 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:48.267592 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:48.267592 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:48.267592 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:48.267592 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:48.267592 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:48.267592 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:48.267592 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:48.267592 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:48.267592 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:48.267592 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:48.267592 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:48.267592 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:48.267592 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:48.267592 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:48.267592 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:48.268700 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:48.268700 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:48.268700 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:48.268700 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:48.271111 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 311/633] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:48.272507 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:48.273523 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d296e-133c-408f-8028-c14d278069db None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:48.298045 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 323/634] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:48.299034 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e74f88-527c-4c9b-ae97-ff652cc138a2 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:48.415993 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d296e-133c-408f-8028-c14d278069db None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:48.420948 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e74f88-527c-4c9b-ae97-ff652cc138a2 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:48.462061 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f80114-b63e-4314-ab8d-abce762fbadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:48.462413 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c18ab-662e-47a0-8fac-d0fb3b5920e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:48.462746 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f80114-b63e-4314-ab8d-abce762fbadc None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:48.462961 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c18ab-662e-47a0-8fac-d0fb3b5920e9 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:48.463063 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f80114-b63e-4314-ab8d-abce762fbadc None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:48.463244 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c18ab-662e-47a0-8fac-d0fb3b5920e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:48.463343 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f80114-b63e-4314-ab8d-abce762fbadc None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:48.463519 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c18ab-662e-47a0-8fac-d0fb3b5920e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:48.464164 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f80114-b63e-4314-ab8d-abce762fbadc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:48.464558 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f80114-b63e-4314-ab8d-abce762fbadc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:48.466159 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:48.467783 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f80114-b63e-4314-ab8d-abce762fbadc None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:48.476574 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c18ab-662e-47a0-8fac-d0fb3b5920e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:48.482698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-ab5c18ab-662e-47a0-8fac-d0fb3b5920e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:38:48.482698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:48.482698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:48.482698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:48.482698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:48.482698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:48.482698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:48.482698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:48.482698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:48.482698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:48.482698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:48.482698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:48.482698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:48.482698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:48.482698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:48.482698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:48.483889 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:48.483889 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:48.483889 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:48.483889 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:48.483889 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:48.483889 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:48.483889 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:48.483889 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:48.483889 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:48.483889 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:48.483889 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:48.483889 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:48.483889 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:48.483889 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:48.483889 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:48.483889 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:48.485002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:48.485002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:48.485002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:48.485002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:48.485002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:48.485002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:48.485002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:48.485002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:48.485002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:48.485002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:48.485002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:38:48.485002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:48.485688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 324/635] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:48.485688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f80114-b63e-4314-ab8d-abce762fbadc None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:48.488480 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 312/636] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 3 12:38:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:48.489386 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c18ab-662e-47a0-8fac-d0fb3b5920e9 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:48.540077 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:48.597403 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f80114-b63e-4314-ab8d-abce762fbadc None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:48.603153 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c18ab-662e-47a0-8fac-d0fb3b5920e9 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:48.637519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e9a97-ab66-4654-8d9d-2e5e5458d3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:48.638169 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e9a97-ab66-4654-8d9d-2e5e5458d3a9 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:48.638456 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e9a97-ab66-4654-8d9d-2e5e5458d3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:48.638787 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e9a97-ab66-4654-8d9d-2e5e5458d3a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:48.640347 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878434f-de98-4698-95d0-64b69aff45ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:48.640989 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878434f-de98-4698-95d0-64b69aff45ec None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:48.641272 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878434f-de98-4698-95d0-64b69aff45ec None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:48.641857 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878434f-de98-4698-95d0-64b69aff45ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:48.648341 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878434f-de98-4698-95d0-64b69aff45ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:48.649855 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878434f-de98-4698-95d0-64b69aff45ec None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:48.650309 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e9a97-ab66-4654-8d9d-2e5e5458d3a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:48.657727 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-093e9a97-ab66-4654-8d9d-2e5e5458d3a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:38:48.657727 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:48.657727 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:48.657727 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:48.657727 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:48.657727 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:48.657727 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:48.657727 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:48.657727 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:48.657727 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:48.657727 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:48.657727 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:48.657727 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:48.657727 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:48.657727 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:48.657727 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:48.658787 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:48.658787 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:48.658787 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:48.658787 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:48.658787 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:48.658787 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:48.658787 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:48.658787 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:48.658787 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:48.658787 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:48.658787 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:48.658787 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:48.658787 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:48.658787 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:48.658787 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:48.658787 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:48.659614 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:48.659614 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:48.659614 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:48.659614 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:48.659614 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:48.659614 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:48.659614 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:48.659614 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:48.659614 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:48.659614 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:48.659614 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:38:48.659614 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:48.661805 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 325/637] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 3 12:38:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:48.662077 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-a878434f-de98-4698-95d0-64b69aff45ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:38:48.662077 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:48.662077 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:48.662077 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:48.662077 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:48.662077 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:48.662077 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:48.662077 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:48.662077 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:48.662077 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:48.662077 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:48.662077 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:48.662077 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:38:48.662077 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:38:48.662077 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:38:48.662914 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:38:48.662914 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:48.662914 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:48.662914 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:48.662914 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:48.662914 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:48.662914 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:48.662914 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:48.662914 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:48.662914 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:48.662914 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:48.662914 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:48.662914 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:48.662914 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:48.662914 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:48.662914 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:48.662914 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:48.663861 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:38:48.663861 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:38:48.663861 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:38:48.663861 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:38:48.663861 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:38:48.663861 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:38:48.663861 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:38:48.663861 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:48.665174 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e9a97-ab66-4654-8d9d-2e5e5458d3a9 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:48.667821 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 313/638] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:38:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:48.669702 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b140f0-b72a-49b9-b501-8520ad3ed902 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:48.669991 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b140f0-b72a-49b9-b501-8520ad3ed902 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:48.670267 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b140f0-b72a-49b9-b501-8520ad3ed902 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:48.673613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 314/639] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:48.673613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b140f0-b72a-49b9-b501-8520ad3ed902 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:48.733998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:48.774924 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e9a97-ab66-4654-8d9d-2e5e5458d3a9 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:48.783046 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b140f0-b72a-49b9-b501-8520ad3ed902 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:48.784309 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:48.818170 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4810b8-965e-4264-b060-e247e08dfb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:48.818770 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4810b8-965e-4264-b060-e247e08dfb4a None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:48.819001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e960a5-412d-4e84-a85c-040d4afae2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:48.819115 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4810b8-965e-4264-b060-e247e08dfb4a None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:48.819290 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4810b8-965e-4264-b060-e247e08dfb4a None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:48.819881 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e960a5-412d-4e84-a85c-040d4afae2b0 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:48.819986 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4810b8-965e-4264-b060-e247e08dfb4a None admin] RBAC: Adding query filter params (name=service) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:48.820289 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4810b8-965e-4264-b060-e247e08dfb4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:48.820388 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e960a5-412d-4e84-a85c-040d4afae2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:48.820755 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e960a5-412d-4e84-a85c-040d4afae2b0 None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:48.821593 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e960a5-412d-4e84-a85c-040d4afae2b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:48.821703 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4810b8-965e-4264-b060-e247e08dfb4a None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:48.822066 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e960a5-412d-4e84-a85c-040d4afae2b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:48.823990 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e960a5-412d-4e84-a85c-040d4afae2b0 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:48.834365 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 326/640] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 3 12:38:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:48.834365 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4810b8-965e-4264-b060-e247e08dfb4a None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:48.837133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 315/641] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 3 12:38:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:48.841652 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f9a70-eaf5-49c4-9901-70e1f491fc4b None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:48.841652 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f9a70-eaf5-49c4-9901-70e1f491fc4b None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:48.841652 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f9a70-eaf5-49c4-9901-70e1f491fc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:48.858307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-382f9a70-eaf5-49c4-9901-70e1f491fc4b None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:48.859582 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-382f9a70-eaf5-49c4-9901-70e1f491fc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:48.936545 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 316/642] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:48.937379 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f9a70-eaf5-49c4-9901-70e1f491fc4b None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:48.949025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4810b8-965e-4264-b060-e247e08dfb4a None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:48.986966 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485b74e-5623-49e0-a47b-435dbef5251b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:48.987935 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485b74e-5623-49e0-a47b-435dbef5251b None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:48.988198 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485b74e-5623-49e0-a47b-435dbef5251b None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:48.988468 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485b74e-5623-49e0-a47b-435dbef5251b None admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:48.989558 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485b74e-5623-49e0-a47b-435dbef5251b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:48.990119 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485b74e-5623-49e0-a47b-435dbef5251b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:48.991538 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485b74e-5623-49e0-a47b-435dbef5251b None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:48.993310 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:49.008830 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 327/643] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 3 12:38:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:49.008830 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485b74e-5623-49e0-a47b-435dbef5251b None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:49.033908 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:49.058536 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f9a70-eaf5-49c4-9901-70e1f491fc4b None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:49.093829 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec5c20-9065-4cea-9ed9-8981b24d1c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:49.094467 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec5c20-9065-4cea-9ed9-8981b24d1c18 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:49.094747 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec5c20-9065-4cea-9ed9-8981b24d1c18 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:49.095021 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec5c20-9065-4cea-9ed9-8981b24d1c18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:49.104393 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485b74e-5623-49e0-a47b-435dbef5251b None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:49.105791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec5c20-9065-4cea-9ed9-8981b24d1c18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:49.107423 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec5c20-9065-4cea-9ed9-8981b24d1c18 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:49.123586 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-5bec5c20-9065-4cea-9ed9-8981b24d1c18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:49.123586 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:49.123586 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:49.123586 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:49.123586 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:49.123586 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:49.123586 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:49.123586 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:49.123586 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:49.123586 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:49.123586 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:49.123586 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:49.123586 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:49.123586 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:49.123586 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:49.124707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:49.124707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:49.124707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:49.124707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:49.124707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:49.124707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:49.124707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:49.124707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:49.124707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:49.124707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:49.124707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:49.124707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:49.124707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:49.124707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:49.124707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:49.124707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:49.124707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:49.125867 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:49.125867 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:49.125867 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:49.125867 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:49.129486 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 317/644] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:49.130031 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec5c20-9065-4cea-9ed9-8981b24d1c18 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:49.142603 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0f904-69de-435f-b97a-0f01185045a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:49.143358 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0f904-69de-435f-b97a-0f01185045a6 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:49.143733 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0f904-69de-435f-b97a-0f01185045a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:49.144101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0f904-69de-435f-b97a-0f01185045a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:49.155299 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c0f904-69de-435f-b97a-0f01185045a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:49.156812 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c0f904-69de-435f-b97a-0f01185045a6 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:49.171750 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-81c0f904-69de-435f-b97a-0f01185045a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:49.171750 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:49.171750 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:49.171750 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:49.171750 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:49.171750 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:49.171750 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:49.171750 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:49.171750 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:49.171750 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:49.171750 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:49.171750 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:49.171750 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:49.171750 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:49.171750 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:49.172828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:49.172828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:49.172828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:49.172828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:49.172828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:49.172828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:49.172828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:49.172828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:49.172828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:49.172828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:49.172828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:49.172828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:49.172828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:49.172828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:49.172828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:49.172828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:49.172828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:49.174066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:49.174066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:49.174066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:49.174066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:49.174570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 328/645] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:49.175345 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0f904-69de-435f-b97a-0f01185045a6 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:49.233481 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:49.238852 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec5c20-9065-4cea-9ed9-8981b24d1c18 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:49.275032 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6b1a9-dec4-4ef1-810b-aba3e80a5dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:49.275679 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6b1a9-dec4-4ef1-810b-aba3e80a5dc5 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:49.275965 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6b1a9-dec4-4ef1-810b-aba3e80a5dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:49.276242 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6b1a9-dec4-4ef1-810b-aba3e80a5dc5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:49.278236 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:49.288476 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c6b1a9-dec4-4ef1-810b-aba3e80a5dc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:49.293824 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-f3c6b1a9-dec4-4ef1-810b-aba3e80a5dc5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:38:49.293824 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:49.293824 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:49.293824 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:49.293824 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:49.293824 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:49.293824 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:49.293824 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:49.293824 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:49.293824 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:49.293824 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:49.293824 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:49.293824 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:49.293824 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:49.293824 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:49.293824 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:49.294731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:49.294731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:49.294731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:49.294731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:49.294731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:49.294731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:49.294731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:49.294731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:49.294731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:49.294731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:49.294731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:49.294731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:49.294731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:49.294731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:49.294731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:49.294731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:49.295555 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:49.295555 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:49.295555 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:49.295555 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:49.295555 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:49.295555 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:49.295555 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:49.295555 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:49.295555 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:49.295555 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:49.295555 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:38:49.295555 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:49.295555 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 318/646] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 3 12:38:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:49.296229 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6b1a9-dec4-4ef1-810b-aba3e80a5dc5 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:49.306121 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0f904-69de-435f-b97a-0f01185045a6 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:49.345537 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc056572-e330-42a1-941a-bd8cc04c1d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:49.346169 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc056572-e330-42a1-941a-bd8cc04c1d5e None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:49.346731 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc056572-e330-42a1-941a-bd8cc04c1d5e None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:49.347006 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc056572-e330-42a1-941a-bd8cc04c1d5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:49.347814 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc056572-e330-42a1-941a-bd8cc04c1d5e None admin] RBAC: Adding query filter params (role.id=39d74def259b415ca634ad9c715e1332, scope.project.id=6ac833dfff634496816842c851545d21, user.id=dcf670ff4f62486dbf70cf6ea0f08bbb) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:49.348120 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc056572-e330-42a1-941a-bd8cc04c1d5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:49.350378 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc056572-e330-42a1-941a-bd8cc04c1d5e None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:49.359025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 329/647] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:38:49 2022] GET /identity/v3/role_assignments?user.id=dcf670ff4f62486dbf70cf6ea0f08bbb&scope.project.id=6ac833dfff634496816842c851545d21&role.id=39d74def259b415ca634ad9c715e1332 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:49.360157 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc056572-e330-42a1-941a-bd8cc04c1d5e None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:49.417206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6b1a9-dec4-4ef1-810b-aba3e80a5dc5 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:49.467889 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa439b9e-fc98-4245-8b86-0f284d1441c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:49.468812 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa439b9e-fc98-4245-8b86-0f284d1441c6 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:49.469237 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa439b9e-fc98-4245-8b86-0f284d1441c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:49.469692 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa439b9e-fc98-4245-8b86-0f284d1441c6 None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:49.470547 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa439b9e-fc98-4245-8b86-0f284d1441c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:49.470995 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa439b9e-fc98-4245-8b86-0f284d1441c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:49.472556 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa439b9e-fc98-4245-8b86-0f284d1441c6 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:49.491242 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 319/648] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:49.493130 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa439b9e-fc98-4245-8b86-0f284d1441c6 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:49.502996 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc056572-e330-42a1-941a-bd8cc04c1d5e None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:49.518360 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:49.545618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd751e-86f3-4ad6-b6bd-708bce9a6959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:49.546451 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd751e-86f3-4ad6-b6bd-708bce9a6959 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:49.546881 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd751e-86f3-4ad6-b6bd-708bce9a6959 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:49.547152 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd751e-86f3-4ad6-b6bd-708bce9a6959 None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:49.547909 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd751e-86f3-4ad6-b6bd-708bce9a6959 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:49.548272 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd751e-86f3-4ad6-b6bd-708bce9a6959 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:49.549916 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd751e-86f3-4ad6-b6bd-708bce9a6959 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:49.565987 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 330/649] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:49.566844 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd751e-86f3-4ad6-b6bd-708bce9a6959 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:49.570533 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:49.627146 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa439b9e-fc98-4245-8b86-0f284d1441c6 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:49.679507 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade03c33-eb2f-4946-a602-816ee382815e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:49.681075 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade03c33-eb2f-4946-a602-816ee382815e None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:49.681716 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade03c33-eb2f-4946-a602-816ee382815e None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:49.682264 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade03c33-eb2f-4946-a602-816ee382815e None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:49.683439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade03c33-eb2f-4946-a602-816ee382815e None admin] RBAC: Adding query filter params (name=service) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:49.684951 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade03c33-eb2f-4946-a602-816ee382815e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:49.686957 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade03c33-eb2f-4946-a602-816ee382815e None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:49.687760 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd751e-86f3-4ad6-b6bd-708bce9a6959 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:49.698343 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 320/650] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 3 12:38:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:49.700122 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade03c33-eb2f-4946-a602-816ee382815e None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:49.725108 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1584ec-8594-4a37-b74e-76bd5efaa284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:49.725981 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1584ec-8594-4a37-b74e-76bd5efaa284 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:49.726331 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1584ec-8594-4a37-b74e-76bd5efaa284 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:49.726675 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1584ec-8594-4a37-b74e-76bd5efaa284 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:49.735425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1584ec-8594-4a37-b74e-76bd5efaa284 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:49.736966 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1584ec-8594-4a37-b74e-76bd5efaa284 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:49.750206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-1c1584ec-8594-4a37-b74e-76bd5efaa284 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 03 12:38:49.750206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:49.750206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:49.750206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:49.750206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:49.750206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:49.750206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:49.750206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:49.750206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:49.750206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:49.750206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:49.750206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:49.750206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:38:49.750206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:38:49.750206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:38:49.750206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:38:49.751227 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:49.751227 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:49.751227 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:38:49.751227 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:38:49.751227 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:38:49.751227 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:38:49.751227 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:49.751227 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:49.751227 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:49.751227 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:49.751227 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:49.751227 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:49.751227 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:49.751227 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:49.751227 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:49.751227 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:49.751227 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:49.751227 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:49.752150 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:49.752150 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:49.752150 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:38:49.752150 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:38:49.752150 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:38:49.752150 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:38:49.752150 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:38:49.752150 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:38:49.752150 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 03 12:38:49.752150 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:49.752150 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 331/651] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:38:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:49.752746 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1584ec-8594-4a37-b74e-76bd5efaa284 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:49.813575 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:49.828719 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:49.842224 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade03c33-eb2f-4946-a602-816ee382815e None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:49.873248 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1584ec-8594-4a37-b74e-76bd5efaa284 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:49.889308 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bae778-6d46-4f63-8478-3be49f0c32f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:49.890283 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bae778-6d46-4f63-8478-3be49f0c32f1 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:49.890879 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bae778-6d46-4f63-8478-3be49f0c32f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:49.891325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bae778-6d46-4f63-8478-3be49f0c32f1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:49.901678 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bae778-6d46-4f63-8478-3be49f0c32f1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:49.903880 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bae778-6d46-4f63-8478-3be49f0c32f1 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:49.909437 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c6bce-079d-4413-a072-03324195010d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:49.910324 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c6bce-079d-4413-a072-03324195010d None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:49.910702 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c6bce-079d-4413-a072-03324195010d None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:49.911074 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c6bce-079d-4413-a072-03324195010d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:49.918202 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-57bae778-6d46-4f63-8478-3be49f0c32f1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 03 12:38:49.918202 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:49.918202 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:49.918202 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:49.918202 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:49.918202 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:49.918202 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:49.918202 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:49.918202 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:49.918202 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:49.918202 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:49.918202 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:49.918202 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:38:49.918202 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:38:49.918202 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:38:49.918202 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:38:49.919280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:49.919280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:49.919280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:38:49.919280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:38:49.919280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:38:49.919280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:38:49.919280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:49.919280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:49.919280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:49.919280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:49.919280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:49.919280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:49.919280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:49.919280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:49.919280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:49.919280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:49.919280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:49.919280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:49.920394 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:49.920394 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:49.920394 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:38:49.920394 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:38:49.920394 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:38:49.920394 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:38:49.920394 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:38:49.920394 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:38:49.920394 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 03 12:38:49.920394 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:49.927809 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 321/652] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:38:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:49.927809 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bae778-6d46-4f63-8478-3be49f0c32f1 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:49.930863 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c6bce-079d-4413-a072-03324195010d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:49.933513 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c6bce-079d-4413-a072-03324195010d None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:49.954035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-066c6bce-079d-4413-a072-03324195010d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:49.954035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:49.954035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:49.954035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:49.954035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:49.954035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:49.954035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:49.954035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:49.954035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:49.954035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:49.954035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:49.954035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:49.954035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:49.954035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:49.954035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:49.955194 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:49.955194 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:49.955194 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:49.955194 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:49.955194 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:49.955194 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:49.955194 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:49.955194 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:49.955194 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:49.955194 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:49.955194 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:49.955194 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:49.955194 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:49.955194 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:49.955194 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:49.955194 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:49.955194 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:49.956115 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:49.956115 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:49.956115 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:49.956115 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:49.956804 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 332/653] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:49.961251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c6bce-079d-4413-a072-03324195010d None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:50.047175 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bae778-6d46-4f63-8478-3be49f0c32f1 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:50.086154 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c6bce-079d-4413-a072-03324195010d None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:50.093951 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d701b-7279-40f1-b99a-2425c4da73f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:50.095260 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d701b-7279-40f1-b99a-2425c4da73f4 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:50.095689 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d701b-7279-40f1-b99a-2425c4da73f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:50.096129 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d701b-7279-40f1-b99a-2425c4da73f4 None admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:50.097615 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d701b-7279-40f1-b99a-2425c4da73f4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:50.098065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d701b-7279-40f1-b99a-2425c4da73f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:50.100354 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d701b-7279-40f1-b99a-2425c4da73f4 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:50.105186 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:50.116269 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:50.127713 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 322/654] 10.222.0.46 () {56 vars in 1137 bytes} [Wed Aug 3 12:38:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:50.131169 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda4e8e-f76a-4e97-a719-0b2b6614f594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:50.131970 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda4e8e-f76a-4e97-a719-0b2b6614f594 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:50.132405 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda4e8e-f76a-4e97-a719-0b2b6614f594 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:50.132851 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda4e8e-f76a-4e97-a719-0b2b6614f594 None admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:50.133437 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d701b-7279-40f1-b99a-2425c4da73f4 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:50.134097 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda4e8e-f76a-4e97-a719-0b2b6614f594 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:50.134603 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda4e8e-f76a-4e97-a719-0b2b6614f594 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:50.136550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda4e8e-f76a-4e97-a719-0b2b6614f594 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:50.166779 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 333/655] 10.222.0.46 () {56 vars in 1137 bytes} [Wed Aug 3 12:38:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:50.166779 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda4e8e-f76a-4e97-a719-0b2b6614f594 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:50.244678 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d701b-7279-40f1-b99a-2425c4da73f4 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:50.288344 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523b8f2-bd2a-48b0-89d5-0d763f0b6521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:50.289054 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523b8f2-bd2a-48b0-89d5-0d763f0b6521 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:50.289451 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523b8f2-bd2a-48b0-89d5-0d763f0b6521 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:50.289757 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523b8f2-bd2a-48b0-89d5-0d763f0b6521 None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:50.290452 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b523b8f2-bd2a-48b0-89d5-0d763f0b6521 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:50.290760 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b523b8f2-bd2a-48b0-89d5-0d763f0b6521 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:50.292120 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b523b8f2-bd2a-48b0-89d5-0d763f0b6521 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:50.292618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda4e8e-f76a-4e97-a719-0b2b6614f594 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:50.305646 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 323/656] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:50.305646 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523b8f2-bd2a-48b0-89d5-0d763f0b6521 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:50.332274 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b760a1b-2cb1-4955-9e42-158870516950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:50.333021 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b760a1b-2cb1-4955-9e42-158870516950 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:50.333373 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b760a1b-2cb1-4955-9e42-158870516950 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:50.333743 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b760a1b-2cb1-4955-9e42-158870516950 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:50.368731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:50.388093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:50.413903 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523b8f2-bd2a-48b0-89d5-0d763f0b6521 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:50.414539 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b760a1b-2cb1-4955-9e42-158870516950 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:50.416114 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b760a1b-2cb1-4955-9e42-158870516950 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:50.456738 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2dae81-472e-400e-8628-4c0449400419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:50.457447 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2dae81-472e-400e-8628-4c0449400419 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:50.457824 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2dae81-472e-400e-8628-4c0449400419 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:50.458165 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2dae81-472e-400e-8628-4c0449400419 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:50.521011 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 334/657] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:38:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:38:50.522387 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0a0d3-c120-41c6-86d8-e485c214eac2 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:50.522729 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0a0d3-c120-41c6-86d8-e485c214eac2 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:50.523060 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0a0d3-c120-41c6-86d8-e485c214eac2 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:50.528960 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 335/658] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:50.528960 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0a0d3-c120-41c6-86d8-e485c214eac2 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:50.538063 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2dae81-472e-400e-8628-4c0449400419 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:50.539517 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2dae81-472e-400e-8628-4c0449400419 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:50.601530 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:50.612563 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:50.641300 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0a0d3-c120-41c6-86d8-e485c214eac2 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:50.654696 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 324/659] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:38:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:38:50.655905 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2dae81-472e-400e-8628-4c0449400419 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:50.682065 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14f69f-4423-4036-b0b7-9673cd4c4165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:50.682711 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14f69f-4423-4036-b0b7-9673cd4c4165 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:50.682991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14f69f-4423-4036-b0b7-9673cd4c4165 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:50.683268 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14f69f-4423-4036-b0b7-9673cd4c4165 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:50.691932 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e14f69f-4423-4036-b0b7-9673cd4c4165 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:50.693365 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e14f69f-4423-4036-b0b7-9673cd4c4165 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:50.707151 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-9e14f69f-4423-4036-b0b7-9673cd4c4165 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 03 12:38:50.707151 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:50.707151 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:50.707151 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:50.707151 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:50.707151 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:50.707151 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:50.707151 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:50.707151 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:50.707151 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:50.707151 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:50.707151 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:50.707151 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:38:50.707151 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:38:50.707151 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:38:50.707151 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:38:50.708273 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:50.708273 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:50.708273 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:38:50.708273 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:38:50.708273 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:38:50.708273 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:38:50.708273 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:50.708273 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:50.708273 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:50.708273 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:50.708273 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:50.708273 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:50.708273 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:50.708273 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:50.708273 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:50.708273 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:50.708273 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:50.708273 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:50.709285 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:50.709285 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:50.709285 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:38:50.709285 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:38:50.709285 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:38:50.709285 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:38:50.709285 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:38:50.709285 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:38:50.709285 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 03 12:38:50.709285 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:50.709285 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 336/660] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 3 12:38:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:50.709943 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0010b5-0ef5-4b18-8a83-e53690a3d49b None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:50.709943 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0010b5-0ef5-4b18-8a83-e53690a3d49b None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:50.710081 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0010b5-0ef5-4b18-8a83-e53690a3d49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:50.728462 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-5d0010b5-0ef5-4b18-8a83-e53690a3d49b None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:50.729527 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-5d0010b5-0ef5-4b18-8a83-e53690a3d49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:50.766583 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2dae81-472e-400e-8628-4c0449400419 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:50.805912 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4caf1-c00d-4727-b399-6d628eddedce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:50.806116 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 337/661] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:50.806209 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4caf1-c00d-4727-b399-6d628eddedce None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:50.806290 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0010b5-0ef5-4b18-8a83-e53690a3d49b None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:50.806360 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4caf1-c00d-4727-b399-6d628eddedce None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:50.806360 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4caf1-c00d-4727-b399-6d628eddedce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:50.821418 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4caf1-c00d-4727-b399-6d628eddedce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:50.822921 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4caf1-c00d-4727-b399-6d628eddedce None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:50.844331 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-7da4caf1-c00d-4727-b399-6d628eddedce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:50.844331 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:50.844331 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:50.844331 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:50.844331 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:50.844331 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:50.844331 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:50.844331 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:50.844331 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:50.844331 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:50.844331 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:50.844331 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:50.844331 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:50.844331 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:50.844331 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:50.845246 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:50.845246 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:50.845246 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:50.845246 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:50.845246 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:50.845246 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:50.845246 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:50.845246 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:50.845246 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:50.845246 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:50.845246 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:50.845246 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:50.845246 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:50.845246 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:50.845246 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:50.845246 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:50.845246 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:50.846154 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:50.846154 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:50.846154 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:50.846154 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:50.849636 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 325/662] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:50.851406 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4caf1-c00d-4727-b399-6d628eddedce None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:50.865457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:50.878638 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:50.918001 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0010b5-0ef5-4b18-8a83-e53690a3d49b None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:50.953103 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49af2f-a100-4a66-a99a-7d6344fceff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:50.953783 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49af2f-a100-4a66-a99a-7d6344fceff5 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:50.954071 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49af2f-a100-4a66-a99a-7d6344fceff5 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:50.954350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49af2f-a100-4a66-a99a-7d6344fceff5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:50.965885 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4caf1-c00d-4727-b399-6d628eddedce None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:50.974353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e49af2f-a100-4a66-a99a-7d6344fceff5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:50.975822 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e49af2f-a100-4a66-a99a-7d6344fceff5 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:50.991979 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-9e49af2f-a100-4a66-a99a-7d6344fceff5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:50.991979 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:50.991979 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:50.991979 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:50.991979 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:50.991979 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:50.991979 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:50.991979 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:50.991979 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:50.991979 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:50.991979 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:50.991979 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:50.991979 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:50.991979 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:50.991979 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:50.993040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:50.993040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:50.993040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:50.993040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:50.993040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:50.993040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:50.993040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:50.993040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:50.993040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:50.993040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:50.993040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:50.993040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:50.993040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:50.993040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:50.993040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:50.993040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:50.993040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:50.994246 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:50.994246 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:50.994246 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:50.994246 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:50.997672 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 338/663] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:50.998864 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49af2f-a100-4a66-a99a-7d6344fceff5 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:51.006384 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e0915-01f0-48da-b9bf-4fe94b24ad9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:51.007226 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e0915-01f0-48da-b9bf-4fe94b24ad9f None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:51.007689 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e0915-01f0-48da-b9bf-4fe94b24ad9f None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:51.008154 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e0915-01f0-48da-b9bf-4fe94b24ad9f None admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:51.009123 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e0915-01f0-48da-b9bf-4fe94b24ad9f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:51.009645 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e0915-01f0-48da-b9bf-4fe94b24ad9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:51.011281 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e0915-01f0-48da-b9bf-4fe94b24ad9f None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:51.030957 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 326/664] 10.222.0.46 () {56 vars in 1139 bytes} [Wed Aug 3 12:38:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:51.031855 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e0915-01f0-48da-b9bf-4fe94b24ad9f None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:51.100427 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:51.107886 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49af2f-a100-4a66-a99a-7d6344fceff5 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:51.126408 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:51.138976 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e0915-01f0-48da-b9bf-4fe94b24ad9f None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:51.148018 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49f5a3-fa3f-4279-94c0-4a9a44942e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:51.149109 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49f5a3-fa3f-4279-94c0-4a9a44942e4b None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:51.149405 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49f5a3-fa3f-4279-94c0-4a9a44942e4b None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:51.150082 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49f5a3-fa3f-4279-94c0-4a9a44942e4b None admin] PATH_INFO: `/v3/roles/service` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:51.161149 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49f5a3-fa3f-4279-94c0-4a9a44942e4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:51.166531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-ab49f5a3-fa3f-4279-94c0-4a9a44942e4b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:38:51.166531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:51.166531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:51.166531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:51.166531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:51.166531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:51.166531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:51.166531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:51.166531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:51.166531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:51.166531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:51.166531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:51.166531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:51.166531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:51.166531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:51.166531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:51.167659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:51.167659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:51.167659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:51.167659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:51.167659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:51.167659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:51.167659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:51.167659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:51.167659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:51.167659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:51.167659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:51.167659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:51.167659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:51.167659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:51.167659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:51.167659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:51.169265 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:51.169265 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:51.169265 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:51.169265 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:51.169265 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:51.169265 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:51.169265 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:51.169265 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:51.169265 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:51.169265 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:51.169265 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:38:51.169265 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:51.173152 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 339/665] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 3 12:38:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:51.174068 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49f5a3-fa3f-4279-94c0-4a9a44942e4b None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:51.177352 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed8c9b-33d3-4228-baa5-ccad2685d64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:51.178278 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed8c9b-33d3-4228-baa5-ccad2685d64f None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:51.178412 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed8c9b-33d3-4228-baa5-ccad2685d64f None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:51.178722 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed8c9b-33d3-4228-baa5-ccad2685d64f None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:51.179481 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed8c9b-33d3-4228-baa5-ccad2685d64f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:51.179857 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed8c9b-33d3-4228-baa5-ccad2685d64f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:51.181272 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed8c9b-33d3-4228-baa5-ccad2685d64f None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:51.194743 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 327/666] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:51.195583 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed8c9b-33d3-4228-baa5-ccad2685d64f None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:51.284086 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49f5a3-fa3f-4279-94c0-4a9a44942e4b None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:51.311294 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed8c9b-33d3-4228-baa5-ccad2685d64f None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:51.321786 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539c6d1-a44d-45a7-9926-1b25abea5e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:51.322406 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539c6d1-a44d-45a7-9926-1b25abea5e9a None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:51.322685 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539c6d1-a44d-45a7-9926-1b25abea5e9a None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:51.322959 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539c6d1-a44d-45a7-9926-1b25abea5e9a None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:51.323654 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539c6d1-a44d-45a7-9926-1b25abea5e9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:51.323953 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539c6d1-a44d-45a7-9926-1b25abea5e9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:51.325568 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539c6d1-a44d-45a7-9926-1b25abea5e9a None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:51.337967 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:51.343027 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 340/667] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:51.343027 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539c6d1-a44d-45a7-9926-1b25abea5e9a None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:51.353192 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba75edf-6d45-41b1-809e-2ec474a9dc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:51.353936 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba75edf-6d45-41b1-809e-2ec474a9dc5c None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:51.354291 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba75edf-6d45-41b1-809e-2ec474a9dc5c None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:51.354634 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba75edf-6d45-41b1-809e-2ec474a9dc5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:51.379653 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:51.428198 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba75edf-6d45-41b1-809e-2ec474a9dc5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:51.429723 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba75edf-6d45-41b1-809e-2ec474a9dc5c None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:51.451521 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539c6d1-a44d-45a7-9926-1b25abea5e9a None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:51.487433 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611ee3a-5910-413c-9bb2-6ea5ed8ac1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:51.488060 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611ee3a-5910-413c-9bb2-6ea5ed8ac1c3 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:51.488344 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611ee3a-5910-413c-9bb2-6ea5ed8ac1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:51.488622 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611ee3a-5910-413c-9bb2-6ea5ed8ac1c3 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:51.489344 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4611ee3a-5910-413c-9bb2-6ea5ed8ac1c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:51.489679 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4611ee3a-5910-413c-9bb2-6ea5ed8ac1c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:51.491311 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4611ee3a-5910-413c-9bb2-6ea5ed8ac1c3 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:51.499452 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 341/668] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 3 12:38:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:51.500255 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611ee3a-5910-413c-9bb2-6ea5ed8ac1c3 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:51.545291 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 328/669] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:38:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:38:51.546082 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba75edf-6d45-41b1-809e-2ec474a9dc5c None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:51.572826 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:51.602817 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:51.607258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611ee3a-5910-413c-9bb2-6ea5ed8ac1c3 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:51.640394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20aaeed-6c76-4830-a7b2-d80d723be707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:51.641037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20aaeed-6c76-4830-a7b2-d80d723be707 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:51.641324 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20aaeed-6c76-4830-a7b2-d80d723be707 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:51.641639 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20aaeed-6c76-4830-a7b2-d80d723be707 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:51.644417 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba75edf-6d45-41b1-809e-2ec474a9dc5c None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:51.648398 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20aaeed-6c76-4830-a7b2-d80d723be707 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:51.649924 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20aaeed-6c76-4830-a7b2-d80d723be707 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:51.661791 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-d20aaeed-6c76-4830-a7b2-d80d723be707 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:38:51.661791 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:51.661791 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:51.661791 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:51.661791 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:51.661791 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:51.661791 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:51.661791 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:51.661791 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:51.661791 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:51.661791 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:51.661791 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:51.661791 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:38:51.661791 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:38:51.661791 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:38:51.662901 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:38:51.662901 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:51.662901 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:51.662901 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:51.662901 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:51.662901 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:51.662901 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:51.662901 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:51.662901 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:51.662901 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:51.662901 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:51.662901 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:51.662901 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:51.662901 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:51.662901 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:51.662901 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:51.662901 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:51.663818 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:38:51.663818 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:38:51.663818 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:38:51.663818 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:38:51.663818 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:38:51.663818 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:38:51.663818 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:38:51.663818 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:51.663818 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 342/670] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:38:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:51.664330 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20aaeed-6c76-4830-a7b2-d80d723be707 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:51.682010 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6fff4-9194-4063-a1f1-3fa298c20f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:51.682584 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6fff4-9194-4063-a1f1-3fa298c20f63 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:51.682869 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6fff4-9194-4063-a1f1-3fa298c20f63 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:51.683156 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6fff4-9194-4063-a1f1-3fa298c20f63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:51.690983 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6fff4-9194-4063-a1f1-3fa298c20f63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:51.692419 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6fff4-9194-4063-a1f1-3fa298c20f63 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:51.705517 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-eef6fff4-9194-4063-a1f1-3fa298c20f63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:38:51.705517 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:51.705517 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:51.705517 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:51.705517 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:51.705517 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:51.705517 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:51.705517 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:51.705517 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:51.705517 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:51.705517 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:51.705517 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:51.705517 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:38:51.705517 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:38:51.705517 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:38:51.706439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:38:51.706439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:51.706439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:51.706439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:51.706439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:51.706439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:51.706439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:51.706439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:51.706439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:51.706439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:51.706439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:51.706439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:51.706439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:51.706439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:51.706439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:51.706439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:51.706439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:51.707525 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:38:51.707525 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:38:51.707525 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:38:51.707525 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:38:51.707525 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:38:51.707525 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:38:51.707525 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:38:51.707525 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:51.707525 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 329/671] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:38:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:51.708176 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b3342-1234-40af-b236-3c2305d9b892 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:51.708176 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b3342-1234-40af-b236-3c2305d9b892 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:51.708454 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b3342-1234-40af-b236-3c2305d9b892 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:51.709876 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 330/672] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:51.710403 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b3342-1234-40af-b236-3c2305d9b892 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:51.771445 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20aaeed-6c76-4830-a7b2-d80d723be707 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:51.802809 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:51.804590 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383c202-9704-49ce-9272-f0a2c897ddf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:51.805349 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383c202-9704-49ce-9272-f0a2c897ddf7 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:51.805697 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383c202-9704-49ce-9272-f0a2c897ddf7 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:51.806005 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383c202-9704-49ce-9272-f0a2c897ddf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:51.815891 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b3342-1234-40af-b236-3c2305d9b892 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:51.816474 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383c202-9704-49ce-9272-f0a2c897ddf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:51.817952 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383c202-9704-49ce-9272-f0a2c897ddf7 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:51.832174 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-7383c202-9704-49ce-9272-f0a2c897ddf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:51.832174 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:51.832174 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:51.832174 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:51.832174 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:51.832174 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:51.832174 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:51.832174 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:51.832174 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:51.832174 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:51.832174 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:51.832174 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:51.832174 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:51.832174 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:51.832174 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:51.833218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:51.833218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:51.833218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:51.833218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:51.833218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:51.833218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:51.833218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:51.833218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:51.833218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:51.833218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:51.833218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:51.833218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:51.833218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:51.833218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:51.833218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:51.833218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:51.833218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:51.834307 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:51.834307 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:51.834307 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:51.834307 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:51.834307 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 343/673] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:51.834307 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383c202-9704-49ce-9272-f0a2c897ddf7 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:51.848714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:51.854136 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b1186-d22c-4555-8ac6-2cf00a577a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:51.854778 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b1186-d22c-4555-8ac6-2cf00a577a73 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:51.855064 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b1186-d22c-4555-8ac6-2cf00a577a73 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:51.855338 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b1186-d22c-4555-8ac6-2cf00a577a73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:51.865878 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b1186-d22c-4555-8ac6-2cf00a577a73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:51.867346 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b1186-d22c-4555-8ac6-2cf00a577a73 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:51.881694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-ae7b1186-d22c-4555-8ac6-2cf00a577a73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:51.881694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:51.881694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:51.881694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:51.881694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:51.881694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:51.881694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:51.881694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:51.881694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:51.881694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:51.881694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:51.881694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:51.881694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:51.881694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:51.881694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:51.882613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:51.882613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:51.882613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:51.882613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:51.882613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:51.882613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:51.882613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:51.882613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:51.882613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:51.882613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:51.882613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:51.882613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:51.882613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:51.882613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:51.882613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:51.882613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:51.882613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:51.883480 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:51.883480 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:51.883480 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:51.883480 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:51.883480 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 331/674] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:51.883759 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b1186-d22c-4555-8ac6-2cf00a577a73 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:51.937959 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383c202-9704-49ce-9272-f0a2c897ddf7 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:51.971477 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577e175-ba37-410c-a9f7-339488c56955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:51.972093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577e175-ba37-410c-a9f7-339488c56955 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:51.972399 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577e175-ba37-410c-a9f7-339488c56955 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:51.972647 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577e175-ba37-410c-a9f7-339488c56955 None admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:51.973394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577e175-ba37-410c-a9f7-339488c56955 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:51.973732 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577e175-ba37-410c-a9f7-339488c56955 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:51.975171 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577e175-ba37-410c-a9f7-339488c56955 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:51.986350 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b1186-d22c-4555-8ac6-2cf00a577a73 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:51.986879 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 344/675] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 3 12:38:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:51.988137 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d315d4d-5bd7-4228-844e-c49ab43985fe None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:51.988421 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d315d4d-5bd7-4228-844e-c49ab43985fe None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:51.988702 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d315d4d-5bd7-4228-844e-c49ab43985fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:52.005920 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-5d315d4d-5bd7-4228-844e-c49ab43985fe None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:52.007119 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-5d315d4d-5bd7-4228-844e-c49ab43985fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:52.021160 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbc2f3-fe7f-43cf-b3cd-8130ac555744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:52.021807 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbc2f3-fe7f-43cf-b3cd-8130ac555744 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:52.022092 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbc2f3-fe7f-43cf-b3cd-8130ac555744 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:52.022380 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbc2f3-fe7f-43cf-b3cd-8130ac555744 None admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:52.023119 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbc2f3-fe7f-43cf-b3cd-8130ac555744 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:52.023429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbc2f3-fe7f-43cf-b3cd-8130ac555744 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:52.024850 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbc2f3-fe7f-43cf-b3cd-8130ac555744 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:52.034555 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:52.038163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 332/676] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 3 12:38:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:52.038983 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbc2f3-fe7f-43cf-b3cd-8130ac555744 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:52.076149 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:52.081142 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 345/677] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:52.081993 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d315d4d-5bd7-4228-844e-c49ab43985fe None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:52.150524 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbc2f3-fe7f-43cf-b3cd-8130ac555744 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:52.183221 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af30c94-e11d-4b5f-8cd1-b895b497b8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:52.184447 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af30c94-e11d-4b5f-8cd1-b895b497b8d7 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:52.184735 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af30c94-e11d-4b5f-8cd1-b895b497b8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:52.185009 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af30c94-e11d-4b5f-8cd1-b895b497b8d7 None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:52.185729 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af30c94-e11d-4b5f-8cd1-b895b497b8d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:52.186031 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af30c94-e11d-4b5f-8cd1-b895b497b8d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:52.187159 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d315d4d-5bd7-4228-844e-c49ab43985fe None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:52.187826 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af30c94-e11d-4b5f-8cd1-b895b497b8d7 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:52.198440 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 333/678] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:52.199192 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af30c94-e11d-4b5f-8cd1-b895b497b8d7 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:52.223135 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a9ee2-ea9e-4507-bad5-0ff27cff29b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:52.223753 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a9ee2-ea9e-4507-bad5-0ff27cff29b1 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:52.224028 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a9ee2-ea9e-4507-bad5-0ff27cff29b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:52.224302 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a9ee2-ea9e-4507-bad5-0ff27cff29b1 None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:52.224993 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a9ee2-ea9e-4507-bad5-0ff27cff29b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:52.225297 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a9ee2-ea9e-4507-bad5-0ff27cff29b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:52.226698 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a9ee2-ea9e-4507-bad5-0ff27cff29b1 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:52.237440 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 346/679] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:52.238240 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a9ee2-ea9e-4507-bad5-0ff27cff29b1 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:52.262947 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:52.301040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:52.304313 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af30c94-e11d-4b5f-8cd1-b895b497b8d7 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:52.338105 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b98882-89ab-43b1-9b8e-8b2d273c610f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:52.338720 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b98882-89ab-43b1-9b8e-8b2d273c610f None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:52.339002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b98882-89ab-43b1-9b8e-8b2d273c610f None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:52.339281 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b98882-89ab-43b1-9b8e-8b2d273c610f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:52.340205 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b98882-89ab-43b1-9b8e-8b2d273c610f None admin] RBAC: Adding query filter params (role.id=39d74def259b415ca634ad9c715e1332, scope.project.id=6ac833dfff634496816842c851545d21, user.id=a2f23f4936684b63afc095986e43ec37) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:52.340522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b98882-89ab-43b1-9b8e-8b2d273c610f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:52.341976 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b98882-89ab-43b1-9b8e-8b2d273c610f None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:52.342968 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a9ee2-ea9e-4507-bad5-0ff27cff29b1 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:52.347652 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 334/680] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:38:52 2022] GET /identity/v3/role_assignments?user.id=a2f23f4936684b63afc095986e43ec37&scope.project.id=6ac833dfff634496816842c851545d21&role.id=39d74def259b415ca634ad9c715e1332 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:52.348429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b98882-89ab-43b1-9b8e-8b2d273c610f None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:52.384639 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc5ef9-239f-41c4-89af-8a19f638df09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:52.385459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc5ef9-239f-41c4-89af-8a19f638df09 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:52.385872 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc5ef9-239f-41c4-89af-8a19f638df09 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:52.386262 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc5ef9-239f-41c4-89af-8a19f638df09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:52.388013 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc5ef9-239f-41c4-89af-8a19f638df09 None admin] RBAC: Adding query filter params (role.id=39d74def259b415ca634ad9c715e1332, scope.project.id=6ac833dfff634496816842c851545d21, user.id=603adceaefb94e218cc1e683529a60b5) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:52.388410 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc5ef9-239f-41c4-89af-8a19f638df09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:52.390022 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc5ef9-239f-41c4-89af-8a19f638df09 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:52.409526 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 347/681] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:38:52 2022] GET /identity/v3/role_assignments?user.id=603adceaefb94e218cc1e683529a60b5&scope.project.id=6ac833dfff634496816842c851545d21&role.id=39d74def259b415ca634ad9c715e1332 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:52.409526 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc5ef9-239f-41c4-89af-8a19f638df09 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:52.483697 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b98882-89ab-43b1-9b8e-8b2d273c610f None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:52.514143 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:52.529677 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15902416-9023-42d6-9e5c-39c354314129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:52.530664 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15902416-9023-42d6-9e5c-39c354314129 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:52.531056 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15902416-9023-42d6-9e5c-39c354314129 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:52.531444 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15902416-9023-42d6-9e5c-39c354314129 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:52.545222 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15902416-9023-42d6-9e5c-39c354314129 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:52.550937 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-15902416-9023-42d6-9e5c-39c354314129 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:38:52.550937 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:52.550937 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:52.550937 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:52.550937 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:52.550937 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:52.550937 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:52.550937 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:52.550937 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:52.550937 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:52.550937 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:52.550937 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:52.550937 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:52.550937 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:52.550937 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:52.550937 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:52.551943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:52.551943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:52.551943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:52.551943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:52.551943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:52.551943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:52.551943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:52.551943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:52.551943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:52.551943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:52.551943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:52.551943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:52.551943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:52.551943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:52.551943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:52.551943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:52.552766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:52.552766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:52.552766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:52.552766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:52.552766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:52.552766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:52.552766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:52.552766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:52.552766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:52.552766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:52.552766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:38:52.552766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:52.552766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 335/682] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 3 12:38:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:52.553461 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15902416-9023-42d6-9e5c-39c354314129 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:52.578190 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc5ef9-239f-41c4-89af-8a19f638df09 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:52.613320 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:52.628915 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec681e-e626-44ac-aafa-591ca0821e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:52.629628 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec681e-e626-44ac-aafa-591ca0821e83 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:52.629908 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec681e-e626-44ac-aafa-591ca0821e83 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:52.630600 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec681e-e626-44ac-aafa-591ca0821e83 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:52.639100 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec681e-e626-44ac-aafa-591ca0821e83 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:52.640659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec681e-e626-44ac-aafa-591ca0821e83 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:52.654630 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-9fec681e-e626-44ac-aafa-591ca0821e83 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 03 12:38:52.654630 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:52.654630 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:52.654630 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:52.654630 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:52.654630 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:52.654630 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:52.654630 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:52.654630 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:52.654630 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:52.654630 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:52.654630 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:52.654630 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:38:52.654630 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:38:52.654630 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:38:52.654630 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:38:52.655882 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:52.655882 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:52.655882 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:38:52.655882 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:38:52.655882 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:38:52.655882 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:38:52.655882 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:52.655882 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:52.655882 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:52.655882 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:52.655882 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:52.655882 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:52.655882 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:52.655882 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:52.655882 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:52.655882 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:52.655882 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:52.655882 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:52.657024 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:52.657024 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:52.657024 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:38:52.657024 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:38:52.657024 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:38:52.657024 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:38:52.657024 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:38:52.657024 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:38:52.657024 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 03 12:38:52.657024 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:52.657024 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 348/683] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 3 12:38:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:52.657024 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec681e-e626-44ac-aafa-591ca0821e83 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:52.682740 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15902416-9023-42d6-9e5c-39c354314129 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:52.726785 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba3c4b-4a43-422a-8e78-e772a58f7e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:52.727590 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba3c4b-4a43-422a-8e78-e772a58f7e70 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:52.727877 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba3c4b-4a43-422a-8e78-e772a58f7e70 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:52.728148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba3c4b-4a43-422a-8e78-e772a58f7e70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:52.738181 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba3c4b-4a43-422a-8e78-e772a58f7e70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:52.740504 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba3c4b-4a43-422a-8e78-e772a58f7e70 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:52.756716 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-54ba3c4b-4a43-422a-8e78-e772a58f7e70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:38:52.756716 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:52.756716 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:52.756716 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:52.756716 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:52.756716 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:52.756716 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:52.756716 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:52.756716 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:52.756716 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:52.756716 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:52.756716 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:52.756716 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:38:52.756716 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:38:52.756716 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:38:52.757910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:38:52.757910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:52.757910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:52.757910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:52.757910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:52.757910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:52.757910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:52.757910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:52.757910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:52.757910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:52.757910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:52.757910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:52.757910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:52.757910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:52.757910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:52.757910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:52.757910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:52.758994 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:38:52.758994 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:38:52.758994 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:38:52.758994 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:38:52.758994 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:38:52.758994 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:38:52.758994 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:38:52.758994 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:52.758994 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 336/684] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:38:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:52.759487 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba3c4b-4a43-422a-8e78-e772a58f7e70 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:52.770287 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec681e-e626-44ac-aafa-591ca0821e83 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:52.817937 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:52.823572 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa794e-4732-482f-a26e-995beac6094a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:52.824709 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa794e-4732-482f-a26e-995beac6094a None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:52.825100 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa794e-4732-482f-a26e-995beac6094a None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:52.825578 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa794e-4732-482f-a26e-995beac6094a None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:52.826312 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa794e-4732-482f-a26e-995beac6094a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:52.826615 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa794e-4732-482f-a26e-995beac6094a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:52.827984 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa794e-4732-482f-a26e-995beac6094a None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:52.845436 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 349/685] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:38:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:52.845436 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa794e-4732-482f-a26e-995beac6094a None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:52.897659 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba3c4b-4a43-422a-8e78-e772a58f7e70 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:52.914244 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:52.951701 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4e466-124d-4617-8d2c-30f012453a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:52.952343 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4e466-124d-4617-8d2c-30f012453a49 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:52.952627 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4e466-124d-4617-8d2c-30f012453a49 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:52.952905 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4e466-124d-4617-8d2c-30f012453a49 None admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:52.953750 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e4e466-124d-4617-8d2c-30f012453a49 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:52.954061 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e4e466-124d-4617-8d2c-30f012453a49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:52.954659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa794e-4732-482f-a26e-995beac6094a None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:52.955510 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e4e466-124d-4617-8d2c-30f012453a49 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:52.981628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 337/686] 10.222.0.46 () {56 vars in 1135 bytes} [Wed Aug 3 12:38:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:52.983426 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4e466-124d-4617-8d2c-30f012453a49 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:52.993174 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcc786-f2fe-4397-8068-7d63ab8295f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:52.993842 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcc786-f2fe-4397-8068-7d63ab8295f5 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:52.994123 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcc786-f2fe-4397-8068-7d63ab8295f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:52.994401 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcc786-f2fe-4397-8068-7d63ab8295f5 None admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:52.995163 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bcc786-f2fe-4397-8068-7d63ab8295f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:52.995476 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bcc786-f2fe-4397-8068-7d63ab8295f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:52.997013 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bcc786-f2fe-4397-8068-7d63ab8295f5 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:53.010292 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 350/687] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 3 12:38:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:53.011215 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcc786-f2fe-4397-8068-7d63ab8295f5 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:53.126074 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcc786-f2fe-4397-8068-7d63ab8295f5 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:53.134824 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:53.166116 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d7bff-ccd7-48dc-b1a7-16e7bb605f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:53.166713 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d7bff-ccd7-48dc-b1a7-16e7bb605f52 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:53.167049 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d7bff-ccd7-48dc-b1a7-16e7bb605f52 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:53.167334 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d7bff-ccd7-48dc-b1a7-16e7bb605f52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:53.231329 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4e466-124d-4617-8d2c-30f012453a49 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:53.233581 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:53.240821 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d7bff-ccd7-48dc-b1a7-16e7bb605f52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:53.242320 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d7bff-ccd7-48dc-b1a7-16e7bb605f52 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:53.278843 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91155615-6789-4c5d-aadd-7acfdb70e340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:53.279721 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91155615-6789-4c5d-aadd-7acfdb70e340 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:53.280149 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91155615-6789-4c5d-aadd-7acfdb70e340 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:53.280662 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91155615-6789-4c5d-aadd-7acfdb70e340 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:53.292411 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91155615-6789-4c5d-aadd-7acfdb70e340 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:53.294178 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91155615-6789-4c5d-aadd-7acfdb70e340 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:53.310224 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-91155615-6789-4c5d-aadd-7acfdb70e340 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:53.310224 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:53.310224 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:53.310224 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:53.310224 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:53.310224 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:53.310224 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:53.310224 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:53.310224 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:53.310224 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:53.310224 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:53.310224 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:53.310224 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:53.310224 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:53.310224 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:53.311297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:53.311297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:53.311297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:53.311297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:53.311297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:53.311297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:53.311297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:53.311297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:53.311297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:53.311297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:53.311297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:53.311297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:53.311297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:53.311297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:53.311297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:53.311297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:53.311297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:53.312355 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:53.312355 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:53.312355 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:53.312355 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:53.317599 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 338/688] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:53.318689 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91155615-6789-4c5d-aadd-7acfdb70e340 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:53.346315 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 351/689] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:38:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:38:53.347158 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d7bff-ccd7-48dc-b1a7-16e7bb605f52 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:53.355139 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:53.433254 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91155615-6789-4c5d-aadd-7acfdb70e340 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:53.451221 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d7bff-ccd7-48dc-b1a7-16e7bb605f52 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:53.471804 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff3e71-06fe-40a3-a351-2e48b23b3146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:53.472689 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff3e71-06fe-40a3-a351-2e48b23b3146 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:53.473116 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff3e71-06fe-40a3-a351-2e48b23b3146 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:53.473604 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff3e71-06fe-40a3-a351-2e48b23b3146 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:53.474540 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff3e71-06fe-40a3-a351-2e48b23b3146 None admin] RBAC: Adding query filter params (role.id=39d74def259b415ca634ad9c715e1332, scope.project.id=6ac833dfff634496816842c851545d21, user.id=e0cd747cb5f64ff7b5f8d67d3d640fc5) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:53.475131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff3e71-06fe-40a3-a351-2e48b23b3146 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:53.476819 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff3e71-06fe-40a3-a351-2e48b23b3146 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:53.489530 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 339/690] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:38:53 2022] GET /identity/v3/role_assignments?user.id=e0cd747cb5f64ff7b5f8d67d3d640fc5&scope.project.id=6ac833dfff634496816842c851545d21&role.id=39d74def259b415ca634ad9c715e1332 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:53.489530 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff3e71-06fe-40a3-a351-2e48b23b3146 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:53.497735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f59cb2-fec7-4847-883e-096a3d17c249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:53.498479 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f59cb2-fec7-4847-883e-096a3d17c249 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:53.498837 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f59cb2-fec7-4847-883e-096a3d17c249 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:53.499183 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f59cb2-fec7-4847-883e-096a3d17c249 None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:53.499990 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f59cb2-fec7-4847-883e-096a3d17c249 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:53.501986 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f59cb2-fec7-4847-883e-096a3d17c249 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:53.505938 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f59cb2-fec7-4847-883e-096a3d17c249 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:53.530030 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 352/691] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:53.536632 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f59cb2-fec7-4847-883e-096a3d17c249 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:53.539109 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:53.672321 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:53.713165 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff3e71-06fe-40a3-a351-2e48b23b3146 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:53.722647 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f59cb2-fec7-4847-883e-096a3d17c249 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:53.763846 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203efa10-861a-40df-a2ce-d6ba323a221c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:53.764446 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203efa10-861a-40df-a2ce-d6ba323a221c None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:53.764729 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203efa10-861a-40df-a2ce-d6ba323a221c None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:53.765007 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203efa10-861a-40df-a2ce-d6ba323a221c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:53.773872 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603fb38-a4ee-4b34-b746-d682d15717ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:53.775255 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603fb38-a4ee-4b34-b746-d682d15717ff None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:53.775766 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603fb38-a4ee-4b34-b746-d682d15717ff None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:53.776535 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603fb38-a4ee-4b34-b746-d682d15717ff None admin] PATH_INFO: `/v3/users/nova` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:53.777131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203efa10-861a-40df-a2ce-d6ba323a221c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:53.778831 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203efa10-861a-40df-a2ce-d6ba323a221c None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:53.786842 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603fb38-a4ee-4b34-b746-d682d15717ff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:53.789176 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603fb38-a4ee-4b34-b746-d682d15717ff None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:53.795939 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-203efa10-861a-40df-a2ce-d6ba323a221c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:53.795939 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:53.795939 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:53.795939 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:53.795939 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:53.795939 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:53.795939 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:53.795939 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:53.795939 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:53.795939 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:53.795939 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:53.795939 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:53.795939 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:53.795939 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:53.795939 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:53.796931 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:53.796931 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:53.796931 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:53.796931 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:53.796931 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:53.796931 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:53.796931 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:53.796931 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:53.796931 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:53.796931 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:53.796931 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:53.796931 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:53.796931 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:53.796931 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:53.796931 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:53.796931 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:53.796931 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:53.798297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:53.798297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:53.798297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:53.798297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:53.798297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 340/692] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:53.804113 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203efa10-861a-40df-a2ce-d6ba323a221c None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:53.808083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-b603fb38-a4ee-4b34-b746-d682d15717ff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:38:53.808083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:53.808083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:53.808083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:53.808083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:53.808083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:53.808083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:53.808083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:53.808083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:53.808083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:53.808083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:53.808083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:53.808083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:38:53.808083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:38:53.808083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:38:53.808083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:38:53.809619 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:53.809619 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:53.809619 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:38:53.809619 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:38:53.809619 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:38:53.809619 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:38:53.809619 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:53.809619 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:53.809619 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:53.809619 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:53.809619 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:53.809619 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:53.809619 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:53.809619 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:53.809619 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:53.809619 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:53.809619 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:53.809619 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:53.810659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:53.810659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:53.810659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:38:53.810659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:38:53.810659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:38:53.810659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:38:53.810659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:38:53.810659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:38:53.810659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:38:53.810659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:53.811186 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 353/693] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Aug 3 12:38:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:53.817351 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603fb38-a4ee-4b34-b746-d682d15717ff None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:53.902619 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:53.955191 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603fb38-a4ee-4b34-b746-d682d15717ff None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:53.960192 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203efa10-861a-40df-a2ce-d6ba323a221c None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:54.004605 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:54.020546 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ef582-0b00-4ba4-9951-9cb680f36f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:54.021966 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ef582-0b00-4ba4-9951-9cb680f36f0b None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:54.022780 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ef582-0b00-4ba4-9951-9cb680f36f0b None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:54.024117 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a9f81-3194-4dd4-aef9-a2bc36b80f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:54.024625 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ef582-0b00-4ba4-9951-9cb680f36f0b None admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:54.025669 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ef582-0b00-4ba4-9951-9cb680f36f0b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:54.026479 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a9f81-3194-4dd4-aef9-a2bc36b80f4d None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:54.026979 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a9f81-3194-4dd4-aef9-a2bc36b80f4d None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:54.027529 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ef582-0b00-4ba4-9951-9cb680f36f0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:54.028270 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a9f81-3194-4dd4-aef9-a2bc36b80f4d None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:54.030103 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ef582-0b00-4ba4-9951-9cb680f36f0b None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:54.031018 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a9f81-3194-4dd4-aef9-a2bc36b80f4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:54.031544 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a9f81-3194-4dd4-aef9-a2bc36b80f4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:54.033091 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a9f81-3194-4dd4-aef9-a2bc36b80f4d None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:54.061930 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 341/694] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:54.066148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a9f81-3194-4dd4-aef9-a2bc36b80f4d None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:54.072075 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 354/695] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Aug 3 12:38:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:54.076165 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ef582-0b00-4ba4-9951-9cb680f36f0b None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:54.236589 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ef582-0b00-4ba4-9951-9cb680f36f0b None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:54.252971 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a9f81-3194-4dd4-aef9-a2bc36b80f4d None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:54.281566 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbaf5f6-65e8-42a3-b27d-0db640bdca55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:54.282195 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbaf5f6-65e8-42a3-b27d-0db640bdca55 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:54.282526 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbaf5f6-65e8-42a3-b27d-0db640bdca55 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:54.282806 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbaf5f6-65e8-42a3-b27d-0db640bdca55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:54.308579 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:54.320546 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9cb86-38fc-4145-b7df-0cb6b0368467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:54.321126 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9cb86-38fc-4145-b7df-0cb6b0368467 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:54.321407 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9cb86-38fc-4145-b7df-0cb6b0368467 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:54.321712 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9cb86-38fc-4145-b7df-0cb6b0368467 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:54.330328 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9cb86-38fc-4145-b7df-0cb6b0368467 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:54.331932 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9cb86-38fc-4145-b7df-0cb6b0368467 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:54.346680 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-1bc9cb86-38fc-4145-b7df-0cb6b0368467 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:38:54.346680 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:54.346680 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:54.346680 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:54.346680 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:54.346680 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:54.346680 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:54.346680 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:54.346680 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:54.346680 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:54.346680 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:54.346680 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:54.346680 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:38:54.346680 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:38:54.346680 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:38:54.347602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:38:54.347602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:54.347602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:54.347602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:54.347602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:54.347602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:54.347602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:54.347602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:54.347602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:54.347602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:54.347602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:54.347602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:54.347602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:54.347602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:54.347602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:54.347602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:54.347602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:54.348893 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:38:54.348893 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:38:54.348893 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:38:54.348893 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:38:54.348893 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:38:54.348893 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:38:54.348893 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:38:54.348893 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:54.348893 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 342/696] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:38:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:54.353660 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9cb86-38fc-4145-b7df-0cb6b0368467 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:54.418090 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:54.466323 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbaf5f6-65e8-42a3-b27d-0db640bdca55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:54.467799 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbaf5f6-65e8-42a3-b27d-0db640bdca55 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:54.468730 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9cb86-38fc-4145-b7df-0cb6b0368467 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:54.511926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4710b29-bd66-48ec-b501-ecf615288aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:54.512561 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4710b29-bd66-48ec-b501-ecf615288aec None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:54.512839 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4710b29-bd66-48ec-b501-ecf615288aec None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:54.513115 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4710b29-bd66-48ec-b501-ecf615288aec None admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:54.513908 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4710b29-bd66-48ec-b501-ecf615288aec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:54.514220 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4710b29-bd66-48ec-b501-ecf615288aec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:54.515655 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4710b29-bd66-48ec-b501-ecf615288aec None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:54.546670 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 343/697] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 3 12:38:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:54.556808 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4710b29-bd66-48ec-b501-ecf615288aec None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:54.616703 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:54.638437 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 355/698] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:38:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:38:54.639737 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47027a7a-f525-4ace-9f4a-e08d9073aecf None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:54.640025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47027a7a-f525-4ace-9f4a-e08d9073aecf None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:54.640302 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47027a7a-f525-4ace-9f4a-e08d9073aecf None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:54.641830 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 356/699] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:54.643495 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47027a7a-f525-4ace-9f4a-e08d9073aecf None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:54.674358 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4710b29-bd66-48ec-b501-ecf615288aec None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:54.710103 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3860b7b-8d17-4dc5-9508-f3e02fedc4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:54.710717 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3860b7b-8d17-4dc5-9508-f3e02fedc4ad None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:54.710995 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3860b7b-8d17-4dc5-9508-f3e02fedc4ad None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:54.711264 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3860b7b-8d17-4dc5-9508-f3e02fedc4ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:54.712050 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3860b7b-8d17-4dc5-9508-f3e02fedc4ad None admin] RBAC: Adding query filter params (role.id=39d74def259b415ca634ad9c715e1332, scope.project.id=6ac833dfff634496816842c851545d21, user.id=67df369737ea4c83bae134f4bf2de20d) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:54.712355 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3860b7b-8d17-4dc5-9508-f3e02fedc4ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:54.713796 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3860b7b-8d17-4dc5-9508-f3e02fedc4ad None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:54.725779 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 344/700] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:38:54 2022] GET /identity/v3/role_assignments?user.id=67df369737ea4c83bae134f4bf2de20d&scope.project.id=6ac833dfff634496816842c851545d21&role.id=39d74def259b415ca634ad9c715e1332 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:54.727236 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acf08b-7034-4827-9feb-0aea91224a4b None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:54.727521 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acf08b-7034-4827-9feb-0aea91224a4b None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:54.727859 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acf08b-7034-4827-9feb-0aea91224a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:54.735108 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:54.753935 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-e3acf08b-7034-4827-9feb-0aea91224a4b None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:54.755228 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-e3acf08b-7034-4827-9feb-0aea91224a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:54.764643 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47027a7a-f525-4ace-9f4a-e08d9073aecf None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:54.803314 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75918509-626c-425c-b6d1-0dd4ff0d8dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:54.804039 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75918509-626c-425c-b6d1-0dd4ff0d8dff None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:54.804335 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75918509-626c-425c-b6d1-0dd4ff0d8dff None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:54.804618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75918509-626c-425c-b6d1-0dd4ff0d8dff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:54.816472 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75918509-626c-425c-b6d1-0dd4ff0d8dff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:54.818093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75918509-626c-425c-b6d1-0dd4ff0d8dff None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:54.835550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-75918509-626c-425c-b6d1-0dd4ff0d8dff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:54.835550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:54.835550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:54.835550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:54.835550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:54.835550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:54.835550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:54.835550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:54.835550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:54.835550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:54.835550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:54.835550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:54.835550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:54.835550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:54.835550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:54.836485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:54.836485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:54.836485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:54.836485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:54.836485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:54.836485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:54.836485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:54.836485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:54.836485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:54.836485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:54.836485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:54.836485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:54.836485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:54.836485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:54.836485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:54.836485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:54.836485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:54.837366 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:54.837366 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:54.837366 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:54.837366 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:54.837366 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 357/702] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:38:54.838643 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57d66a-2544-4645-8783-be28538d9dc3 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:54.838984 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57d66a-2544-4645-8783-be28538d9dc3 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:54.839265 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57d66a-2544-4645-8783-be28538d9dc3 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:54.841538 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 358/703] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:54.841719 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 345/703] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:54.846763 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d26e5f-dc5f-4040-b35e-0bb8fd8d2e6e None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:54.847077 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acf08b-7034-4827-9feb-0aea91224a4b None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:54.847223 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d26e5f-dc5f-4040-b35e-0bb8fd8d2e6e None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:54.847651 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d26e5f-dc5f-4040-b35e-0bb8fd8d2e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:54.868215 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-64d26e5f-dc5f-4040-b35e-0bb8fd8d2e6e None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:54.869646 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-64d26e5f-dc5f-4040-b35e-0bb8fd8d2e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:54.907256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:54.956251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 359/704] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:54.957352 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d26e5f-dc5f-4040-b35e-0bb8fd8d2e6e None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:54.982957 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acf08b-7034-4827-9feb-0aea91224a4b None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:55.034943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350fb490-03c4-46b5-91bd-316b039be93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:55.036207 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fb490-03c4-46b5-91bd-316b039be93f None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:55.036493 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fb490-03c4-46b5-91bd-316b039be93f None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:55.036762 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fb490-03c4-46b5-91bd-316b039be93f None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:55.037473 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350fb490-03c4-46b5-91bd-316b039be93f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:55.037852 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350fb490-03c4-46b5-91bd-316b039be93f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:55.039682 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350fb490-03c4-46b5-91bd-316b039be93f None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:55.056541 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:55.056784 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 346/705] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:38:55.057746 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350fb490-03c4-46b5-91bd-316b039be93f None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:55.101626 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d26e5f-dc5f-4040-b35e-0bb8fd8d2e6e None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:55.146861 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6d608-5752-4afa-a936-d22f1b5d6a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:55.147889 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6d608-5752-4afa-a936-d22f1b5d6a14 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:55.148320 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6d608-5752-4afa-a936-d22f1b5d6a14 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:55.149041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6d608-5752-4afa-a936-d22f1b5d6a14 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:55.149848 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6d608-5752-4afa-a936-d22f1b5d6a14 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:55.151383 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6d608-5752-4afa-a936-d22f1b5d6a14 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:55.164104 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350fb490-03c4-46b5-91bd-316b039be93f None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:55.165981 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-64c6d608-5752-4afa-a936-d22f1b5d6a14 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 03 12:38:55.165981 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:55.165981 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:38:55.165981 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:38:55.165981 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:38:55.165981 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:38:55.165981 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:38:55.165981 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:38:55.165981 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 03 12:38:55.165981 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:55.165981 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:38:55.165981 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:55.165981 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:55.165981 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:55.165981 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:55.165981 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:55.167090 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:55.167090 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:55.167090 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:55.167090 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:55.167090 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:55.167090 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:55.167090 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:55.167090 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:38:55.167090 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:38:55.167090 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:38:55.167090 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:38:55.167090 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:55.167090 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:55.167090 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:55.167090 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:55.167090 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:55.168171 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:55.168171 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:55.168171 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:55.168171 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:55.168171 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:55.168171 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:55.168171 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:55.168171 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:55.168171 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:55.168171 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:55.168171 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:55.168171 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:38:55.168171 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:38:55.168171 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 03 12:38:55.168171 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:55.169039 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:55.171003 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 360/706] 10.222.0.46 () {56 vars in 1129 bytes} [Wed Aug 3 12:38:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:55.174299 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6d608-5752-4afa-a936-d22f1b5d6a14 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:55.204918 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f1cc6-baf9-46b3-a3ba-2349dc611d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:55.205598 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f1cc6-baf9-46b3-a3ba-2349dc611d67 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:55.205923 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f1cc6-baf9-46b3-a3ba-2349dc611d67 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:55.206151 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f1cc6-baf9-46b3-a3ba-2349dc611d67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:55.217694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f1cc6-baf9-46b3-a3ba-2349dc611d67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:55.219204 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f1cc6-baf9-46b3-a3ba-2349dc611d67 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:55.234454 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-eb8f1cc6-baf9-46b3-a3ba-2349dc611d67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:55.234454 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:55.234454 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:55.234454 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:55.234454 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:55.234454 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:55.234454 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:55.234454 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:55.234454 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:55.234454 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:55.234454 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:55.234454 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:55.234454 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:55.234454 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:55.234454 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:55.235399 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:55.235399 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:55.235399 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:55.235399 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:55.235399 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:55.235399 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:55.235399 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:55.235399 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:55.235399 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:55.235399 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:55.235399 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:55.235399 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:55.235399 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:55.235399 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:55.235399 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:55.235399 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:55.235399 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:55.236288 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:55.236288 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:55.236288 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:55.236288 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:55.240721 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 347/707] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:55.241602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f1cc6-baf9-46b3-a3ba-2349dc611d67 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:55.303227 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6d608-5752-4afa-a936-d22f1b5d6a14 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:55.339583 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:55.347257 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfdd492-27a5-4e17-acda-ff1b60851f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:55.348004 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdd492-27a5-4e17-acda-ff1b60851f21 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:55.348355 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdd492-27a5-4e17-acda-ff1b60851f21 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:55.348640 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdd492-27a5-4e17-acda-ff1b60851f21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:55.356645 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfdd492-27a5-4e17-acda-ff1b60851f21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:55.358583 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfdd492-27a5-4e17-acda-ff1b60851f21 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:55.372284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-6bfdd492-27a5-4e17-acda-ff1b60851f21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:38:55.372284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:55.372284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:55.372284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:55.372284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:55.372284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:55.372284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:55.372284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:55.372284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:55.372284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:55.372284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:55.372284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:55.372284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:38:55.372284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:38:55.372284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:38:55.373305 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:38:55.373305 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:55.373305 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:55.373305 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:55.373305 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:55.373305 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:55.373305 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:55.373305 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:55.373305 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:55.373305 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:55.373305 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:55.373305 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:55.373305 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:55.373305 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:55.373305 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:55.373305 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:55.373305 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:55.374255 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:38:55.374255 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:38:55.374255 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:38:55.374255 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:38:55.374255 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:38:55.374255 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:38:55.374255 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:38:55.374255 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:55.377776 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 361/708] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:38:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:55.378722 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfdd492-27a5-4e17-acda-ff1b60851f21 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:55.383906 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f1cc6-baf9-46b3-a3ba-2349dc611d67 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:55.429226 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef63cd2-2eab-436b-80b6-343acd9cdcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:55.430465 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef63cd2-2eab-436b-80b6-343acd9cdcd6 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:55.431419 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef63cd2-2eab-436b-80b6-343acd9cdcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:55.431899 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef63cd2-2eab-436b-80b6-343acd9cdcd6 None admin] PATH_INFO: `/v3/services` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:55.433056 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef63cd2-2eab-436b-80b6-343acd9cdcd6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:55.434406 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef63cd2-2eab-436b-80b6-343acd9cdcd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:55.435803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef63cd2-2eab-436b-80b6-343acd9cdcd6 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:55.441075 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 348/709] 10.222.0.46 () {56 vars in 1124 bytes} [Wed Aug 3 12:38:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:55.442050 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef63cd2-2eab-436b-80b6-343acd9cdcd6 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:55.465892 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:55.503501 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfdd492-27a5-4e17-acda-ff1b60851f21 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:55.548673 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560913c-8e2b-481c-9d4c-001aeda5ec26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:55.549805 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560913c-8e2b-481c-9d4c-001aeda5ec26 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:55.550251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560913c-8e2b-481c-9d4c-001aeda5ec26 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:55.550678 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560913c-8e2b-481c-9d4c-001aeda5ec26 None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:55.551394 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef63cd2-2eab-436b-80b6-343acd9cdcd6 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:55.551712 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560913c-8e2b-481c-9d4c-001aeda5ec26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:55.552160 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560913c-8e2b-481c-9d4c-001aeda5ec26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:55.553864 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560913c-8e2b-481c-9d4c-001aeda5ec26 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:55.570413 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 362/710] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:55.571806 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560913c-8e2b-481c-9d4c-001aeda5ec26 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:55.593882 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268d840-c76d-42b1-a60f-b9546d51c255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:55.594621 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268d840-c76d-42b1-a60f-b9546d51c255 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:55.595083 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268d840-c76d-42b1-a60f-b9546d51c255 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:55.595450 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268d840-c76d-42b1-a60f-b9546d51c255 None admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:55.596376 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268d840-c76d-42b1-a60f-b9546d51c255 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:55.596790 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268d840-c76d-42b1-a60f-b9546d51c255 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:55.598354 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268d840-c76d-42b1-a60f-b9546d51c255 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:55.617398 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 349/711] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 3 12:38:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:55.618479 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268d840-c76d-42b1-a60f-b9546d51c255 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:55.634426 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:55.693224 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560913c-8e2b-481c-9d4c-001aeda5ec26 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:55.715803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:55.733766 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa0f02-6227-4f0e-990f-70850b20edc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:55.734815 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa0f02-6227-4f0e-990f-70850b20edc2 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:55.735317 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa0f02-6227-4f0e-990f-70850b20edc2 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:55.735839 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa0f02-6227-4f0e-990f-70850b20edc2 None admin] PATH_INFO: `/v3/services` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:55.736743 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa0f02-6227-4f0e-990f-70850b20edc2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:55.737314 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa0f02-6227-4f0e-990f-70850b20edc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:55.739138 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa0f02-6227-4f0e-990f-70850b20edc2 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:55.742166 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268d840-c76d-42b1-a60f-b9546d51c255 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:55.747059 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 363/712] 10.222.0.46 () {56 vars in 1124 bytes} [Wed Aug 3 12:38:55 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:55.748347 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa0f02-6227-4f0e-990f-70850b20edc2 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:55.788153 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4bc39-3835-43cc-8c66-6c469af3f7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:55.789603 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4bc39-3835-43cc-8c66-6c469af3f7df None admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:55.789900 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4bc39-3835-43cc-8c66-6c469af3f7df None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:55.790182 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4bc39-3835-43cc-8c66-6c469af3f7df None admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:55.790896 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd4bc39-3835-43cc-8c66-6c469af3f7df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:55.792379 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd4bc39-3835-43cc-8c66-6c469af3f7df None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:55.831886 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 350/713] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Aug 3 12:38:55 2022] POST /identity/v3/users => generated 254 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:38:55.885943 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa0f02-6227-4f0e-990f-70850b20edc2 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:55.913780 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:55.946489 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831a287-4508-4b83-9c00-4d524fa84f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:55.947043 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831a287-4508-4b83-9c00-4d524fa84f16 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:55.947322 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831a287-4508-4b83-9c00-4d524fa84f16 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:55.947598 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831a287-4508-4b83-9c00-4d524fa84f16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:55.948479 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8831a287-4508-4b83-9c00-4d524fa84f16 None admin] RBAC: Adding query filter params (role.id=0e57d142f86c471883fc07a89fe66ec8, scope.project.id=6ac833dfff634496816842c851545d21, user.id=dcf670ff4f62486dbf70cf6ea0f08bbb) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:55.948796 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8831a287-4508-4b83-9c00-4d524fa84f16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:55.950915 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8831a287-4508-4b83-9c00-4d524fa84f16 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:55.952817 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51dc9a-99a5-4899-9b0c-acc307eb7252 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:55.953113 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51dc9a-99a5-4899-9b0c-acc307eb7252 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:55.953392 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51dc9a-99a5-4899-9b0c-acc307eb7252 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:55.955059 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 351/714] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:55.961658 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2400a6-4d38-4cee-89f8-4db3f10a9c2a None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:55.961961 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2400a6-4d38-4cee-89f8-4db3f10a9c2a None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:55.962222 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2400a6-4d38-4cee-89f8-4db3f10a9c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:55.964917 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 364/715] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:38:55 2022] GET /identity/v3/role_assignments?user.id=dcf670ff4f62486dbf70cf6ea0f08bbb&scope.project.id=6ac833dfff634496816842c851545d21&role.id=0e57d142f86c471883fc07a89fe66ec8 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:56.003357 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-9e2400a6-4d38-4cee-89f8-4db3f10a9c2a None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:56.004618 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-9e2400a6-4d38-4cee-89f8-4db3f10a9c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:56.101392 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 352/716] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:38:56.125042 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831a287-4508-4b83-9c00-4d524fa84f16 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:56.243026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831a287-4508-4b83-9c00-4d524fa84f16 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:56.286698 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d72628-503f-4ad5-b135-f091bd1e707c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:56.287413 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d72628-503f-4ad5-b135-f091bd1e707c None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:56.287702 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d72628-503f-4ad5-b135-f091bd1e707c None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:56.287977 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d72628-503f-4ad5-b135-f091bd1e707c None admin] PATH_INFO: `/v3/services/network` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:56.288615 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d72628-503f-4ad5-b135-f091bd1e707c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:56.290023 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d72628-503f-4ad5-b135-f091bd1e707c None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:56.299744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-13d72628-503f-4ad5-b135-f091bd1e707c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 03 12:38:56.299744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:56.299744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:38:56.299744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:38:56.299744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:38:56.299744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:38:56.299744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:38:56.299744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:38:56.299744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 03 12:38:56.299744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:56.299744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:38:56.299744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:56.299744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:56.299744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:56.299744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:56.299744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:56.299744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:56.300804 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:56.300804 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:56.300804 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:56.300804 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:56.300804 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:56.300804 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:56.300804 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:38:56.300804 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:38:56.300804 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:38:56.300804 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:38:56.300804 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:56.300804 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:56.300804 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:56.300804 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:56.300804 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:56.300804 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:56.302015 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:56.302015 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:56.302015 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:56.302015 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:56.302015 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:56.302015 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:56.302015 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:56.302015 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:56.302015 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:56.302015 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:56.302015 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:38:56.302015 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:38:56.302015 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 03 12:38:56.302015 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:56.302015 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 365/717] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:38:56 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:56.310598 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2400a6-4d38-4cee-89f8-4db3f10a9c2a None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:56.397094 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:56.445186 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2400a6-4d38-4cee-89f8-4db3f10a9c2a None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:56.488077 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b76e9-f00c-4602-b08b-e67d5299298b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:56.488714 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b76e9-f00c-4602-b08b-e67d5299298b None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:56.489039 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b76e9-f00c-4602-b08b-e67d5299298b None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:56.489328 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b76e9-f00c-4602-b08b-e67d5299298b None admin] PATH_INFO: `/v3/services` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:56.490312 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b76e9-f00c-4602-b08b-e67d5299298b None admin] RBAC: Adding query filter params (name=network) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:56.490619 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b76e9-f00c-4602-b08b-e67d5299298b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:56.492000 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b76e9-f00c-4602-b08b-e67d5299298b None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:56.500585 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 353/718] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Aug 3 12:38:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:56.506002 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d72628-503f-4ad5-b135-f091bd1e707c None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:56.553156 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:56.620687 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d72628-503f-4ad5-b135-f091bd1e707c None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:56.661042 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a619e2-0138-4f29-9d30-1b9e0fb069f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:56.661698 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a619e2-0138-4f29-9d30-1b9e0fb069f6 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:56.661986 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a619e2-0138-4f29-9d30-1b9e0fb069f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:56.662266 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a619e2-0138-4f29-9d30-1b9e0fb069f6 None admin] PATH_INFO: `/v3/services` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:56.662961 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a619e2-0138-4f29-9d30-1b9e0fb069f6 None admin] RBAC: Adding query filter params (type=network) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:56.663269 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a619e2-0138-4f29-9d30-1b9e0fb069f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:56.664720 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a619e2-0138-4f29-9d30-1b9e0fb069f6 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:56.669836 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 366/719] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Aug 3 12:38:56 2022] GET /identity/v3/services?type=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:57.161027 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8610b-baa7-4c0f-b764-605a9a35bedc None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:57.161404 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8610b-baa7-4c0f-b764-605a9a35bedc None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:57.161638 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8610b-baa7-4c0f-b764-605a9a35bedc None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:57.163213 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 354/720] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:57.169252 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83fed8-42c8-4f04-8517-15942b721ea8 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:57.169252 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83fed8-42c8-4f04-8517-15942b721ea8 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:57.169726 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83fed8-42c8-4f04-8517-15942b721ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:57.198638 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-aa83fed8-42c8-4f04-8517-15942b721ea8 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:57.199944 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-aa83fed8-42c8-4f04-8517-15942b721ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:57.289899 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 367/721] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:57.324878 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8610b-baa7-4c0f-b764-605a9a35bedc None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:57.464121 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8610b-baa7-4c0f-b764-605a9a35bedc None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:57.502716 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:57.509530 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c2f5e-6f45-447c-9a4b-700a4749d4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:57.510209 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c2f5e-6f45-447c-9a4b-700a4749d4f6 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:57.510458 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c2f5e-6f45-447c-9a4b-700a4749d4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:57.510730 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c2f5e-6f45-447c-9a4b-700a4749d4f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:57.523762 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c2f5e-6f45-447c-9a4b-700a4749d4f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:57.529679 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-7f1c2f5e-6f45-447c-9a4b-700a4749d4f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:38:57.529679 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:57.529679 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:57.529679 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:57.529679 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:57.529679 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:57.529679 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:57.529679 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:57.529679 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:57.529679 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:57.529679 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:57.529679 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:57.529679 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:57.529679 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:57.529679 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:57.529679 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:57.530880 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:57.530880 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:57.530880 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:57.530880 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:57.530880 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:57.530880 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:57.530880 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:57.530880 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:57.530880 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:57.530880 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:57.530880 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:57.530880 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:57.530880 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:57.530880 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:57.530880 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:57.530880 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:57.531903 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:57.531903 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:57.531903 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:57.531903 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:57.531903 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:57.531903 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:57.531903 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:57.531903 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:57.531903 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:57.531903 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:57.531903 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:38:57.531903 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:57.531903 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 355/722] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 3 12:38:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:57.538583 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83fed8-42c8-4f04-8517-15942b721ea8 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:57.625860 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:57.685132 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83fed8-42c8-4f04-8517-15942b721ea8 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:57.720903 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1b62d-1160-4e37-8ea7-7f64ab4c64fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:57.721444 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1b62d-1160-4e37-8ea7-7f64ab4c64fb None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:57.721756 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1b62d-1160-4e37-8ea7-7f64ab4c64fb None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:57.722034 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1b62d-1160-4e37-8ea7-7f64ab4c64fb None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:57.722758 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1b62d-1160-4e37-8ea7-7f64ab4c64fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:57.723066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1b62d-1160-4e37-8ea7-7f64ab4c64fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:57.724441 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1b62d-1160-4e37-8ea7-7f64ab4c64fb None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:57.733197 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 368/723] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:38:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:57.738700 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c2f5e-6f45-447c-9a4b-700a4749d4f6 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:57.898786 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c2f5e-6f45-447c-9a4b-700a4749d4f6 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:57.945896 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00c660-e55c-4887-bfd4-1f0ba9667922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:57.946909 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00c660-e55c-4887-bfd4-1f0ba9667922 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:57.947677 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00c660-e55c-4887-bfd4-1f0ba9667922 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:57.948182 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00c660-e55c-4887-bfd4-1f0ba9667922 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:57.963758 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00c660-e55c-4887-bfd4-1f0ba9667922 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:57.966171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00c660-e55c-4887-bfd4-1f0ba9667922 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:57.989607 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-ef00c660-e55c-4887-bfd4-1f0ba9667922 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:57.989607 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:57.989607 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:57.989607 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:57.989607 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:57.989607 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:57.989607 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:57.989607 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:57.989607 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:57.989607 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:57.989607 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:57.989607 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:57.989607 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:57.989607 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:57.989607 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:57.990779 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:57.990779 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:57.990779 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:57.990779 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:57.990779 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:57.990779 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:57.990779 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:57.990779 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:57.990779 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:57.990779 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:57.990779 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:57.990779 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:57.990779 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:57.990779 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:57.990779 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:57.990779 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:57.990779 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:57.991643 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:57.991643 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:57.991643 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:57.991643 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:57.994078 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 356/724] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:57.999324 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1b62d-1160-4e37-8ea7-7f64ab4c64fb None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:58.126244 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:58.130150 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1b62d-1160-4e37-8ea7-7f64ab4c64fb None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:58.165125 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8c87e-758f-48e5-810f-bf5de4ef5714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:58.165775 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8c87e-758f-48e5-810f-bf5de4ef5714 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:58.166057 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8c87e-758f-48e5-810f-bf5de4ef5714 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:58.166330 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8c87e-758f-48e5-810f-bf5de4ef5714 None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:58.167023 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8c87e-758f-48e5-810f-bf5de4ef5714 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:58.167325 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8c87e-758f-48e5-810f-bf5de4ef5714 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:58.168752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8c87e-758f-48e5-810f-bf5de4ef5714 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:58.181359 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 369/725] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:58.187337 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00c660-e55c-4887-bfd4-1f0ba9667922 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:58.226141 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f6e93-016f-448b-995e-cf03419b2945 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:58.226803 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f6e93-016f-448b-995e-cf03419b2945 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:58.227287 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f6e93-016f-448b-995e-cf03419b2945 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:58.229123 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 370/726] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:38:58.234352 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fc6e4-0c86-45d3-9d45-1761c6c62d13 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:58.234888 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fc6e4-0c86-45d3-9d45-1761c6c62d13 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:58.235368 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fc6e4-0c86-45d3-9d45-1761c6c62d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:58.243330 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:58.264322 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-fb9fc6e4-0c86-45d3-9d45-1761c6c62d13 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:58.266982 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-fb9fc6e4-0c86-45d3-9d45-1761c6c62d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:58.365612 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 371/727] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:38:58.381327 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00c660-e55c-4887-bfd4-1f0ba9667922 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:58.387931 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9fc6e4-0c86-45d3-9d45-1761c6c62d13 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:58.462208 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87fbbd-4d0d-444f-bcec-6243b87b1f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:58.462858 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87fbbd-4d0d-444f-bcec-6243b87b1f52 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:58.463138 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87fbbd-4d0d-444f-bcec-6243b87b1f52 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:58.463410 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87fbbd-4d0d-444f-bcec-6243b87b1f52 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:58.482587 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87fbbd-4d0d-444f-bcec-6243b87b1f52 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:58.484027 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87fbbd-4d0d-444f-bcec-6243b87b1f52 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:58.491285 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:58.505065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-de87fbbd-4d0d-444f-bcec-6243b87b1f52 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 03 12:38:58.505065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:58.505065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:58.505065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:58.505065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:58.505065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:58.505065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:58.505065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:58.505065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:58.505065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:58.505065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:58.505065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:58.505065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:38:58.505065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:38:58.505065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:38:58.505065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:38:58.506058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:58.506058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:58.506058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:38:58.506058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:38:58.506058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:38:58.506058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:38:58.506058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:58.506058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:58.506058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:58.506058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:58.506058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:58.506058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:58.506058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:58.506058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:58.506058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:58.506058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:58.506058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:58.506058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:58.506997 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:58.506997 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:58.506997 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:38:58.506997 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:38:58.506997 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:38:58.506997 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:38:58.506997 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:38:58.506997 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:38:58.506997 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 03 12:38:58.506997 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:58.508848 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9fc6e4-0c86-45d3-9d45-1761c6c62d13 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:58.513881 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 357/728] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 3 12:38:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:58.514757 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87fbbd-4d0d-444f-bcec-6243b87b1f52 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:58.549437 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e34cc2-c491-42e2-a473-1041a901656a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:58.550867 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e34cc2-c491-42e2-a473-1041a901656a None admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:58.551623 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e34cc2-c491-42e2-a473-1041a901656a None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:58.552115 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e34cc2-c491-42e2-a473-1041a901656a None admin] PATH_INFO: `/v3/services` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:58.553030 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e34cc2-c491-42e2-a473-1041a901656a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:58.555043 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e34cc2-c491-42e2-a473-1041a901656a None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:58.582041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 372/729] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Aug 3 12:38:58 2022] POST /identity/v3/services => generated 251 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:38:58.582041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5c2c8-a91f-4c58-8a2c-41a00d950a78 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:58.582041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5c2c8-a91f-4c58-8a2c-41a00d950a78 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:58.582041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5c2c8-a91f-4c58-8a2c-41a00d950a78 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:58.582041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 373/730] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:58.587888 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d81a3-18f3-42e8-a20d-455cfffc65e1 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:58.588212 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d81a3-18f3-42e8-a20d-455cfffc65e1 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:58.588434 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d81a3-18f3-42e8-a20d-455cfffc65e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:58.626859 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-644d81a3-18f3-42e8-a20d-455cfffc65e1 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:58.628072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-644d81a3-18f3-42e8-a20d-455cfffc65e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:58.738611 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87fbbd-4d0d-444f-bcec-6243b87b1f52 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:58.740738 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:58.769338 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 374/731] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:58 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:58.770574 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346cc0ec-5561-4570-8ab0-270b96bd4138 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:58.770856 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346cc0ec-5561-4570-8ab0-270b96bd4138 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:58.771130 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346cc0ec-5561-4570-8ab0-270b96bd4138 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:58.778486 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 375/732] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:58.778651 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0018cc8-2948-409b-acbf-d727743f835c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:58.779281 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0018cc8-2948-409b-acbf-d727743f835c None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:58.779564 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0018cc8-2948-409b-acbf-d727743f835c None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:58.779837 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0018cc8-2948-409b-acbf-d727743f835c None admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:58.780635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0018cc8-2948-409b-acbf-d727743f835c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:58.780942 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0018cc8-2948-409b-acbf-d727743f835c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:58.786324 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0018cc8-2948-409b-acbf-d727743f835c None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:58.786830 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9854f73-d409-4d09-bd24-11c04df8ab35 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:58.787114 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9854f73-d409-4d09-bd24-11c04df8ab35 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:58.787387 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9854f73-d409-4d09-bd24-11c04df8ab35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:58.804887 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 358/733] 10.222.0.46 () {56 vars in 1135 bytes} [Wed Aug 3 12:38:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:58.805642 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0018cc8-2948-409b-acbf-d727743f835c None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:58.818588 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-d9854f73-d409-4d09-bd24-11c04df8ab35 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:58.819842 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-d9854f73-d409-4d09-bd24-11c04df8ab35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:58.916432 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 376/734] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:58 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 03 12:38:58.917749 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9854f73-d409-4d09-bd24-11c04df8ab35 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:58.921341 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:58.936190 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0018cc8-2948-409b-acbf-d727743f835c None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:58.982792 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f09ece-0647-4891-9f25-5f8e79767d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:58.983462 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f09ece-0647-4891-9f25-5f8e79767d88 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:58.983743 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f09ece-0647-4891-9f25-5f8e79767d88 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:58.984017 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f09ece-0647-4891-9f25-5f8e79767d88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:58.997864 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f09ece-0647-4891-9f25-5f8e79767d88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:59.003364 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-f7f09ece-0647-4891-9f25-5f8e79767d88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:38:59.003364 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:59.003364 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:59.003364 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:59.003364 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:59.003364 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:59.003364 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:59.003364 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:59.003364 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:59.003364 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:59.003364 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:59.003364 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:59.003364 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:59.003364 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:59.003364 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:59.003364 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:59.004361 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:59.004361 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:59.004361 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:59.004361 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:59.004361 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:59.004361 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:59.004361 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:59.004361 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:59.004361 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:59.004361 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:59.004361 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:59.004361 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:59.004361 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:59.004361 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:59.004361 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:59.004361 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:59.005175 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:59.005175 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:59.005175 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:59.005175 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:59.005175 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:59.005175 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:59.005175 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:59.005175 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:59.005175 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:59.005175 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:59.005175 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:38:59.005175 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:59.009692 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 359/735] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 3 12:38:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:59.010809 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f09ece-0647-4891-9f25-5f8e79767d88 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:59.038399 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:59.129216 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f09ece-0647-4891-9f25-5f8e79767d88 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:59.174089 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed352ac7-c6b4-49ae-8a6d-8623c3c47674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:59.174896 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed352ac7-c6b4-49ae-8a6d-8623c3c47674 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:59.175179 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed352ac7-c6b4-49ae-8a6d-8623c3c47674 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:59.175452 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed352ac7-c6b4-49ae-8a6d-8623c3c47674 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:59.187477 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed352ac7-c6b4-49ae-8a6d-8623c3c47674 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:38:59.192821 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-ed352ac7-c6b4-49ae-8a6d-8623c3c47674 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:38:59.192821 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:59.192821 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:59.192821 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:59.192821 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:59.192821 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:59.192821 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:59.192821 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:59.192821 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:59.192821 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:59.192821 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:59.192821 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:59.192821 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:38:59.192821 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:38:59.192821 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:38:59.192821 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:38:59.193767 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:38:59.193767 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:38:59.193767 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:38:59.193767 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:38:59.193767 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:59.193767 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:59.193767 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:59.193767 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:59.193767 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:59.193767 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:59.193767 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:59.193767 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:59.193767 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:59.193767 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:59.193767 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:59.193767 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:59.194591 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:59.194591 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:59.194591 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:59.194591 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:59.194591 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:38:59.194591 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:38:59.194591 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:38:59.194591 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:38:59.194591 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:38:59.194591 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:38:59.194591 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:38:59.194591 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:59.196319 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9854f73-d409-4d09-bd24-11c04df8ab35 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:59.199193 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 360/736] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 3 12:38:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:59.200772 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed352ac7-c6b4-49ae-8a6d-8623c3c47674 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:59.241049 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dea524-d3a4-4b29-bce9-bf4e863654a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:59.241760 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dea524-d3a4-4b29-bce9-bf4e863654a7 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:59.242040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dea524-d3a4-4b29-bce9-bf4e863654a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:59.242313 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dea524-d3a4-4b29-bce9-bf4e863654a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:59.305420 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:59.328693 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed352ac7-c6b4-49ae-8a6d-8623c3c47674 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:59.330988 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dea524-d3a4-4b29-bce9-bf4e863654a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:59.332607 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dea524-d3a4-4b29-bce9-bf4e863654a7 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:59.335466 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:59.365285 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09be5e-38bb-481d-9ac6-0b0c01f722b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:59.365929 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09be5e-38bb-481d-9ac6-0b0c01f722b4 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:59.366207 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09be5e-38bb-481d-9ac6-0b0c01f722b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:59.366476 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09be5e-38bb-481d-9ac6-0b0c01f722b4 None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:59.367192 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09be5e-38bb-481d-9ac6-0b0c01f722b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:59.367494 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09be5e-38bb-481d-9ac6-0b0c01f722b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:59.368861 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09be5e-38bb-481d-9ac6-0b0c01f722b4 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:59.378659 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 361/737] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:38:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:59.379682 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09be5e-38bb-481d-9ac6-0b0c01f722b4 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:59.440539 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 377/738] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:38:58 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 03 12:38:59.442128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0e357-2096-47d5-b301-ed6824bf259f None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:59.442410 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0e357-2096-47d5-b301-ed6824bf259f None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:59.442682 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0e357-2096-47d5-b301-ed6824bf259f None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:59.444072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 378/739] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:38:59.444602 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0e357-2096-47d5-b301-ed6824bf259f None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:59.518796 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09be5e-38bb-481d-9ac6-0b0c01f722b4 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:59.556963 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0d4ed-092a-401e-8cd6-8e4da7d89383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:59.557487 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0d4ed-092a-401e-8cd6-8e4da7d89383 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:59.557800 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0d4ed-092a-401e-8cd6-8e4da7d89383 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:59.558095 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0d4ed-092a-401e-8cd6-8e4da7d89383 None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:59.559383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0d4ed-092a-401e-8cd6-8e4da7d89383 None admin] RBAC: Adding query filter params (name=service) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:59.559677 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0d4ed-092a-401e-8cd6-8e4da7d89383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:59.561037 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0d4ed-092a-401e-8cd6-8e4da7d89383 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:59.571149 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 362/740] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 3 12:38:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:59.572292 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0d4ed-092a-401e-8cd6-8e4da7d89383 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:59.577367 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:59.583372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0e357-2096-47d5-b301-ed6824bf259f None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:59.585711 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:59.618158 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8ff7b-c6cb-47bd-8a4a-d794f7fcd476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:59.618799 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8ff7b-c6cb-47bd-8a4a-d794f7fcd476 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:59.619080 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8ff7b-c6cb-47bd-8a4a-d794f7fcd476 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:59.619353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8ff7b-c6cb-47bd-8a4a-d794f7fcd476 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:59.630089 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8ff7b-c6cb-47bd-8a4a-d794f7fcd476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:59.631792 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8ff7b-c6cb-47bd-8a4a-d794f7fcd476 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:59.653183 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-99c8ff7b-c6cb-47bd-8a4a-d794f7fcd476 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:59.653183 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:59.653183 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:59.653183 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:59.653183 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:59.653183 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:59.653183 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:59.653183 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:59.653183 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:59.653183 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:59.653183 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:59.653183 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:59.653183 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:59.653183 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:59.653183 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:59.654306 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:59.654306 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:59.654306 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:59.654306 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:59.654306 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:59.654306 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:59.654306 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:59.654306 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:59.654306 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:59.654306 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:59.654306 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:59.654306 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:59.654306 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:59.654306 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:59.654306 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:59.654306 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:59.654306 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:59.655399 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:59.655399 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:59.655399 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:59.655399 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:38:59.661630 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 379/741] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:59.662957 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e2100-84da-473f-ba87-6cebdb94ec58 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:59.663367 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e2100-84da-473f-ba87-6cebdb94ec58 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:59.663645 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e2100-84da-473f-ba87-6cebdb94ec58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:59.681074 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-658e2100-84da-473f-ba87-6cebdb94ec58 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:38:59.682298 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-658e2100-84da-473f-ba87-6cebdb94ec58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:38:59.686907 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0d4ed-092a-401e-8cd6-8e4da7d89383 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:59.722698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84983e59-3ab5-41d3-8eb4-b296359dc9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:59.723345 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84983e59-3ab5-41d3-8eb4-b296359dc9d4 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:59.723627 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84983e59-3ab5-41d3-8eb4-b296359dc9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:59.723904 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84983e59-3ab5-41d3-8eb4-b296359dc9d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:59.735756 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84983e59-3ab5-41d3-8eb4-b296359dc9d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:59.737314 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84983e59-3ab5-41d3-8eb4-b296359dc9d4 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:59.752772 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-84983e59-3ab5-41d3-8eb4-b296359dc9d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:59.752772 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:59.752772 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:59.752772 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:59.752772 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:59.752772 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:59.752772 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:59.752772 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:59.752772 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:59.752772 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:59.752772 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:59.752772 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:59.752772 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:59.752772 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:59.752772 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:59.753732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:59.753732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:59.753732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:59.753732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:59.753732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:59.753732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:59.753732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:59.753732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:59.753732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:59.753732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:59.753732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:59.753732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:59.753732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:59.753732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:59.753732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:59.753732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:59.753732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:59.754669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:59.754669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:59.754669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:59.754669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:59.754669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 363/742] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:59.755396 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84983e59-3ab5-41d3-8eb4-b296359dc9d4 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:59.758113 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 380/743] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:38:59 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 03 12:38:59.759164 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e2100-84da-473f-ba87-6cebdb94ec58 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:59.832515 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:59.856437 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:38:59.873814 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e2100-84da-473f-ba87-6cebdb94ec58 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:59.881001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84983e59-3ab5-41d3-8eb4-b296359dc9d4 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:38:59.910956 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e33939e-e32c-486f-89e6-c3a2e33420af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:59.911875 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33939e-e32c-486f-89e6-c3a2e33420af None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:59.912160 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33939e-e32c-486f-89e6-c3a2e33420af None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:59.912438 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33939e-e32c-486f-89e6-c3a2e33420af None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:59.913134 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e33939e-e32c-486f-89e6-c3a2e33420af None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:38:59.913564 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e33939e-e32c-486f-89e6-c3a2e33420af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:59.915067 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e33939e-e32c-486f-89e6-c3a2e33420af None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:59.920730 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac86f3-abc5-41b9-8e43-018e9fce5d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:38:59.921408 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac86f3-abc5-41b9-8e43-018e9fce5d85 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:38:59.921717 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac86f3-abc5-41b9-8e43-018e9fce5d85 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:38:59.921993 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac86f3-abc5-41b9-8e43-018e9fce5d85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:38:59.928509 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 381/744] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:38:59.929148 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e33939e-e32c-486f-89e6-c3a2e33420af None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:38:59.938215 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac86f3-abc5-41b9-8e43-018e9fce5d85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:38:59.939672 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac86f3-abc5-41b9-8e43-018e9fce5d85 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:38:59.955403 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-06ac86f3-abc5-41b9-8e43-018e9fce5d85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:59.955403 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:38:59.955403 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:38:59.955403 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:38:59.955403 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:38:59.955403 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:38:59.955403 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:38:59.955403 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:38:59.955403 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:38:59.955403 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:38:59.955403 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:38:59.955403 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:38:59.955403 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:38:59.955403 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:38:59.955403 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:38:59.956317 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:38:59.956317 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:38:59.956317 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:38:59.956317 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:38:59.956317 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:38:59.956317 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:38:59.956317 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:38:59.956317 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:38:59.956317 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:38:59.956317 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:38:59.956317 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:38:59.956317 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:38:59.956317 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:38:59.956317 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:38:59.956317 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:38:59.956317 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:38:59.956317 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:38:59.957220 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:38:59.957220 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:38:59.957220 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:38:59.957220 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:38:59.957220 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 364/745] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:38:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:38:59.957962 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac86f3-abc5-41b9-8e43-018e9fce5d85 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:00.040022 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e33939e-e32c-486f-89e6-c3a2e33420af None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:00.065308 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac86f3-abc5-41b9-8e43-018e9fce5d85 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:00.074195 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:00.079384 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17039f-472a-417e-97b7-843a5126c6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:00.080008 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17039f-472a-417e-97b7-843a5126c6d5 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:00.080291 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17039f-472a-417e-97b7-843a5126c6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:00.080570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17039f-472a-417e-97b7-843a5126c6d5 None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:00.081266 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17039f-472a-417e-97b7-843a5126c6d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:00.081599 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17039f-472a-417e-97b7-843a5126c6d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:00.083037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17039f-472a-417e-97b7-843a5126c6d5 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:00.099620 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 382/746] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:00.099620 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17039f-472a-417e-97b7-843a5126c6d5 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:00.105207 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0197a-ed19-4a07-9931-d246f4210ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:00.106412 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0197a-ed19-4a07-9931-d246f4210ae0 None admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:00.106874 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0197a-ed19-4a07-9931-d246f4210ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:00.107096 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:00.107220 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0197a-ed19-4a07-9931-d246f4210ae0 None admin] PATH_INFO: `/v3/services` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:00.108048 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0197a-ed19-4a07-9931-d246f4210ae0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:00.109626 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0197a-ed19-4a07-9931-d246f4210ae0 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:00.137308 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 365/747] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Aug 3 12:38:59 2022] POST /identity/v3/services => generated 240 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:39:00.138313 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0197a-ed19-4a07-9931-d246f4210ae0 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:00.217831 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17039f-472a-417e-97b7-843a5126c6d5 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:00.271757 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5bb1b-9008-4b62-a2fe-e443c3f65cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:00.275147 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5bb1b-9008-4b62-a2fe-e443c3f65cbe None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:00.275147 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5bb1b-9008-4b62-a2fe-e443c3f65cbe None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:00.275147 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5bb1b-9008-4b62-a2fe-e443c3f65cbe None admin] PATH_INFO: `/v3/users/nova` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:00.286230 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f5bb1b-9008-4b62-a2fe-e443c3f65cbe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:00.287916 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f5bb1b-9008-4b62-a2fe-e443c3f65cbe None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:00.302432 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0197a-ed19-4a07-9931-d246f4210ae0 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:00.302686 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-06f5bb1b-9008-4b62-a2fe-e443c3f65cbe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:39:00.302686 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:00.302686 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:00.302686 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:00.302686 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:00.302686 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:00.302686 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:00.302686 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:00.302686 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:00.302686 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:00.302686 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:00.302686 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:00.302686 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:39:00.302686 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:39:00.302686 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:39:00.302686 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:39:00.303553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:00.303553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:00.303553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:39:00.303553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:39:00.303553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:39:00.303553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:39:00.303553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:00.303553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:00.303553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:00.303553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:00.303553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:00.303553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:00.303553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:00.303553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:00.303553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:00.303553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:00.303553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:00.303553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:00.304479 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:00.304479 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:00.304479 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:39:00.304479 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:39:00.304479 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:39:00.304479 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:39:00.304479 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:39:00.304479 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:39:00.304479 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:39:00.304479 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:00.304479 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 383/748] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Aug 3 12:39:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:00.310621 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5bb1b-9008-4b62-a2fe-e443c3f65cbe None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:00.352506 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d247ee-a1fa-4b59-ac93-be3de454ef93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:00.353055 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d247ee-a1fa-4b59-ac93-be3de454ef93 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:00.353336 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d247ee-a1fa-4b59-ac93-be3de454ef93 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:00.353638 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d247ee-a1fa-4b59-ac93-be3de454ef93 None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:00.354783 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d247ee-a1fa-4b59-ac93-be3de454ef93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:00.355089 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d247ee-a1fa-4b59-ac93-be3de454ef93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:00.358182 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d247ee-a1fa-4b59-ac93-be3de454ef93 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:00.372227 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 366/749] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:00.373379 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d247ee-a1fa-4b59-ac93-be3de454ef93 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:00.388392 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:00.410437 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:00.439392 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5bb1b-9008-4b62-a2fe-e443c3f65cbe None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:00.480457 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e397549-675a-491a-9b67-659f588bd34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:00.482186 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e397549-675a-491a-9b67-659f588bd34f None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:00.482677 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e397549-675a-491a-9b67-659f588bd34f None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:00.483156 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e397549-675a-491a-9b67-659f588bd34f None admin] PATH_INFO: `/v3/projects/service` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:00.491372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e397549-675a-491a-9b67-659f588bd34f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:00.493359 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e397549-675a-491a-9b67-659f588bd34f None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:00.502946 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d247ee-a1fa-4b59-ac93-be3de454ef93 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:00.506752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-3e397549-675a-491a-9b67-659f588bd34f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:39:00.506752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:00.506752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:00.506752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:00.506752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:00.506752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:00.506752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:00.506752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:00.506752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:00.506752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:00.506752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:00.506752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:00.506752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:39:00.506752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:39:00.506752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:39:00.507625 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:39:00.507625 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:00.507625 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:00.507625 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:00.507625 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:00.507625 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:00.507625 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:00.507625 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:00.507625 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:00.507625 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:00.507625 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:00.507625 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:00.507625 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:00.507625 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:00.507625 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:00.507625 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:00.507625 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:00.508526 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:39:00.508526 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:39:00.508526 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:39:00.508526 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:39:00.508526 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:39:00.508526 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:39:00.508526 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:39:00.508526 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:00.511258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 384/750] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:39:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:00.512578 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e397549-675a-491a-9b67-659f588bd34f None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:00.552104 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf652a-16de-4291-b706-5bc5ca6e4ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:00.552783 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf652a-16de-4291-b706-5bc5ca6e4ef7 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:00.553013 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf652a-16de-4291-b706-5bc5ca6e4ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:00.553290 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf652a-16de-4291-b706-5bc5ca6e4ef7 None admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:00.554390 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf652a-16de-4291-b706-5bc5ca6e4ef7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:00.554703 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf652a-16de-4291-b706-5bc5ca6e4ef7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:00.557035 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf652a-16de-4291-b706-5bc5ca6e4ef7 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:00.584245 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 367/751] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Aug 3 12:39:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:00.584245 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf652a-16de-4291-b706-5bc5ca6e4ef7 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:00.637977 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e397549-675a-491a-9b67-659f588bd34f None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:00.664922 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:00.674355 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:00.682567 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ace478-ac15-4dc0-9b10-a64b0dc73c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:00.683765 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ace478-ac15-4dc0-9b10-a64b0dc73c6c None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:00.684463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ace478-ac15-4dc0-9b10-a64b0dc73c6c None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:00.684980 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ace478-ac15-4dc0-9b10-a64b0dc73c6c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:00.690258 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf652a-16de-4291-b706-5bc5ca6e4ef7 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:00.695081 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ace478-ac15-4dc0-9b10-a64b0dc73c6c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:00.696774 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ace478-ac15-4dc0-9b10-a64b0dc73c6c None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:00.710557 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-75ace478-ac15-4dc0-9b10-a64b0dc73c6c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 12:39:00.710557 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:00.710557 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:00.710557 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:00.710557 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:00.710557 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:00.710557 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:00.710557 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:00.710557 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:00.710557 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:00.710557 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:00.710557 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:00.710557 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:39:00.710557 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:39:00.710557 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:39:00.710557 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:39:00.711566 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:00.711566 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:00.711566 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:39:00.711566 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:39:00.711566 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:39:00.711566 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:39:00.711566 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:00.711566 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:00.711566 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:00.711566 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:00.711566 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:00.711566 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:00.711566 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:00.711566 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:00.711566 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:00.711566 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:00.711566 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:00.711566 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:00.712517 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:00.712517 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:00.712517 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:39:00.712517 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:39:00.712517 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:39:00.712517 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:39:00.712517 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:39:00.712517 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:39:00.712517 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 12:39:00.712517 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:00.720166 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 385/752] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Aug 3 12:39:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:00.721319 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ace478-ac15-4dc0-9b10-a64b0dc73c6c None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:00.726482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bbf39-8813-4b6e-a4ae-72e1e41ee32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:00.727103 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bbf39-8813-4b6e-a4ae-72e1e41ee32b None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:00.727386 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bbf39-8813-4b6e-a4ae-72e1e41ee32b None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:00.727662 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bbf39-8813-4b6e-a4ae-72e1e41ee32b None admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:00.728420 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6bbf39-8813-4b6e-a4ae-72e1e41ee32b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:00.728727 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6bbf39-8813-4b6e-a4ae-72e1e41ee32b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:00.730186 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6bbf39-8813-4b6e-a4ae-72e1e41ee32b None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:00.745960 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 368/753] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 3 12:39:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:00.745960 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342522c-39c7-4da0-9fae-f0cda27b3324 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:00.745960 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342522c-39c7-4da0-9fae-f0cda27b3324 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:00.745960 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342522c-39c7-4da0-9fae-f0cda27b3324 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:00.745960 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 369/754] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:00.746711 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342522c-39c7-4da0-9fae-f0cda27b3324 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:00.833580 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ace478-ac15-4dc0-9b10-a64b0dc73c6c None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:00.860132 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342522c-39c7-4da0-9fae-f0cda27b3324 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:00.869145 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb68775-462e-4936-a968-827531fc213f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:00.870029 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb68775-462e-4936-a968-827531fc213f None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:00.870495 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb68775-462e-4936-a968-827531fc213f None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:00.871000 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb68775-462e-4936-a968-827531fc213f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:00.882139 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb68775-462e-4936-a968-827531fc213f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:00.883792 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb68775-462e-4936-a968-827531fc213f None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:00.896640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974c1ea-cf59-4ac3-ac7f-7a4de7f13121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:00.897274 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974c1ea-cf59-4ac3-ac7f-7a4de7f13121 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:00.897660 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974c1ea-cf59-4ac3-ac7f-7a4de7f13121 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:00.898002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974c1ea-cf59-4ac3-ac7f-7a4de7f13121 None admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:00.898875 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974c1ea-cf59-4ac3-ac7f-7a4de7f13121 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:00.899097 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-7bb68775-462e-4936-a968-827531fc213f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:00.899097 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:00.899097 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:00.899097 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:00.899097 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:00.899097 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:00.899097 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:00.899097 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:00.899097 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:00.899097 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:00.899097 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:00.899097 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:00.899097 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:39:00.899097 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:39:00.899097 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:39:00.900100 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:39:00.900100 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:00.900100 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:00.900100 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:00.900100 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:00.900100 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:00.900100 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:00.900100 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:00.900100 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:00.900100 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:00.900100 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:00.900100 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:00.900100 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:00.900100 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:00.900100 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:00.900100 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:00.900100 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:00.901037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:39:00.901037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:39:00.901037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:00.901037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:00.901267 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974c1ea-cf59-4ac3-ac7f-7a4de7f13121 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:00.901336 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 386/755] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:39:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:00.901336 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb68775-462e-4936-a968-827531fc213f None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:00.906775 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974c1ea-cf59-4ac3-ac7f-7a4de7f13121 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:00.928757 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 370/756] 10.222.0.46 () {56 vars in 1149 bytes} [Wed Aug 3 12:39:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:00.930269 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2fc633-ed3e-4951-99ac-235828ad0269 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:00.930557 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2fc633-ed3e-4951-99ac-235828ad0269 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:00.930830 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2fc633-ed3e-4951-99ac-235828ad0269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:00.938355 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:00.945447 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:00.949910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-8b2fc633-ed3e-4951-99ac-235828ad0269 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:00.951119 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-8b2fc633-ed3e-4951-99ac-235828ad0269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:01.020032 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb68775-462e-4936-a968-827531fc213f None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:01.025713 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 371/757] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:39:01.025713 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2fc633-ed3e-4951-99ac-235828ad0269 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:01.071223 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c962a-716b-47a9-bf05-c203d00f3f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:01.071830 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c962a-716b-47a9-bf05-c203d00f3f04 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:01.072107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c962a-716b-47a9-bf05-c203d00f3f04 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:01.072377 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c962a-716b-47a9-bf05-c203d00f3f04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:01.073164 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c962a-716b-47a9-bf05-c203d00f3f04 None admin] RBAC: Adding query filter params (role.id=0e57d142f86c471883fc07a89fe66ec8, scope.project.id=6ac833dfff634496816842c851545d21, user.id=67df369737ea4c83bae134f4bf2de20d) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:01.073471 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c962a-716b-47a9-bf05-c203d00f3f04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:01.075526 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c962a-716b-47a9-bf05-c203d00f3f04 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:01.080886 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 387/758] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:39:00 2022] GET /identity/v3/role_assignments?user.id=67df369737ea4c83bae134f4bf2de20d&scope.project.id=6ac833dfff634496816842c851545d21&role.id=0e57d142f86c471883fc07a89fe66ec8 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:01.081643 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c962a-716b-47a9-bf05-c203d00f3f04 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:01.158683 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2fc633-ed3e-4951-99ac-235828ad0269 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:01.202710 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:01.207486 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c962a-716b-47a9-bf05-c203d00f3f04 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:01.212171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bacc30-fd34-4782-9a47-2afcb596d3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:01.213136 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bacc30-fd34-4782-9a47-2afcb596d3f0 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:01.213676 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bacc30-fd34-4782-9a47-2afcb596d3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:01.214186 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bacc30-fd34-4782-9a47-2afcb596d3f0 None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:01.215213 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bacc30-fd34-4782-9a47-2afcb596d3f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:01.215794 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bacc30-fd34-4782-9a47-2afcb596d3f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:01.218147 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bacc30-fd34-4782-9a47-2afcb596d3f0 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:01.220142 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:01.235965 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 372/759] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:01.237313 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bacc30-fd34-4782-9a47-2afcb596d3f0 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:01.260768 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf847101-9568-454c-b293-ca5a2b2303b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:01.261361 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf847101-9568-454c-b293-ca5a2b2303b8 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:01.262353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf847101-9568-454c-b293-ca5a2b2303b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:01.262778 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf847101-9568-454c-b293-ca5a2b2303b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:01.347719 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf847101-9568-454c-b293-ca5a2b2303b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:01.349316 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf847101-9568-454c-b293-ca5a2b2303b8 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:01.360675 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bacc30-fd34-4782-9a47-2afcb596d3f0 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:01.397441 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e5ec6-ba7a-4961-bfdd-5f7881a7b9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:01.398114 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e5ec6-ba7a-4961-bfdd-5f7881a7b9a6 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:01.398399 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e5ec6-ba7a-4961-bfdd-5f7881a7b9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:01.398677 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e5ec6-ba7a-4961-bfdd-5f7881a7b9a6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:01.399314 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e5ec6-ba7a-4961-bfdd-5f7881a7b9a6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:01.400678 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e5ec6-ba7a-4961-bfdd-5f7881a7b9a6 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:01.412707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-260e5ec6-ba7a-4961-bfdd-5f7881a7b9a6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 03 12:39:01.412707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:01.412707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:39:01.412707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:39:01.412707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:39:01.412707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:39:01.412707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:39:01.412707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:01.412707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 03 12:39:01.412707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:01.412707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:39:01.412707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:01.412707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:01.412707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:01.412707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:01.412707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:01.413794 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:01.413794 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:01.413794 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:01.413794 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:01.413794 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:01.413794 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:01.413794 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:01.413794 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:39:01.413794 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:39:01.413794 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:39:01.413794 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:39:01.413794 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:01.413794 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:01.413794 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:01.413794 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:01.413794 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:01.414661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:01.414661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:01.414661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:01.414661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:01.414661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:01.414661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:01.414661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:01.414661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:01.414661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:01.414661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:01.414661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:01.414661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:39:01.414661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:01.414661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 03 12:39:01.414661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:01.414661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 373/760] 10.222.0.46 () {56 vars in 1129 bytes} [Wed Aug 3 12:39:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:01.415491 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e5ec6-ba7a-4961-bfdd-5f7881a7b9a6 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:01.453231 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:01.463458 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 388/761] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:39:01 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:39:01.464467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf847101-9568-454c-b293-ca5a2b2303b8 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:01.504448 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:01.557945 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e5ec6-ba7a-4961-bfdd-5f7881a7b9a6 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:01.575325 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf847101-9568-454c-b293-ca5a2b2303b8 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:01.604314 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b81162-ca6a-4269-8f26-29e8a15aa0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:01.605989 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b81162-ca6a-4269-8f26-29e8a15aa0db None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:01.606415 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b81162-ca6a-4269-8f26-29e8a15aa0db None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:01.607233 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b81162-ca6a-4269-8f26-29e8a15aa0db None admin] PATH_INFO: `/v3/projects/service` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:01.611792 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f18ebe-00be-4dfa-bb03-5fe3b146ec18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:01.612508 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f18ebe-00be-4dfa-bb03-5fe3b146ec18 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:01.612882 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f18ebe-00be-4dfa-bb03-5fe3b146ec18 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:01.613247 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f18ebe-00be-4dfa-bb03-5fe3b146ec18 None admin] PATH_INFO: `/v3/services` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:01.614071 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f18ebe-00be-4dfa-bb03-5fe3b146ec18 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:01.614631 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f18ebe-00be-4dfa-bb03-5fe3b146ec18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:01.616097 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b81162-ca6a-4269-8f26-29e8a15aa0db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:01.616489 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f18ebe-00be-4dfa-bb03-5fe3b146ec18 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:01.618145 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b81162-ca6a-4269-8f26-29e8a15aa0db None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:01.626950 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 389/762] 10.222.0.46 () {56 vars in 1124 bytes} [Wed Aug 3 12:39:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:01.626950 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f18ebe-00be-4dfa-bb03-5fe3b146ec18 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:01.639230 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-c7b81162-ca6a-4269-8f26-29e8a15aa0db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:39:01.639230 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:01.639230 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:01.639230 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:01.639230 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:01.639230 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:01.639230 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:01.639230 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:01.639230 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:01.639230 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:01.639230 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:01.639230 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:01.639230 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:39:01.639230 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:39:01.639230 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:39:01.640302 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:39:01.640302 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:01.640302 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:01.640302 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:01.640302 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:01.640302 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:01.640302 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:01.640302 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:01.640302 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:01.640302 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:01.640302 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:01.640302 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:01.640302 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:01.640302 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:01.640302 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:01.640302 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:01.640302 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:01.641396 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:39:01.641396 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:39:01.641396 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:39:01.641396 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:39:01.641396 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:39:01.641396 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:39:01.641396 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:39:01.641396 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:01.644055 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 374/763] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:39:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:01.645037 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b81162-ca6a-4269-8f26-29e8a15aa0db None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:01.700004 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:01.747749 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f18ebe-00be-4dfa-bb03-5fe3b146ec18 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:01.779763 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b81162-ca6a-4269-8f26-29e8a15aa0db None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:01.784791 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ae7d7-f8cf-4522-a6f8-b7132cd73543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:01.785587 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ae7d7-f8cf-4522-a6f8-b7132cd73543 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:01.785982 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ae7d7-f8cf-4522-a6f8-b7132cd73543 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:01.786351 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ae7d7-f8cf-4522-a6f8-b7132cd73543 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:01.798311 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ae7d7-f8cf-4522-a6f8-b7132cd73543 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:01.799669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:01.801328 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ae7d7-f8cf-4522-a6f8-b7132cd73543 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:01.818427 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5113af-f493-475b-af97-80703f54a321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:01.819051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5113af-f493-475b-af97-80703f54a321 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:01.819332 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5113af-f493-475b-af97-80703f54a321 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:01.819606 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5113af-f493-475b-af97-80703f54a321 None admin] PATH_INFO: `/v3/services` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:01.820240 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-c59ae7d7-f8cf-4522-a6f8-b7132cd73543 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:01.820240 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:01.820240 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:01.820240 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:01.820240 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:01.820240 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:01.820240 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:01.820240 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:01.820240 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:01.820240 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:01.820240 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:01.820240 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:01.820240 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:39:01.820240 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:39:01.820240 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:39:01.821083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:39:01.821083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:01.821083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:01.821083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:01.821083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:01.821083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:01.821083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:01.821083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:01.821083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:01.821083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:01.821083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:01.821083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:01.821083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:01.821083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:01.821083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:01.821083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:01.821083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:01.822029 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:39:01.822029 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:39:01.822029 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:01.822029 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:01.822244 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5113af-f493-475b-af97-80703f54a321 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:01.822244 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5113af-f493-475b-af97-80703f54a321 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:01.822244 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5113af-f493-475b-af97-80703f54a321 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:01.829319 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 390/765] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:39:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:01.831148 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ae7d7-f8cf-4522-a6f8-b7132cd73543 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:01.832903 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 375/765] 10.222.0.46 () {56 vars in 1124 bytes} [Wed Aug 3 12:39:01 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:01.833808 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5113af-f493-475b-af97-80703f54a321 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:01.938815 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5113af-f493-475b-af97-80703f54a321 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:01.944934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ae7d7-f8cf-4522-a6f8-b7132cd73543 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:01.961285 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:01.976628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e201b3a-7c7e-4006-9304-17ecd1c6c2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:01.977393 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e201b3a-7c7e-4006-9304-17ecd1c6c2f0 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:01.977705 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e201b3a-7c7e-4006-9304-17ecd1c6c2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:01.978036 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e201b3a-7c7e-4006-9304-17ecd1c6c2f0 None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:01.978991 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e201b3a-7c7e-4006-9304-17ecd1c6c2f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:01.979302 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e201b3a-7c7e-4006-9304-17ecd1c6c2f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:01.981522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e201b3a-7c7e-4006-9304-17ecd1c6c2f0 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:01.985263 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6ffb9-2362-450c-aa90-deca445f2bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:01.986115 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6ffb9-2362-450c-aa90-deca445f2bc1 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:01.986590 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6ffb9-2362-450c-aa90-deca445f2bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:01.987079 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6ffb9-2362-450c-aa90-deca445f2bc1 None admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:01.988112 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6ffb9-2362-450c-aa90-deca445f2bc1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:01.988691 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6ffb9-2362-450c-aa90-deca445f2bc1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:01.990670 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6ffb9-2362-450c-aa90-deca445f2bc1 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:01.999558 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 376/766] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:01.999558 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e201b3a-7c7e-4006-9304-17ecd1c6c2f0 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:02.014806 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 391/767] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 3 12:39:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:02.016223 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6ffb9-2362-450c-aa90-deca445f2bc1 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:02.055448 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:02.127578 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6ffb9-2362-450c-aa90-deca445f2bc1 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:02.139525 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e201b3a-7c7e-4006-9304-17ecd1c6c2f0 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:02.164303 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb19db-1cd0-4375-9a10-ffd2726814c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:02.165299 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb19db-1cd0-4375-9a10-ffd2726814c7 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:02.165825 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb19db-1cd0-4375-9a10-ffd2726814c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:02.166292 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb19db-1cd0-4375-9a10-ffd2726814c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:02.174182 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb19db-1cd0-4375-9a10-ffd2726814c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:02.175871 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb19db-1cd0-4375-9a10-ffd2726814c7 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:02.182403 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a58645-e448-4b15-b2f3-3ea588a979a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:02.183035 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a58645-e448-4b15-b2f3-3ea588a979a0 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:02.183319 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a58645-e448-4b15-b2f3-3ea588a979a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:02.183762 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a58645-e448-4b15-b2f3-3ea588a979a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:02.184569 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a58645-e448-4b15-b2f3-3ea588a979a0 None admin] RBAC: Adding query filter params (interface=public, service_id=869de45b6f604ed182c0796213de4757, region_id=RegionOne) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:02.184924 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a58645-e448-4b15-b2f3-3ea588a979a0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:02.186307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a58645-e448-4b15-b2f3-3ea588a979a0 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:02.189605 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-6bfb19db-1cd0-4375-9a10-ffd2726814c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:39:02.189605 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:02.189605 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:02.189605 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:02.189605 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:02.189605 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:02.189605 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:02.189605 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:02.189605 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:02.189605 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:02.189605 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:02.189605 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:02.189605 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:39:02.189605 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:39:02.189605 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:39:02.190505 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:39:02.190505 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:02.190505 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:02.190505 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:02.190505 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:02.190505 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:02.190505 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:02.190505 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:02.190505 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:02.190505 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:02.190505 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:02.190505 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:02.190505 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:02.190505 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:02.190505 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:02.190505 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:02.190505 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:02.191372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:39:02.191372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:39:02.191372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:39:02.191372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:39:02.191372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:39:02.191372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:39:02.191372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:39:02.191372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:02.198296 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 392/769] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:39:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:02.200039 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 377/769] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Aug 3 12:39:01 2022] GET /identity/v3/endpoints?service_id=869de45b6f604ed182c0796213de4757&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:02.200586 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb19db-1cd0-4375-9a10-ffd2726814c7 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:02.200988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a58645-e448-4b15-b2f3-3ea588a979a0 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:02.251721 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:02.321171 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb19db-1cd0-4375-9a10-ffd2726814c7 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:02.322166 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a58645-e448-4b15-b2f3-3ea588a979a0 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:02.329913 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:02.358843 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeeae74-c267-4d52-a46c-30eb123d0c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:02.359452 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeeae74-c267-4d52-a46c-30eb123d0c80 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:02.359732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeeae74-c267-4d52-a46c-30eb123d0c80 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:02.359849 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af47ce86-e34f-475a-886e-35138911cbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:02.360055 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeeae74-c267-4d52-a46c-30eb123d0c80 None admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:02.360415 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47ce86-e34f-475a-886e-35138911cbe4 None admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:02.360745 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeeae74-c267-4d52-a46c-30eb123d0c80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:02.360841 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47ce86-e34f-475a-886e-35138911cbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:02.361029 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47ce86-e34f-475a-886e-35138911cbe4 None admin] PATH_INFO: `/v3/projects/6ac833dfff634496816842c851545d21/users/dcf670ff4f62486dbf70cf6ea0f08bbb/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:02.361139 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeeae74-c267-4d52-a46c-30eb123d0c80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:02.362472 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeeae74-c267-4d52-a46c-30eb123d0c80 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:02.363209 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af47ce86-e34f-475a-886e-35138911cbe4 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ac833dfff634496816842c851545d21, user_id=dcf670ff4f62486dbf70cf6ea0f08bbb, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:02.364677 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af47ce86-e34f-475a-886e-35138911cbe4 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:02.375033 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 378/770] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 3 12:39:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:02.375937 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeeae74-c267-4d52-a46c-30eb123d0c80 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:02.382299 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 393/771] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 3 12:39:02 2022] PUT /identity/v3/projects/6ac833dfff634496816842c851545d21/users/dcf670ff4f62486dbf70cf6ea0f08bbb/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:39:02.383784 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cdfc8-0728-4a5a-9205-e97f47799058 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:02.384313 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cdfc8-0728-4a5a-9205-e97f47799058 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:02.385362 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cdfc8-0728-4a5a-9205-e97f47799058 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:02.388481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 394/772] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:02.390001 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470cdfc8-0728-4a5a-9205-e97f47799058 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:02.490408 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeeae74-c267-4d52-a46c-30eb123d0c80 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:02.532283 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424fb87e-7f80-4801-8977-180bdb4ff42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:02.532952 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424fb87e-7f80-4801-8977-180bdb4ff42c None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:02.533297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424fb87e-7f80-4801-8977-180bdb4ff42c None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:02.533725 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424fb87e-7f80-4801-8977-180bdb4ff42c None admin] PATH_INFO: `/v3/services` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:02.534436 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424fb87e-7f80-4801-8977-180bdb4ff42c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:02.535878 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424fb87e-7f80-4801-8977-180bdb4ff42c None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:02.540102 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:02.543661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 379/773] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Aug 3 12:39:02 2022] GET /identity/v3/services => generated 772 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:02.545053 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e10421-a300-4432-9d48-1af063f88ef2 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:02.545408 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e10421-a300-4432-9d48-1af063f88ef2 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:02.547568 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e10421-a300-4432-9d48-1af063f88ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:02.560400 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470cdfc8-0728-4a5a-9205-e97f47799058 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:02.570258 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-40e10421-a300-4432-9d48-1af063f88ef2 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:02.572243 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-40e10421-a300-4432-9d48-1af063f88ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:02.604624 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173972a3-00a8-47b2-86bd-ef1b6a255a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:02.605258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173972a3-00a8-47b2-86bd-ef1b6a255a5d None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:02.605742 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173972a3-00a8-47b2-86bd-ef1b6a255a5d None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:02.605929 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173972a3-00a8-47b2-86bd-ef1b6a255a5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:02.607571 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173972a3-00a8-47b2-86bd-ef1b6a255a5d None admin] RBAC: Adding query filter params (role.id=39d74def259b415ca634ad9c715e1332, scope.project.id=6ac833dfff634496816842c851545d21, user.id=a994c976b95744ed9723bf9c4386bde1) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:02.607900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173972a3-00a8-47b2-86bd-ef1b6a255a5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:02.609321 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:02.609443 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173972a3-00a8-47b2-86bd-ef1b6a255a5d None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:02.616130 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 395/774] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:39:02 2022] GET /identity/v3/role_assignments?user.id=a994c976b95744ed9723bf9c4386bde1&scope.project.id=6ac833dfff634496816842c851545d21&role.id=39d74def259b415ca634ad9c715e1332 => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:02.664700 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 380/775] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:39:02.695961 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173972a3-00a8-47b2-86bd-ef1b6a255a5d None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:02.829609 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173972a3-00a8-47b2-86bd-ef1b6a255a5d None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:02.866670 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5672f58-6d05-40fa-9f08-96d03dbb781a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:02.867328 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5672f58-6d05-40fa-9f08-96d03dbb781a None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:02.867605 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5672f58-6d05-40fa-9f08-96d03dbb781a None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:02.867875 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5672f58-6d05-40fa-9f08-96d03dbb781a None admin] PATH_INFO: `/v3/services/network` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:02.868505 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5672f58-6d05-40fa-9f08-96d03dbb781a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:02.869899 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5672f58-6d05-40fa-9f08-96d03dbb781a None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:02.879270 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-f5672f58-6d05-40fa-9f08-96d03dbb781a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 03 12:39:02.879270 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:02.879270 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:39:02.879270 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:39:02.879270 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:39:02.879270 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:39:02.879270 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:39:02.879270 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:02.879270 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 03 12:39:02.879270 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:02.879270 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:39:02.879270 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:02.879270 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:02.879270 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:02.879270 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:02.879270 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:02.879270 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:02.880276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:02.880276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:02.880276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:02.880276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:02.880276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:02.880276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:02.880276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:39:02.880276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:39:02.880276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:39:02.880276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:39:02.880276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:02.880276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:02.880276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:02.880276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:02.880276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:02.880276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:02.881614 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:02.881614 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:02.881614 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:02.881614 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:02.881614 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:02.881614 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:02.881614 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:02.881614 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:02.881614 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:02.881614 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:02.881614 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:39:02.881614 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:02.881614 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 03 12:39:02.881614 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:02.881614 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 396/776] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:39:02 2022] GET /identity/v3/services/network => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:02.886923 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e10421-a300-4432-9d48-1af063f88ef2 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:02.998416 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e10421-a300-4432-9d48-1af063f88ef2 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:03.039519 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd3f16-12e7-4e0e-b161-92d35105d4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:03.040137 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd3f16-12e7-4e0e-b161-92d35105d4aa None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:03.040413 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd3f16-12e7-4e0e-b161-92d35105d4aa None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:03.040683 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd3f16-12e7-4e0e-b161-92d35105d4aa None admin] PATH_INFO: `/v3/services` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:03.041420 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd3f16-12e7-4e0e-b161-92d35105d4aa None admin] RBAC: Adding query filter params (name=network) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:03.041755 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd3f16-12e7-4e0e-b161-92d35105d4aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:03.043697 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd3f16-12e7-4e0e-b161-92d35105d4aa None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:03.048778 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 381/777] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Aug 3 12:39:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:03.054246 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5672f58-6d05-40fa-9f08-96d03dbb781a None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:03.082841 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:03.164335 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5672f58-6d05-40fa-9f08-96d03dbb781a None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:03.200064 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77050c76-5497-4022-a83c-84073f5ddf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:03.201235 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77050c76-5497-4022-a83c-84073f5ddf47 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:03.201710 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77050c76-5497-4022-a83c-84073f5ddf47 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:03.201993 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77050c76-5497-4022-a83c-84073f5ddf47 None admin] PATH_INFO: `/v3/services` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:03.202676 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77050c76-5497-4022-a83c-84073f5ddf47 None admin] RBAC: Adding query filter params (type=network) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:03.202975 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77050c76-5497-4022-a83c-84073f5ddf47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:03.204336 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77050c76-5497-4022-a83c-84073f5ddf47 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:03.209694 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 397/778] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Aug 3 12:39:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:03.218131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a84c92-536b-4d33-867f-70f5bb2f3dff None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:03.218419 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a84c92-536b-4d33-867f-70f5bb2f3dff None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:03.218700 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a84c92-536b-4d33-867f-70f5bb2f3dff None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:03.219033 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77050c76-5497-4022-a83c-84073f5ddf47 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:03.220317 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 382/779] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:03.225256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3b7a8-8d3b-4fc9-b78d-177715484c11 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:03.225569 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3b7a8-8d3b-4fc9-b78d-177715484c11 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:03.225848 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3b7a8-8d3b-4fc9-b78d-177715484c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:03.258711 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-54d3b7a8-8d3b-4fc9-b78d-177715484c11 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:03.259921 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-54d3b7a8-8d3b-4fc9-b78d-177715484c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:03.291461 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:03.331220 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:03.349037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77050c76-5497-4022-a83c-84073f5ddf47 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:03.382631 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61f5b6-768e-46cf-9c83-1654a8b16457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:03.383255 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61f5b6-768e-46cf-9c83-1654a8b16457 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:03.383534 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61f5b6-768e-46cf-9c83-1654a8b16457 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:03.383807 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61f5b6-768e-46cf-9c83-1654a8b16457 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:03.387734 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61f5b6-768e-46cf-9c83-1654a8b16457 None admin] RBAC: Adding query filter params (interface=public, service_id=607fa1054230419f82a01fd86c855942, region_id=RegionOne) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:03.387734 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61f5b6-768e-46cf-9c83-1654a8b16457 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:03.387734 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61f5b6-768e-46cf-9c83-1654a8b16457 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:03.394009 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 398/780] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Aug 3 12:39:03 2022] GET /identity/v3/endpoints?service_id=607fa1054230419f82a01fd86c855942&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:03.399261 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61f5b6-768e-46cf-9c83-1654a8b16457 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:03.400525 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 383/781] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:39:03.439695 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3b7a8-8d3b-4fc9-b78d-177715484c11 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:03.502292 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61f5b6-768e-46cf-9c83-1654a8b16457 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:03.536868 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8200a39-3ffb-4b76-95e4-42a1240d66ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:03.537979 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8200a39-3ffb-4b76-95e4-42a1240d66ad None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:03.538259 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8200a39-3ffb-4b76-95e4-42a1240d66ad None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:03.538533 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8200a39-3ffb-4b76-95e4-42a1240d66ad None admin] PATH_INFO: `/v3/services` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:03.539184 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8200a39-3ffb-4b76-95e4-42a1240d66ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:03.540551 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8200a39-3ffb-4b76-95e4-42a1240d66ad None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:03.546082 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 399/782] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Aug 3 12:39:03 2022] GET /identity/v3/services => generated 772 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:03.662900 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3b7a8-8d3b-4fc9-b78d-177715484c11 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:03.713596 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530fae0d-0fbb-43ec-8f2f-fa0c0227ab01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:03.714245 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fae0d-0fbb-43ec-8f2f-fa0c0227ab01 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:03.714529 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fae0d-0fbb-43ec-8f2f-fa0c0227ab01 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:03.714945 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fae0d-0fbb-43ec-8f2f-fa0c0227ab01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:03.725776 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530fae0d-0fbb-43ec-8f2f-fa0c0227ab01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:39:03.731445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-530fae0d-0fbb-43ec-8f2f-fa0c0227ab01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:39:03.731445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:03.731445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:03.731445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:03.731445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:03.731445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:03.731445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:03.731445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:03.731445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:03.731445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:03.731445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:03.731445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:03.731445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:39:03.731445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:39:03.731445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:39:03.731445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:39:03.732356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:39:03.732356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:39:03.732356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:39:03.732356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:39:03.732356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:03.732356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:03.732356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:03.732356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:03.732356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:03.732356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:03.732356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:03.732356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:03.732356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:03.732356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:03.732356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:03.732356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:03.733179 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:03.733179 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:03.733179 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:03.733179 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:03.733179 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:39:03.733179 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:39:03.733179 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:39:03.733179 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:39:03.733179 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:39:03.733179 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:39:03.733179 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:39:03.733179 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:03.733179 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 384/783] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 3 12:39:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:39:03.740664 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8200a39-3ffb-4b76-95e4-42a1240d66ad None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:03.767381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:03.897281 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8200a39-3ffb-4b76-95e4-42a1240d66ad None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:03.947996 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fffdff7-3148-45da-a868-11ba70b28541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:03.948564 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffdff7-3148-45da-a868-11ba70b28541 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:03.948854 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffdff7-3148-45da-a868-11ba70b28541 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:03.949701 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffdff7-3148-45da-a868-11ba70b28541 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:03.950472 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fffdff7-3148-45da-a868-11ba70b28541 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:03.950780 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fffdff7-3148-45da-a868-11ba70b28541 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:03.952221 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fffdff7-3148-45da-a868-11ba70b28541 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:03.966459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 400/784] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:39:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:03.971974 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530fae0d-0fbb-43ec-8f2f-fa0c0227ab01 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:03.997402 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:04.136137 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530fae0d-0fbb-43ec-8f2f-fa0c0227ab01 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:04.186555 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c8355-6c6d-4a6b-b7f0-15f451dff8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:04.187209 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c8355-6c6d-4a6b-b7f0-15f451dff8a1 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:04.187495 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c8355-6c6d-4a6b-b7f0-15f451dff8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:04.187836 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c8355-6c6d-4a6b-b7f0-15f451dff8a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:04.198959 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c8355-6c6d-4a6b-b7f0-15f451dff8a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:04.200693 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c8355-6c6d-4a6b-b7f0-15f451dff8a1 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:04.217752 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-1f6c8355-6c6d-4a6b-b7f0-15f451dff8a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:04.217752 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:04.217752 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:04.217752 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:04.217752 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:04.217752 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:04.217752 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:04.217752 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:04.217752 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:04.217752 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:04.217752 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:04.217752 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:04.217752 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:39:04.217752 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:39:04.217752 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:39:04.218668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:39:04.218668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:04.218668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:04.218668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:04.218668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:04.218668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:04.218668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:04.218668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:04.218668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:04.218668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:04.218668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:04.218668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:04.218668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:04.218668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:04.218668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:04.218668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:04.218668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:04.219554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:39:04.219554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:39:04.219554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:04.219554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:04.219554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 385/785] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:39:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:04.226600 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fffdff7-3148-45da-a868-11ba70b28541 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:04.367512 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:04.397258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fffdff7-3148-45da-a868-11ba70b28541 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:04.447393 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e93555-710d-449b-a36f-7596c0456e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:04.448018 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e93555-710d-449b-a36f-7596c0456e07 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:04.448300 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e93555-710d-449b-a36f-7596c0456e07 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:04.448578 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e93555-710d-449b-a36f-7596c0456e07 None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:04.449933 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e93555-710d-449b-a36f-7596c0456e07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:04.450184 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e93555-710d-449b-a36f-7596c0456e07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:04.451564 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e93555-710d-449b-a36f-7596c0456e07 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:04.472933 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 401/786] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:04.482655 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c8355-6c6d-4a6b-b7f0-15f451dff8a1 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:04.601901 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:04.633309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c8355-6c6d-4a6b-b7f0-15f451dff8a1 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:04.680628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26ad36-e707-4f40-89f1-9aaf2b7fb107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:04.681410 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26ad36-e707-4f40-89f1-9aaf2b7fb107 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:04.681636 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26ad36-e707-4f40-89f1-9aaf2b7fb107 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:04.681913 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26ad36-e707-4f40-89f1-9aaf2b7fb107 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:04.692857 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26ad36-e707-4f40-89f1-9aaf2b7fb107 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:04.698353 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26ad36-e707-4f40-89f1-9aaf2b7fb107 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:04.710508 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-dc26ad36-e707-4f40-89f1-9aaf2b7fb107 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 03 12:39:04.710508 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:04.710508 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:04.710508 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:04.710508 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:04.710508 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:04.710508 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:04.710508 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:04.710508 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:04.710508 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:04.710508 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:04.710508 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:04.710508 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:39:04.710508 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:39:04.710508 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:39:04.710508 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:39:04.711429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:04.711429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:04.711429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:39:04.711429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:39:04.711429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:39:04.711429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:39:04.711429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:04.711429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:04.711429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:04.711429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:04.711429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:04.711429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:04.711429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:04.711429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:04.711429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:04.711429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:04.711429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:04.711429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:04.712380 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:04.712380 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:04.712380 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:39:04.712380 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:39:04.712380 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:39:04.712380 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:39:04.712380 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:39:04.712380 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:39:04.712380 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 03 12:39:04.712380 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:04.712380 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 386/787] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 3 12:39:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:04.719682 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e93555-710d-449b-a36f-7596c0456e07 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:04.881442 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e93555-710d-449b-a36f-7596c0456e07 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:04.920470 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca81bd9-52cc-4212-934d-dc1def862d1d None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:04.920805 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca81bd9-52cc-4212-934d-dc1def862d1d None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:04.921129 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca81bd9-52cc-4212-934d-dc1def862d1d None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:04.924010 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 387/788] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:04.929890 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa682dbe-a98f-4de7-89c7-c4465f597b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:04.930519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa682dbe-a98f-4de7-89c7-c4465f597b77 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:04.930803 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa682dbe-a98f-4de7-89c7-c4465f597b77 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:04.930994 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd8d04-7696-4cc6-801a-473d57ec61ab None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:04.931090 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa682dbe-a98f-4de7-89c7-c4465f597b77 None admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:04.931265 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd8d04-7696-4cc6-801a-473d57ec61ab None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:04.931502 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd8d04-7696-4cc6-801a-473d57ec61ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:04.931868 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa682dbe-a98f-4de7-89c7-c4465f597b77 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:04.932179 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa682dbe-a98f-4de7-89c7-c4465f597b77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:04.933959 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa682dbe-a98f-4de7-89c7-c4465f597b77 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:04.936802 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:04.954676 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 402/789] 10.222.0.46 () {56 vars in 1135 bytes} [Wed Aug 3 12:39:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:04.962575 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa682dbe-a98f-4de7-89c7-c4465f597b77 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:04.962821 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-16bd8d04-7696-4cc6-801a-473d57ec61ab None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:04.964225 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-16bd8d04-7696-4cc6-801a-473d57ec61ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:05.083799 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 388/790] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:39:05.108189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc6aee-090f-47f1-91ac-b6462222880e None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:05.108720 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc6aee-090f-47f1-91ac-b6462222880e None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:05.109181 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc6aee-090f-47f1-91ac-b6462222880e None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:05.110971 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 389/791] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:39:05.118807 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a478d9-a6a8-4ad5-aa06-e160802fd703 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:05.119085 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a478d9-a6a8-4ad5-aa06-e160802fd703 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:05.119356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a478d9-a6a8-4ad5-aa06-e160802fd703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:05.135172 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa682dbe-a98f-4de7-89c7-c4465f597b77 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:05.139237 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-91a478d9-a6a8-4ad5-aa06-e160802fd703 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:05.140433 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-91a478d9-a6a8-4ad5-aa06-e160802fd703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:05.172830 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c4637-77f5-45d9-a619-cfd020d32b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:05.173483 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c4637-77f5-45d9-a619-cfd020d32b91 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:05.173787 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c4637-77f5-45d9-a619-cfd020d32b91 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:05.174061 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c4637-77f5-45d9-a619-cfd020d32b91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:05.184714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c4637-77f5-45d9-a619-cfd020d32b91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:05.186203 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c4637-77f5-45d9-a619-cfd020d32b91 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:05.197120 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:05.201856 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-628c4637-77f5-45d9-a619-cfd020d32b91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:05.201856 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:05.201856 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:05.201856 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:05.201856 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:05.201856 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:05.201856 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:05.201856 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:05.201856 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:05.201856 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:05.201856 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:05.201856 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:05.201856 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:39:05.201856 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:39:05.201856 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:39:05.202762 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:39:05.202762 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:05.202762 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:05.202762 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:05.202762 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:05.202762 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:05.202762 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:05.202762 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:05.202762 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:05.202762 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:05.202762 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:05.202762 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:05.202762 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:05.202762 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:05.202762 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:05.202762 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:05.202762 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:05.203677 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:39:05.203677 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:39:05.203677 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:05.203677 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:05.203677 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 403/792] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:39:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:05.204350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c4637-77f5-45d9-a619-cfd020d32b91 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:05.219870 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 390/793] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:39:05.221917 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a478d9-a6a8-4ad5-aa06-e160802fd703 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:05.271178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:05.332981 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c4637-77f5-45d9-a619-cfd020d32b91 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:05.358344 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a478d9-a6a8-4ad5-aa06-e160802fd703 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:05.369366 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b8131-cc45-49a8-bbef-45014a3d72c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:05.370264 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b8131-cc45-49a8-bbef-45014a3d72c5 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:05.370691 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b8131-cc45-49a8-bbef-45014a3d72c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:05.371137 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b8131-cc45-49a8-bbef-45014a3d72c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:05.382145 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b8131-cc45-49a8-bbef-45014a3d72c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:39:05.388698 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-8e4b8131-cc45-49a8-bbef-45014a3d72c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:39:05.388698 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:05.388698 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:05.388698 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:05.388698 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:05.388698 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:05.388698 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:05.388698 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:05.388698 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:05.388698 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:05.388698 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:05.388698 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:05.388698 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:39:05.388698 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:39:05.388698 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:39:05.388698 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:39:05.389840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:39:05.389840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:39:05.389840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:39:05.389840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:39:05.389840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:05.389840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:05.389840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:05.389840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:05.389840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:05.389840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:05.389840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:05.389840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:05.389840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:05.389840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:05.389840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:05.389840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:05.390770 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:05.390770 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:05.390770 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:05.390770 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:05.390770 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:39:05.390770 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:39:05.390770 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:39:05.390770 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:39:05.390770 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:39:05.390770 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:39:05.390770 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:39:05.390770 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:05.397544 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 404/794] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 3 12:39:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:05.397544 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b8131-cc45-49a8-bbef-45014a3d72c5 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:05.404786 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522dbf19-8c9f-4dcc-925b-c4ce63a105f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:05.405731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522dbf19-8c9f-4dcc-925b-c4ce63a105f2 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:05.406216 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522dbf19-8c9f-4dcc-925b-c4ce63a105f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:05.406690 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522dbf19-8c9f-4dcc-925b-c4ce63a105f2 None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:05.407707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522dbf19-8c9f-4dcc-925b-c4ce63a105f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:05.408301 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522dbf19-8c9f-4dcc-925b-c4ce63a105f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:05.409970 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522dbf19-8c9f-4dcc-925b-c4ce63a105f2 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:05.423730 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 391/795] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:05.424947 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522dbf19-8c9f-4dcc-925b-c4ce63a105f2 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:05.486478 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:05.509184 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b8131-cc45-49a8-bbef-45014a3d72c5 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:05.516752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:05.545322 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebf0e5-53d3-4238-a80f-12ea2191b6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:05.545994 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebf0e5-53d3-4238-a80f-12ea2191b6f2 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:05.546275 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebf0e5-53d3-4238-a80f-12ea2191b6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:05.546546 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebf0e5-53d3-4238-a80f-12ea2191b6f2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:05.546640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522dbf19-8c9f-4dcc-925b-c4ce63a105f2 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:05.547178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beebf0e5-53d3-4238-a80f-12ea2191b6f2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:05.548542 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beebf0e5-53d3-4238-a80f-12ea2191b6f2 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:05.557545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-beebf0e5-53d3-4238-a80f-12ea2191b6f2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 03 12:39:05.557545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:05.557545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:39:05.557545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:39:05.557545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:39:05.557545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:39:05.557545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:39:05.557545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:05.557545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 03 12:39:05.557545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:05.557545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:39:05.557545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:05.557545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:05.557545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:05.557545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:05.557545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:05.559041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:05.559041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:05.559041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:05.559041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:05.559041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:05.559041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:05.559041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:05.559041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:39:05.559041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:39:05.559041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:39:05.559041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:39:05.559041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:05.559041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:05.559041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:05.559041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:05.559041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:05.559852 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:05.559852 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:05.559852 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:05.559852 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:05.559852 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:05.559852 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:05.559852 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:05.559852 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:05.559852 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:05.559852 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:05.559852 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:05.559852 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:39:05.559852 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:05.559852 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 03 12:39:05.559852 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:05.559852 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 405/796] 10.222.0.46 () {56 vars in 1129 bytes} [Wed Aug 3 12:39:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:05.560673 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebf0e5-53d3-4238-a80f-12ea2191b6f2 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:05.589009 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca95ae4-ba8d-425f-8148-2c4d82a789ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:05.589708 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca95ae4-ba8d-425f-8148-2c4d82a789ae None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:05.589995 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca95ae4-ba8d-425f-8148-2c4d82a789ae None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:05.590273 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca95ae4-ba8d-425f-8148-2c4d82a789ae None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:05.590993 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca95ae4-ba8d-425f-8148-2c4d82a789ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:05.591303 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca95ae4-ba8d-425f-8148-2c4d82a789ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:05.592664 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca95ae4-ba8d-425f-8148-2c4d82a789ae None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:05.601940 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 392/797] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:39:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:05.602984 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116ceb5-d398-46da-a7ef-576f52e5afba None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:05.603271 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116ceb5-d398-46da-a7ef-576f52e5afba None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:05.603545 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116ceb5-d398-46da-a7ef-576f52e5afba None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:05.604899 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 393/798] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:05.606328 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116ceb5-d398-46da-a7ef-576f52e5afba None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:05.675341 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebf0e5-53d3-4238-a80f-12ea2191b6f2 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:05.713456 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88d612-836a-4871-9113-ba40ce02d3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:05.714116 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88d612-836a-4871-9113-ba40ce02d3fc None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:05.714397 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88d612-836a-4871-9113-ba40ce02d3fc None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:05.715328 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88d612-836a-4871-9113-ba40ce02d3fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:05.716842 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116ceb5-d398-46da-a7ef-576f52e5afba None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:05.722599 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88d612-836a-4871-9113-ba40ce02d3fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:05.724112 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88d612-836a-4871-9113-ba40ce02d3fc None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:05.726970 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:05.736439 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-6a88d612-836a-4871-9113-ba40ce02d3fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:39:05.736439 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:05.736439 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:05.736439 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:05.736439 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:05.736439 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:05.736439 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:05.736439 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:05.736439 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:05.736439 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:05.736439 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:05.736439 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:05.736439 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:39:05.736439 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:39:05.736439 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:39:05.737565 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:39:05.737565 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:05.737565 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:05.737565 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:05.737565 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:05.737565 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:05.737565 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:05.737565 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:05.737565 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:05.737565 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:05.737565 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:05.737565 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:05.737565 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:05.737565 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:05.737565 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:05.737565 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:05.737565 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:05.738573 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:39:05.738573 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:39:05.738573 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:39:05.738573 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:39:05.738573 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:39:05.738573 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:39:05.738573 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:39:05.738573 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:05.738573 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 406/799] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:39:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:05.743378 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88d612-836a-4871-9113-ba40ce02d3fc None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:05.757028 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e521a-1b31-4486-9003-617d7e81358f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:05.757761 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e521a-1b31-4486-9003-617d7e81358f None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:05.758114 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e521a-1b31-4486-9003-617d7e81358f None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:05.758482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e521a-1b31-4486-9003-617d7e81358f None admin] PATH_INFO: `/v3/services` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:05.759189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e521a-1b31-4486-9003-617d7e81358f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:05.759471 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e521a-1b31-4486-9003-617d7e81358f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:05.760827 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e521a-1b31-4486-9003-617d7e81358f None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:05.769996 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 394/800] 10.222.0.46 () {56 vars in 1124 bytes} [Wed Aug 3 12:39:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:05.769996 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2556930-c0ea-4f89-918f-2352e9012b8d None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:05.769996 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2556930-c0ea-4f89-918f-2352e9012b8d None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:05.769996 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2556930-c0ea-4f89-918f-2352e9012b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:05.782550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:05.786028 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-a2556930-c0ea-4f89-918f-2352e9012b8d None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:05.787234 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-a2556930-c0ea-4f89-918f-2352e9012b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:05.858332 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88d612-836a-4871-9113-ba40ce02d3fc None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:05.859053 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 395/801] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:39:05.860038 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2556930-c0ea-4f89-918f-2352e9012b8d None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:05.904081 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d531b6-386e-4779-bd97-1339fd093fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:05.904732 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d531b6-386e-4779-bd97-1339fd093fdd None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:05.905016 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d531b6-386e-4779-bd97-1339fd093fdd None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:05.905296 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d531b6-386e-4779-bd97-1339fd093fdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:05.917013 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d531b6-386e-4779-bd97-1339fd093fdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:05.919206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d531b6-386e-4779-bd97-1339fd093fdd None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:05.933888 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-24d531b6-386e-4779-bd97-1339fd093fdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:05.933888 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:05.933888 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:05.933888 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:05.933888 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:05.933888 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:05.933888 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:05.933888 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:05.933888 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:05.933888 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:05.933888 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:05.933888 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:05.933888 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:39:05.933888 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:39:05.933888 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:39:05.935356 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:39:05.935356 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:05.935356 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:05.935356 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:05.935356 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:05.935356 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:05.935356 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:05.935356 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:05.935356 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:05.935356 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:05.935356 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:05.935356 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:05.935356 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:05.935356 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:05.935356 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:05.935356 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:05.935356 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:05.936230 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:39:05.936230 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:39:05.936230 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:05.936230 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:05.936230 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 407/802] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:39:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:05.936521 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d531b6-386e-4779-bd97-1339fd093fdd None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:05.984415 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2556930-c0ea-4f89-918f-2352e9012b8d None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:05.986097 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:06.021285 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4fc029-7336-434e-9400-0c9876dc7c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:06.021926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4fc029-7336-434e-9400-0c9876dc7c6c None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:06.022206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4fc029-7336-434e-9400-0c9876dc7c6c None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:06.022481 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4fc029-7336-434e-9400-0c9876dc7c6c None admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:06.023233 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4fc029-7336-434e-9400-0c9876dc7c6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:06.023539 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4fc029-7336-434e-9400-0c9876dc7c6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:06.024955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4fc029-7336-434e-9400-0c9876dc7c6c None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:06.025524 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:06.037079 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 396/803] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 3 12:39:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:06.037913 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4fc029-7336-434e-9400-0c9876dc7c6c None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:06.045107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d531b6-386e-4779-bd97-1339fd093fdd None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:06.078136 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e75cb-7788-4290-96c5-09ec457c149d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:06.078746 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e75cb-7788-4290-96c5-09ec457c149d None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:06.079024 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e75cb-7788-4290-96c5-09ec457c149d None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:06.079294 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e75cb-7788-4290-96c5-09ec457c149d None admin] PATH_INFO: `/v3/services` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:06.079967 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e75cb-7788-4290-96c5-09ec457c149d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:06.080266 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e75cb-7788-4290-96c5-09ec457c149d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:06.081655 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e75cb-7788-4290-96c5-09ec457c149d None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:06.086358 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 408/804] 10.222.0.46 () {56 vars in 1124 bytes} [Wed Aug 3 12:39:05 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:06.087116 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e75cb-7788-4290-96c5-09ec457c149d None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:06.136141 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4fc029-7336-434e-9400-0c9876dc7c6c None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:06.170196 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54798d2-6cc2-4acb-9476-8946fe9ef81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:06.170838 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54798d2-6cc2-4acb-9476-8946fe9ef81c None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:06.171122 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54798d2-6cc2-4acb-9476-8946fe9ef81c None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:06.171398 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54798d2-6cc2-4acb-9476-8946fe9ef81c None admin] PATH_INFO: `/v3/roles/service` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:06.181474 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54798d2-6cc2-4acb-9476-8946fe9ef81c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:39:06.187099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-f54798d2-6cc2-4acb-9476-8946fe9ef81c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:39:06.187099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:06.187099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:06.187099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:06.187099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:06.187099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:06.187099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:06.187099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:06.187099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:06.187099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:06.187099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:06.187099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:06.187099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:39:06.187099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:39:06.187099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:39:06.187099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:39:06.188158 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:39:06.188158 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:39:06.188158 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:39:06.188158 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:39:06.188158 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:06.188158 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:06.188158 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:06.188158 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:06.188158 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:06.188158 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:06.188158 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:06.188158 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:06.188158 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:06.188158 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:06.188158 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:06.188158 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:06.189156 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:06.189156 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:06.189156 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:06.189156 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:06.189156 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:39:06.189156 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:39:06.189156 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:39:06.189156 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:39:06.189156 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:39:06.189156 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:39:06.189156 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:39:06.189156 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:06.189156 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 397/805] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 3 12:39:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:06.189989 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e2e38-89bc-4f92-9b37-d9308d5a6edd None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:06.189989 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e2e38-89bc-4f92-9b37-d9308d5a6edd None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:06.190242 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e2e38-89bc-4f92-9b37-d9308d5a6edd None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:06.191493 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 398/806] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:06.192162 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e2e38-89bc-4f92-9b37-d9308d5a6edd None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:06.194640 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e75cb-7788-4290-96c5-09ec457c149d None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:06.217822 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:06.230169 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868c609-d5e8-48cf-b95a-a0fe0926a4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:06.231067 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868c609-d5e8-48cf-b95a-a0fe0926a4bc None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:06.231353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868c609-d5e8-48cf-b95a-a0fe0926a4bc None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:06.231631 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868c609-d5e8-48cf-b95a-a0fe0926a4bc None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:06.232331 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868c609-d5e8-48cf-b95a-a0fe0926a4bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:06.232641 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868c609-d5e8-48cf-b95a-a0fe0926a4bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:06.234059 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868c609-d5e8-48cf-b95a-a0fe0926a4bc None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:06.246719 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 409/807] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:06.248061 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868c609-d5e8-48cf-b95a-a0fe0926a4bc None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:06.256253 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:06.301637 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e2e38-89bc-4f92-9b37-d9308d5a6edd None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:06.336515 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4219e0-1517-4a1f-80e7-72a0d846e316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:06.337396 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4219e0-1517-4a1f-80e7-72a0d846e316 None admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:06.337698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4219e0-1517-4a1f-80e7-72a0d846e316 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:06.337981 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4219e0-1517-4a1f-80e7-72a0d846e316 None admin] PATH_INFO: `/v3/projects/6ac833dfff634496816842c851545d21/users/67df369737ea4c83bae134f4bf2de20d/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:06.340006 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4219e0-1517-4a1f-80e7-72a0d846e316 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ac833dfff634496816842c851545d21, user_id=67df369737ea4c83bae134f4bf2de20d, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:06.341439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4219e0-1517-4a1f-80e7-72a0d846e316 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:06.351855 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868c609-d5e8-48cf-b95a-a0fe0926a4bc None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:06.354209 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 399/808] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 3 12:39:06 2022] PUT /identity/v3/projects/6ac833dfff634496816842c851545d21/users/67df369737ea4c83bae134f4bf2de20d/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:39:06.355005 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4219e0-1517-4a1f-80e7-72a0d846e316 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:06.394160 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618aae0d-4f6e-4179-b283-5af27dc8fc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:06.394785 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618aae0d-4f6e-4179-b283-5af27dc8fc64 None admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:06.395112 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618aae0d-4f6e-4179-b283-5af27dc8fc64 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:06.395334 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618aae0d-4f6e-4179-b283-5af27dc8fc64 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:06.396613 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618aae0d-4f6e-4179-b283-5af27dc8fc64 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:06.397528 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618aae0d-4f6e-4179-b283-5af27dc8fc64 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:06.431578 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 410/809] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:39:06 2022] POST /identity/v3/endpoints => generated 346 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:39:06.432915 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ada500-d72d-4200-974a-e4cb5b2190f4 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:06.433206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ada500-d72d-4200-974a-e4cb5b2190f4 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:06.434087 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ada500-d72d-4200-974a-e4cb5b2190f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:06.455565 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:06.470151 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-25ada500-d72d-4200-974a-e4cb5b2190f4 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:06.472739 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-25ada500-d72d-4200-974a-e4cb5b2190f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:06.481924 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4219e0-1517-4a1f-80e7-72a0d846e316 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:06.546193 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d87ef8-b902-4e94-a368-0d6bef8ea877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:06.546825 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d87ef8-b902-4e94-a368-0d6bef8ea877 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:06.547111 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d87ef8-b902-4e94-a368-0d6bef8ea877 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:06.547387 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d87ef8-b902-4e94-a368-0d6bef8ea877 None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:06.548137 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d87ef8-b902-4e94-a368-0d6bef8ea877 None admin] RBAC: Adding query filter params (name=service) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:06.548445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d87ef8-b902-4e94-a368-0d6bef8ea877 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:06.549898 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d87ef8-b902-4e94-a368-0d6bef8ea877 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:06.557608 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:06.559916 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 400/810] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 3 12:39:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:06.561023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d87ef8-b902-4e94-a368-0d6bef8ea877 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:06.578410 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 411/811] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:39:06.578919 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ada500-d72d-4200-974a-e4cb5b2190f4 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:06.701279 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d87ef8-b902-4e94-a368-0d6bef8ea877 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:06.703012 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ada500-d72d-4200-974a-e4cb5b2190f4 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:06.741649 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433b387-5abe-484d-95e1-77ae66b3ed34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:06.742744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433b387-5abe-484d-95e1-77ae66b3ed34 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:06.743030 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433b387-5abe-484d-95e1-77ae66b3ed34 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:06.743314 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433b387-5abe-484d-95e1-77ae66b3ed34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:06.747671 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1b7b9-df86-4fd4-9f3a-734f31839eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:06.748317 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1b7b9-df86-4fd4-9f3a-734f31839eef None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:06.748599 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1b7b9-df86-4fd4-9f3a-734f31839eef None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:06.748877 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1b7b9-df86-4fd4-9f3a-734f31839eef None admin] PATH_INFO: `/v3/users/nova` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:06.755654 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9433b387-5abe-484d-95e1-77ae66b3ed34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:06.757126 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9433b387-5abe-484d-95e1-77ae66b3ed34 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:06.758482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1b7b9-df86-4fd4-9f3a-734f31839eef None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:06.760629 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1b7b9-df86-4fd4-9f3a-734f31839eef None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:06.764133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:06.775478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-9433b387-5abe-484d-95e1-77ae66b3ed34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:06.775478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:06.775478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:06.775478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:06.775478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:06.775478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:06.775478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:06.775478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:06.775478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:06.775478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:06.775478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:06.775478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:06.775478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:39:06.775478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:39:06.775478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:39:06.776372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:39:06.776372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:06.776372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:06.776372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:06.776372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:06.776372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:06.776372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:06.776372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:06.776372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:06.776372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:06.776372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:06.776372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:06.776372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:06.776372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:06.776372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:06.776372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:06.776372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:06.778382 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:39:06.778382 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:39:06.778382 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:06.778382 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:06.778916 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-12e1b7b9-df86-4fd4-9f3a-734f31839eef None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:39:06.778916 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:06.778916 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:06.778916 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:06.778916 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:06.778916 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:06.778916 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:06.778916 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:06.778916 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:06.778916 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:06.778916 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:06.778916 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:06.778916 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:39:06.778916 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:39:06.778916 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:39:06.778916 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:39:06.779760 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:06.779760 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:06.779760 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:39:06.779760 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:39:06.779760 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:39:06.779760 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:39:06.779760 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:06.779760 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:06.779760 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:06.779760 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:06.779760 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:06.779760 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:06.779760 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:06.779760 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:06.779760 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:06.779760 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:06.779760 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:06.779760 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:06.780677 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:06.780677 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:06.780677 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:39:06.780677 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:39:06.780677 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:39:06.780677 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:39:06.780677 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:39:06.780677 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:39:06.780677 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:39:06.780677 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:06.780677 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 401/813] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Aug 3 12:39:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:06.780677 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1b7b9-df86-4fd4-9f3a-734f31839eef None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:06.782367 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 412/813] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:39:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:06.783298 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433b387-5abe-484d-95e1-77ae66b3ed34 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:06.843219 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:06.911490 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433b387-5abe-484d-95e1-77ae66b3ed34 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:06.923424 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1b7b9-df86-4fd4-9f3a-734f31839eef None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:06.947294 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bce9c4-ec3a-4aa1-9f55-d28a18ae3434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:06.947984 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bce9c4-ec3a-4aa1-9f55-d28a18ae3434 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:06.948268 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bce9c4-ec3a-4aa1-9f55-d28a18ae3434 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:06.948543 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bce9c4-ec3a-4aa1-9f55-d28a18ae3434 None admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:06.950296 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bce9c4-ec3a-4aa1-9f55-d28a18ae3434 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:06.950603 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bce9c4-ec3a-4aa1-9f55-d28a18ae3434 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:06.952066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bce9c4-ec3a-4aa1-9f55-d28a18ae3434 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:06.971337 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 413/814] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Aug 3 12:39:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:06.971539 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95d562-73ef-4e1a-8a5d-a8a2fec01088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:06.972076 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95d562-73ef-4e1a-8a5d-a8a2fec01088 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:06.972298 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bce9c4-ec3a-4aa1-9f55-d28a18ae3434 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:06.972398 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95d562-73ef-4e1a-8a5d-a8a2fec01088 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:06.972692 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95d562-73ef-4e1a-8a5d-a8a2fec01088 None admin] PATH_INFO: `/v3/services/network` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:06.973263 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a95d562-73ef-4e1a-8a5d-a8a2fec01088 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:06.974748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a95d562-73ef-4e1a-8a5d-a8a2fec01088 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:06.985800 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-1a95d562-73ef-4e1a-8a5d-a8a2fec01088 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 03 12:39:06.985800 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:06.985800 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:39:06.985800 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:39:06.985800 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:39:06.985800 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:39:06.985800 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:39:06.985800 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:06.985800 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 03 12:39:06.985800 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:06.985800 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:39:06.985800 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:06.985800 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:06.985800 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:06.985800 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:06.985800 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:06.985800 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:06.986926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:06.986926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:06.986926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:06.986926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:06.986926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:06.986926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:06.986926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:39:06.986926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:39:06.986926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:39:06.986926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:39:06.986926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:06.986926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:06.986926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:06.986926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:06.986926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:06.986926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:06.987766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:06.987766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:06.987766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:06.987766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:06.987766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:06.987766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:06.987766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:06.987766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:06.987766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:06.987766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:06.987766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:39:06.987766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:06.987766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 03 12:39:06.987766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:06.988518 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 402/815] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:39:06 2022] GET /identity/v3/services/network => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:06.989646 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95d562-73ef-4e1a-8a5d-a8a2fec01088 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:07.068963 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:07.101962 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bce9c4-ec3a-4aa1-9f55-d28a18ae3434 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:07.104050 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:07.120030 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95d562-73ef-4e1a-8a5d-a8a2fec01088 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:07.144939 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e68a8-dbc6-42e6-9d29-1ef3b9979691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:07.145840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e68a8-dbc6-42e6-9d29-1ef3b9979691 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:07.146301 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e68a8-dbc6-42e6-9d29-1ef3b9979691 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:07.146861 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e68a8-dbc6-42e6-9d29-1ef3b9979691 None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:07.147700 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e68a8-dbc6-42e6-9d29-1ef3b9979691 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:07.148148 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e68a8-dbc6-42e6-9d29-1ef3b9979691 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:07.149905 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e68a8-dbc6-42e6-9d29-1ef3b9979691 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:07.163435 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 414/816] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:07.163599 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb20cb-493e-49dd-9d29-82d4a1768935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:07.164358 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb20cb-493e-49dd-9d29-82d4a1768935 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:07.164737 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb20cb-493e-49dd-9d29-82d4a1768935 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:07.164959 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e68a8-dbc6-42e6-9d29-1ef3b9979691 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:07.165196 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb20cb-493e-49dd-9d29-82d4a1768935 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:07.247007 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb20cb-493e-49dd-9d29-82d4a1768935 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:07.249336 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb20cb-493e-49dd-9d29-82d4a1768935 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:07.283335 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e68a8-dbc6-42e6-9d29-1ef3b9979691 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:07.314919 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:07.322463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087612ba-9e7c-4490-af0f-151372d321e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:07.323292 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087612ba-9e7c-4490-af0f-151372d321e6 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:07.323813 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087612ba-9e7c-4490-af0f-151372d321e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:07.324257 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087612ba-9e7c-4490-af0f-151372d321e6 None admin] PATH_INFO: `/v3/services` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:07.325149 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087612ba-9e7c-4490-af0f-151372d321e6 None admin] RBAC: Adding query filter params (name=network) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:07.325653 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087612ba-9e7c-4490-af0f-151372d321e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:07.327203 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087612ba-9e7c-4490-af0f-151372d321e6 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:07.332489 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 415/817] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Aug 3 12:39:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:07.333434 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087612ba-9e7c-4490-af0f-151372d321e6 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:07.367390 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 403/818] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:39:06 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:39:07.369098 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb20cb-493e-49dd-9d29-82d4a1768935 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:07.370836 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:07.466024 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087612ba-9e7c-4490-af0f-151372d321e6 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:07.500004 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb20cb-493e-49dd-9d29-82d4a1768935 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:07.508165 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7de517-3a9c-41df-ba11-5573690a894b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:07.508885 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7de517-3a9c-41df-ba11-5573690a894b None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:07.509296 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7de517-3a9c-41df-ba11-5573690a894b None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:07.509673 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7de517-3a9c-41df-ba11-5573690a894b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:07.519920 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7de517-3a9c-41df-ba11-5573690a894b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:07.522011 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7de517-3a9c-41df-ba11-5573690a894b None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:07.536546 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-6d7de517-3a9c-41df-ba11-5573690a894b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 12:39:07.536546 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:07.536546 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:07.536546 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:07.536546 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:07.536546 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:07.536546 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:07.536546 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:07.536546 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:07.536546 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:07.536546 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:07.536546 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:07.536546 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:39:07.536546 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:39:07.536546 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:39:07.536546 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:39:07.537616 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:07.537616 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:07.537616 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:39:07.537616 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:39:07.537616 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:39:07.537616 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:39:07.537616 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:07.537616 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:07.537616 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:07.537616 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:07.537616 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:07.537616 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:07.537616 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:07.537616 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:07.537616 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:07.537616 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:07.537616 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:07.537616 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:07.538555 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:07.538555 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:07.538555 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:39:07.538555 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:39:07.538555 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:39:07.538555 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:39:07.538555 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:39:07.538555 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:39:07.538555 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 12:39:07.538555 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:07.541564 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 416/819] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Aug 3 12:39:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:07.542539 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7de517-3a9c-41df-ba11-5573690a894b None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:07.546631 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea3169-ffbf-4cf9-b5d5-4a3a449b2379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:07.548477 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea3169-ffbf-4cf9-b5d5-4a3a449b2379 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:07.548947 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea3169-ffbf-4cf9-b5d5-4a3a449b2379 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:07.549373 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea3169-ffbf-4cf9-b5d5-4a3a449b2379 None admin] PATH_INFO: `/v3/services` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:07.550338 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea3169-ffbf-4cf9-b5d5-4a3a449b2379 None admin] RBAC: Adding query filter params (type=network) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:07.551776 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea3169-ffbf-4cf9-b5d5-4a3a449b2379 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:07.553773 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea3169-ffbf-4cf9-b5d5-4a3a449b2379 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:07.564511 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 404/820] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Aug 3 12:39:07 2022] GET /identity/v3/services?type=network => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:07.565580 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea3169-ffbf-4cf9-b5d5-4a3a449b2379 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:07.600826 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:07.665034 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:07.683129 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea3169-ffbf-4cf9-b5d5-4a3a449b2379 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:07.686324 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7de517-3a9c-41df-ba11-5573690a894b None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:07.725970 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1044a2c-a306-4e61-b966-39cc7db086d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:07.726840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1044a2c-a306-4e61-b966-39cc7db086d5 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:07.727261 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1044a2c-a306-4e61-b966-39cc7db086d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:07.727672 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1044a2c-a306-4e61-b966-39cc7db086d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:07.728646 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69ebce-7b33-4989-a211-2ba84c9fcba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:07.729267 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69ebce-7b33-4989-a211-2ba84c9fcba2 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:07.729575 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69ebce-7b33-4989-a211-2ba84c9fcba2 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:07.729856 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69ebce-7b33-4989-a211-2ba84c9fcba2 None admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:07.731558 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69ebce-7b33-4989-a211-2ba84c9fcba2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:07.731877 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69ebce-7b33-4989-a211-2ba84c9fcba2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:07.733771 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69ebce-7b33-4989-a211-2ba84c9fcba2 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:07.741331 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1044a2c-a306-4e61-b966-39cc7db086d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:07.742951 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1044a2c-a306-4e61-b966-39cc7db086d5 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:07.758941 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-c1044a2c-a306-4e61-b966-39cc7db086d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:07.758941 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:07.758941 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:07.758941 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:07.758941 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:07.758941 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:07.758941 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:07.758941 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:07.758941 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:07.758941 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:07.758941 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:07.758941 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:07.758941 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:39:07.758941 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:39:07.758941 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:39:07.760018 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:39:07.760018 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:07.760018 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:07.760018 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:07.760018 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:07.760018 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:07.760018 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:07.760018 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:07.760018 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:07.760018 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:07.760018 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:07.760018 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:07.760018 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:07.760018 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:07.760018 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:07.760018 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:07.760018 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:07.760918 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:39:07.760918 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:39:07.760918 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:07.760918 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:07.761145 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 405/821] 10.222.0.46 () {56 vars in 1149 bytes} [Wed Aug 3 12:39:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:07.762089 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69ebce-7b33-4989-a211-2ba84c9fcba2 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:07.767670 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 417/822] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:39:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:07.768771 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1044a2c-a306-4e61-b966-39cc7db086d5 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:07.866899 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:07.884571 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1044a2c-a306-4e61-b966-39cc7db086d5 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:07.885706 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69ebce-7b33-4989-a211-2ba84c9fcba2 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:07.925682 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfefaf-35bc-48d3-a2ae-543387eb23f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:07.926626 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfefaf-35bc-48d3-a2ae-543387eb23f0 None admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:07.927099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfefaf-35bc-48d3-a2ae-543387eb23f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:07.927546 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfefaf-35bc-48d3-a2ae-543387eb23f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:07.927950 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5c1ca-8f7d-40e5-b7bc-adca27c333ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:07.928592 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5c1ca-8f7d-40e5-b7bc-adca27c333ce None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:07.928866 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5c1ca-8f7d-40e5-b7bc-adca27c333ce None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:07.929035 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cfefaf-35bc-48d3-a2ae-543387eb23f0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:07.929129 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5c1ca-8f7d-40e5-b7bc-adca27c333ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:07.930666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cfefaf-35bc-48d3-a2ae-543387eb23f0 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:07.937776 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:07.943474 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5c1ca-8f7d-40e5-b7bc-adca27c333ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:07.945286 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5c1ca-8f7d-40e5-b7bc-adca27c333ce None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:07.962603 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-fcd5c1ca-8f7d-40e5-b7bc-adca27c333ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:07.962603 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:07.962603 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:07.962603 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:07.962603 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:07.962603 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:07.962603 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:07.962603 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:07.962603 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:07.962603 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:07.962603 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:07.962603 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:07.962603 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:39:07.962603 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:39:07.962603 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:39:07.963946 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:39:07.963946 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:07.963946 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:07.963946 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:07.963946 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:07.963946 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:07.963946 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:07.963946 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:07.963946 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:07.963946 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:07.963946 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:07.963946 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:07.963946 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:07.963946 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:07.963946 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:07.963946 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:07.963946 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:07.965423 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:39:07.965423 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:39:07.965423 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:07.965423 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:07.965668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 406/823] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:39:07 2022] POST /identity/v3/endpoints => generated 337 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:39:07.966450 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfefaf-35bc-48d3-a2ae-543387eb23f0 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:07.971145 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 418/824] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:39:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:07.972056 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5c1ca-8f7d-40e5-b7bc-adca27c333ce None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:08.107909 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfefaf-35bc-48d3-a2ae-543387eb23f0 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:08.149141 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956772f-d1f6-48a3-8115-04aff491b760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:08.149856 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956772f-d1f6-48a3-8115-04aff491b760 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:08.150141 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956772f-d1f6-48a3-8115-04aff491b760 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:08.150464 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956772f-d1f6-48a3-8115-04aff491b760 None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:08.157525 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8956772f-d1f6-48a3-8115-04aff491b760 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:08.157525 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8956772f-d1f6-48a3-8115-04aff491b760 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:08.157525 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8956772f-d1f6-48a3-8115-04aff491b760 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:08.161838 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:08.170378 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 407/825] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:08.179558 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956772f-d1f6-48a3-8115-04aff491b760 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:08.195208 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5c1ca-8f7d-40e5-b7bc-adca27c333ce None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:08.236586 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab39464-4197-427c-9751-171ed3a10df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:08.238262 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab39464-4197-427c-9751-171ed3a10df0 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:08.238448 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab39464-4197-427c-9751-171ed3a10df0 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:08.238700 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab39464-4197-427c-9751-171ed3a10df0 None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:08.239409 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab39464-4197-427c-9751-171ed3a10df0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:08.239772 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab39464-4197-427c-9751-171ed3a10df0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:08.241467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab39464-4197-427c-9751-171ed3a10df0 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:08.254890 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 419/826] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:08.260404 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab39464-4197-427c-9751-171ed3a10df0 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:08.323181 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956772f-d1f6-48a3-8115-04aff491b760 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:08.324750 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:08.373624 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba3af0-ddec-47e7-93e4-dffc69683570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:08.374816 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba3af0-ddec-47e7-93e4-dffc69683570 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:08.375531 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba3af0-ddec-47e7-93e4-dffc69683570 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:08.376412 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba3af0-ddec-47e7-93e4-dffc69683570 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:08.387521 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab39464-4197-427c-9751-171ed3a10df0 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:08.387997 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba3af0-ddec-47e7-93e4-dffc69683570 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:08.390617 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba3af0-ddec-47e7-93e4-dffc69683570 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:08.407065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-f4ba3af0-ddec-47e7-93e4-dffc69683570 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:39:08.407065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:08.407065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:08.407065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:08.407065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:08.407065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:08.407065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:08.407065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:08.407065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:08.407065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:08.407065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:08.407065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:08.407065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:39:08.407065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:39:08.407065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:39:08.408037 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:39:08.408037 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:08.408037 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:08.408037 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:08.408037 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:08.408037 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:08.408037 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:08.408037 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:08.408037 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:08.408037 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:08.408037 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:08.408037 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:08.408037 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:08.408037 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:08.408037 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:08.408037 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:08.408037 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:08.408925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:39:08.408925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:39:08.408925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:39:08.408925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:39:08.408925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:39:08.408925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:39:08.408925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:39:08.408925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:08.410968 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 408/827] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:39:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:08.418971 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba3af0-ddec-47e7-93e4-dffc69683570 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:08.440411 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62410e0c-23ba-41de-9803-9fb8016b8be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:08.441769 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62410e0c-23ba-41de-9803-9fb8016b8be1 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:08.442276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62410e0c-23ba-41de-9803-9fb8016b8be1 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:08.442855 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62410e0c-23ba-41de-9803-9fb8016b8be1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:08.453084 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62410e0c-23ba-41de-9803-9fb8016b8be1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:08.455522 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62410e0c-23ba-41de-9803-9fb8016b8be1 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:08.471202 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-62410e0c-23ba-41de-9803-9fb8016b8be1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:39:08.471202 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:08.471202 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:08.471202 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:08.471202 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:08.471202 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:08.471202 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:08.471202 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:08.471202 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:08.471202 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:08.471202 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:08.471202 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:08.471202 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:39:08.471202 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:39:08.471202 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:39:08.472128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:39:08.472128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:08.472128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:08.472128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:08.472128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:08.472128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:08.472128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:08.472128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:08.472128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:08.472128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:08.472128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:08.472128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:08.472128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:08.472128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:08.472128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:08.472128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:08.472128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:08.473021 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:39:08.473021 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:39:08.473021 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:39:08.473021 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:39:08.473021 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:39:08.473021 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:39:08.473021 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:39:08.473021 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:08.475989 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 420/828] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:39:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:08.485089 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62410e0c-23ba-41de-9803-9fb8016b8be1 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:08.505573 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:08.555180 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba3af0-ddec-47e7-93e4-dffc69683570 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:08.593426 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf3cf1-a456-4005-8a67-2e05ca496241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:08.594070 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf3cf1-a456-4005-8a67-2e05ca496241 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:08.594355 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf3cf1-a456-4005-8a67-2e05ca496241 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:08.594632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf3cf1-a456-4005-8a67-2e05ca496241 None admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:08.595389 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf3cf1-a456-4005-8a67-2e05ca496241 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:08.595707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf3cf1-a456-4005-8a67-2e05ca496241 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:08.597135 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf3cf1-a456-4005-8a67-2e05ca496241 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:08.609258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62410e0c-23ba-41de-9803-9fb8016b8be1 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:08.611682 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 409/829] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 3 12:39:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:08.613060 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f52fb-28c6-4f2a-832f-88a0f783d25a None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:08.613352 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f52fb-28c6-4f2a-832f-88a0f783d25a None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:08.613655 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f52fb-28c6-4f2a-832f-88a0f783d25a None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:08.615262 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 410/830] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:08.618372 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f52fb-28c6-4f2a-832f-88a0f783d25a None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:08.625703 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:08.650902 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe0a59-a741-4ceb-9cbe-3e570a72798f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:08.651504 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe0a59-a741-4ceb-9cbe-3e570a72798f None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:08.651796 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe0a59-a741-4ceb-9cbe-3e570a72798f None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:08.652805 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe0a59-a741-4ceb-9cbe-3e570a72798f None admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:08.653401 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe0a59-a741-4ceb-9cbe-3e570a72798f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:08.653751 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe0a59-a741-4ceb-9cbe-3e570a72798f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:08.655200 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe0a59-a741-4ceb-9cbe-3e570a72798f None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:08.667609 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 421/831] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 3 12:39:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:08.669422 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6840c-e8da-4909-9f09-9a811ffb944f None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:08.669737 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6840c-e8da-4909-9f09-9a811ffb944f None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:08.670013 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6840c-e8da-4909-9f09-9a811ffb944f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:08.687412 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-41b6840c-e8da-4909-9f09-9a811ffb944f None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:08.688617 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-41b6840c-e8da-4909-9f09-9a811ffb944f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:08.723530 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f52fb-28c6-4f2a-832f-88a0f783d25a None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:08.741038 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:08.754358 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 422/832] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:39:08.755753 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43679f-2403-4880-bf70-6f4085af6387 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:08.756052 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43679f-2403-4880-bf70-6f4085af6387 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:08.756330 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43679f-2403-4880-bf70-6f4085af6387 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:08.761556 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 423/833] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:08.761556 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43679f-2403-4880-bf70-6f4085af6387 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:08.762555 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e46a7-d8a2-4951-9584-f26299729c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:08.763170 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e46a7-d8a2-4951-9584-f26299729c42 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:08.763453 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e46a7-d8a2-4951-9584-f26299729c42 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:08.763731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e46a7-d8a2-4951-9584-f26299729c42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:08.764530 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e46a7-d8a2-4951-9584-f26299729c42 None admin] RBAC: Adding query filter params (role.id=0e57d142f86c471883fc07a89fe66ec8, scope.project.id=6ac833dfff634496816842c851545d21, user.id=dcf670ff4f62486dbf70cf6ea0f08bbb) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:08.764845 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e46a7-d8a2-4951-9584-f26299729c42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:08.766300 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e46a7-d8a2-4951-9584-f26299729c42 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:08.772480 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 411/834] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:39:08 2022] GET /identity/v3/role_assignments?user.id=dcf670ff4f62486dbf70cf6ea0f08bbb&scope.project.id=6ac833dfff634496816842c851545d21&role.id=0e57d142f86c471883fc07a89fe66ec8 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:08.773669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43696dfc-eb9a-4626-ba9d-89cc536e5d30 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:08.773956 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43696dfc-eb9a-4626-ba9d-89cc536e5d30 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:08.774261 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43696dfc-eb9a-4626-ba9d-89cc536e5d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:08.794993 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-43696dfc-eb9a-4626-ba9d-89cc536e5d30 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:08.796240 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-43696dfc-eb9a-4626-ba9d-89cc536e5d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:08.874055 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 412/835] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:39:08.875329 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43696dfc-eb9a-4626-ba9d-89cc536e5d30 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:08.900821 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:08.905451 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43679f-2403-4880-bf70-6f4085af6387 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:08.951488 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e690c-e78b-4774-a953-992d7f9b731c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:08.952416 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e690c-e78b-4774-a953-992d7f9b731c None admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:08.952797 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e690c-e78b-4774-a953-992d7f9b731c None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:08.952972 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e690c-e78b-4774-a953-992d7f9b731c None admin] PATH_INFO: `/v3/projects/6ac833dfff634496816842c851545d21/users/a994c976b95744ed9723bf9c4386bde1/roles/39d74def259b415ca634ad9c715e1332` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:08.973083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e690c-e78b-4774-a953-992d7f9b731c None admin] RBAC: Authorizing `identity:create_grant(project_id=6ac833dfff634496816842c851545d21, user_id=a994c976b95744ed9723bf9c4386bde1, role_id=39d74def259b415ca634ad9c715e1332)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:08.974613 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e690c-e78b-4774-a953-992d7f9b731c None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:08.988966 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 424/836] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 3 12:39:08 2022] PUT /identity/v3/projects/6ac833dfff634496816842c851545d21/users/a994c976b95744ed9723bf9c4386bde1/roles/39d74def259b415ca634ad9c715e1332 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:39:08.990297 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e690c-e78b-4774-a953-992d7f9b731c None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:09.004001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43696dfc-eb9a-4626-ba9d-89cc536e5d30 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:09.020112 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:09.047775 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dab7e3-ae98-4723-b011-81275d5f661b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:09.048775 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dab7e3-ae98-4723-b011-81275d5f661b None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:09.050069 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dab7e3-ae98-4723-b011-81275d5f661b None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:09.050566 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dab7e3-ae98-4723-b011-81275d5f661b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:09.067857 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dab7e3-ae98-4723-b011-81275d5f661b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:39:09.073798 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-49dab7e3-ae98-4723-b011-81275d5f661b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:39:09.073798 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:09.073798 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:09.073798 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:09.073798 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:09.073798 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:09.073798 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:09.073798 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:09.073798 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:09.073798 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:09.073798 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:09.073798 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:09.073798 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:39:09.073798 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:39:09.073798 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:39:09.073798 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:39:09.074854 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:39:09.074854 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:39:09.074854 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:39:09.074854 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:39:09.074854 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:09.074854 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:09.074854 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:09.074854 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:09.074854 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:09.074854 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:09.074854 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:09.074854 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:09.074854 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:09.074854 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:09.074854 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:09.074854 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:09.075732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:09.075732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:09.075732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:09.075732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:09.075732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:39:09.075732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:39:09.075732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:39:09.075732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:39:09.075732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:39:09.075732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:39:09.075732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:39:09.075732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:09.079943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 413/837] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 3 12:39:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:09.082645 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dab7e3-ae98-4723-b011-81275d5f661b None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:09.142574 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e690c-e78b-4774-a953-992d7f9b731c None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:09.181328 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9e2e7-3237-41cc-9a28-f004af8c2393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:09.182018 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9e2e7-3237-41cc-9a28-f004af8c2393 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:09.182301 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9e2e7-3237-41cc-9a28-f004af8c2393 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:09.182579 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9e2e7-3237-41cc-9a28-f004af8c2393 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:09.184238 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa9e2e7-3237-41cc-9a28-f004af8c2393 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:09.185418 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa9e2e7-3237-41cc-9a28-f004af8c2393 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:09.195437 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-7fa9e2e7-3237-41cc-9a28-f004af8c2393 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 03 12:39:09.195437 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:09.195437 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:39:09.195437 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:39:09.195437 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:39:09.195437 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:39:09.195437 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:39:09.195437 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:09.195437 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 03 12:39:09.195437 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:09.195437 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:39:09.195437 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:09.195437 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:09.195437 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:09.195437 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:09.195437 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:09.195437 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:09.196459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:09.196459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:09.196459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:09.196459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:09.196459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:09.196459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:09.196459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:39:09.196459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:39:09.196459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:39:09.196459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:39:09.196459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:09.196459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:09.196459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:09.196459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:09.196459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:09.196459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:09.197288 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:09.197288 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:09.197288 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:09.197288 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:09.197288 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:09.197288 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:09.197288 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:09.197288 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:09.197288 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:09.197288 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:09.197288 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:39:09.197288 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:09.197288 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 03 12:39:09.197288 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:09.199537 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 425/838] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 3 12:39:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:09.203431 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9e2e7-3237-41cc-9a28-f004af8c2393 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:09.209348 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dab7e3-ae98-4723-b011-81275d5f661b None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:09.234010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:09.246882 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c6309-a834-4c1b-975c-dafb76705435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:09.247556 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c6309-a834-4c1b-975c-dafb76705435 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:09.247839 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c6309-a834-4c1b-975c-dafb76705435 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:09.248116 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c6309-a834-4c1b-975c-dafb76705435 None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:09.248845 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c6309-a834-4c1b-975c-dafb76705435 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:09.249154 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c6309-a834-4c1b-975c-dafb76705435 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:09.250760 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c6309-a834-4c1b-975c-dafb76705435 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:09.261236 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 414/839] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:39:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:09.274717 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c6309-a834-4c1b-975c-dafb76705435 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:09.320741 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:09.330375 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9e2e7-3237-41cc-9a28-f004af8c2393 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:09.368509 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae9d59-2789-4fd8-80c9-a2cfb799a7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:09.369480 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae9d59-2789-4fd8-80c9-a2cfb799a7f9 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:09.369936 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae9d59-2789-4fd8-80c9-a2cfb799a7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:09.370361 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae9d59-2789-4fd8-80c9-a2cfb799a7f9 None admin] PATH_INFO: `/v3/services` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:09.371555 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae9d59-2789-4fd8-80c9-a2cfb799a7f9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:09.372039 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae9d59-2789-4fd8-80c9-a2cfb799a7f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:09.373726 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae9d59-2789-4fd8-80c9-a2cfb799a7f9 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:09.383872 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 426/840] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 3 12:39:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:09.385302 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae9d59-2789-4fd8-80c9-a2cfb799a7f9 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:09.393540 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c6309-a834-4c1b-975c-dafb76705435 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:09.431140 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4b18e-b474-4e11-acb6-5784ddf68fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:09.431814 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4b18e-b474-4e11-acb6-5784ddf68fb0 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:09.432099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4b18e-b474-4e11-acb6-5784ddf68fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:09.432374 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4b18e-b474-4e11-acb6-5784ddf68fb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:09.446730 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f4b18e-b474-4e11-acb6-5784ddf68fb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:09.448254 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f4b18e-b474-4e11-acb6-5784ddf68fb0 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:09.465172 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-23f4b18e-b474-4e11-acb6-5784ddf68fb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:09.465172 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:09.465172 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:09.465172 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:09.465172 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:09.465172 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:09.465172 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:09.465172 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:09.465172 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:09.465172 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:09.465172 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:09.465172 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:09.465172 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:39:09.465172 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:39:09.465172 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:39:09.466312 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:39:09.466312 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:09.466312 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:09.466312 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:09.466312 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:09.466312 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:09.466312 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:09.466312 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:09.466312 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:09.466312 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:09.466312 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:09.466312 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:09.466312 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:09.466312 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:09.466312 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:09.466312 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:09.466312 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:09.467620 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:39:09.467620 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:39:09.467620 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:09.467620 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:09.471332 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 415/841] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:39:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:09.472378 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4b18e-b474-4e11-acb6-5784ddf68fb0 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:09.476088 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:09.500823 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae9d59-2789-4fd8-80c9-a2cfb799a7f9 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:09.538715 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8c68f-0f0b-49ce-bb59-066d79f8dac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:09.539634 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8c68f-0f0b-49ce-bb59-066d79f8dac1 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:09.540089 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8c68f-0f0b-49ce-bb59-066d79f8dac1 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:09.540519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8c68f-0f0b-49ce-bb59-066d79f8dac1 None admin] PATH_INFO: `/v3/services` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:09.541453 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8c68f-0f0b-49ce-bb59-066d79f8dac1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:09.542030 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8c68f-0f0b-49ce-bb59-066d79f8dac1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:09.543581 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8c68f-0f0b-49ce-bb59-066d79f8dac1 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:09.556029 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 427/842] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 3 12:39:09 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:09.571454 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:09.589397 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4b18e-b474-4e11-acb6-5784ddf68fb0 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:09.628869 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce0e5d-1908-47ea-a471-77961fa83049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:09.629522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce0e5d-1908-47ea-a471-77961fa83049 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:09.629819 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce0e5d-1908-47ea-a471-77961fa83049 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:09.630096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce0e5d-1908-47ea-a471-77961fa83049 None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:09.630810 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce0e5d-1908-47ea-a471-77961fa83049 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:09.631116 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce0e5d-1908-47ea-a471-77961fa83049 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:09.632505 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce0e5d-1908-47ea-a471-77961fa83049 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:09.647176 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 416/843] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:09.653074 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8c68f-0f0b-49ce-bb59-066d79f8dac1 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:09.775584 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8c68f-0f0b-49ce-bb59-066d79f8dac1 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:09.812326 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69287855-4443-4a42-95f7-6bb7a3d82e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:09.812970 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69287855-4443-4a42-95f7-6bb7a3d82e5d None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:09.813254 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69287855-4443-4a42-95f7-6bb7a3d82e5d None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:09.813553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69287855-4443-4a42-95f7-6bb7a3d82e5d None admin] PATH_INFO: `/v3/users/swift` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:09.821600 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69287855-4443-4a42-95f7-6bb7a3d82e5d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:09.823047 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69287855-4443-4a42-95f7-6bb7a3d82e5d None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:09.834819 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-69287855-4443-4a42-95f7-6bb7a3d82e5d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 03 12:39:09.834819 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:09.834819 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:09.834819 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:09.834819 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:09.834819 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:09.834819 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:09.834819 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:09.834819 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:09.834819 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:09.834819 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:09.834819 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:09.834819 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:39:09.834819 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:39:09.834819 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:39:09.834819 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:39:09.835763 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:09.835763 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:09.835763 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:39:09.835763 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:39:09.835763 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:39:09.835763 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:39:09.835763 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:09.835763 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:09.835763 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:09.835763 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:09.835763 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:09.835763 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:09.835763 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:09.835763 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:09.835763 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:09.835763 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:09.835763 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:09.835763 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:09.836934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:09.836934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:09.836934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:39:09.836934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:39:09.836934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:39:09.836934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:39:09.836934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:39:09.836934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:39:09.836934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 03 12:39:09.836934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:09.836934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 428/844] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 3 12:39:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:09.842061 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce0e5d-1908-47ea-a471-77961fa83049 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:09.949236 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce0e5d-1908-47ea-a471-77961fa83049 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:09.987323 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90507cf2-4586-4ba7-9891-b7c0166a063e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:09.987943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90507cf2-4586-4ba7-9891-b7c0166a063e None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:09.988273 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90507cf2-4586-4ba7-9891-b7c0166a063e None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:09.988552 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90507cf2-4586-4ba7-9891-b7c0166a063e None admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:09.989347 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90507cf2-4586-4ba7-9891-b7c0166a063e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:09.989694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90507cf2-4586-4ba7-9891-b7c0166a063e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:09.991442 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90507cf2-4586-4ba7-9891-b7c0166a063e None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:10.010564 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 417/845] 10.222.0.46 () {56 vars in 1135 bytes} [Wed Aug 3 12:39:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:10.016350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69287855-4443-4a42-95f7-6bb7a3d82e5d None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:10.019278 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:10.132751 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69287855-4443-4a42-95f7-6bb7a3d82e5d None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:10.171851 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ea38b-c673-44db-bd1c-877e29a93828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:10.172849 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ea38b-c673-44db-bd1c-877e29a93828 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:10.173334 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ea38b-c673-44db-bd1c-877e29a93828 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:10.173833 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ea38b-c673-44db-bd1c-877e29a93828 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:10.249234 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ea38b-c673-44db-bd1c-877e29a93828 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:10.250735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ea38b-c673-44db-bd1c-877e29a93828 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:10.253772 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:10.359900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 429/846] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:39:10 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:39:10.365557 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90507cf2-4586-4ba7-9891-b7c0166a063e None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:10.369428 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:10.474841 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90507cf2-4586-4ba7-9891-b7c0166a063e None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:10.515425 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413932d-1ec4-4140-9ecc-8f2aef33a46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:10.516081 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413932d-1ec4-4140-9ecc-8f2aef33a46a None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:10.516361 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413932d-1ec4-4140-9ecc-8f2aef33a46a None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:10.516636 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413932d-1ec4-4140-9ecc-8f2aef33a46a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:10.527083 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413932d-1ec4-4140-9ecc-8f2aef33a46a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:10.529049 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413932d-1ec4-4140-9ecc-8f2aef33a46a None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:10.544124 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-a413932d-1ec4-4140-9ecc-8f2aef33a46a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:10.544124 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:10.544124 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:10.544124 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:10.544124 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:10.544124 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:10.544124 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:10.544124 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:10.544124 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:10.544124 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:10.544124 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:10.544124 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:10.544124 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:39:10.544124 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:39:10.544124 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:39:10.545042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:39:10.545042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:10.545042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:10.545042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:10.545042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:10.545042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:10.545042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:10.545042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:10.545042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:10.545042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:10.545042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:10.545042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:10.545042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:10.545042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:10.545042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:10.545042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:10.545042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:10.546112 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:39:10.546112 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:39:10.546112 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:10.546112 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:10.546112 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 418/847] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:10.551216 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ea38b-c673-44db-bd1c-877e29a93828 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:10.653786 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ea38b-c673-44db-bd1c-877e29a93828 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:10.655346 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:10.688766 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b59e2-961f-4855-8890-2a6cb903a0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:10.689394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b59e2-961f-4855-8890-2a6cb903a0bc None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:10.689703 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b59e2-961f-4855-8890-2a6cb903a0bc None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:10.689984 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b59e2-961f-4855-8890-2a6cb903a0bc None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:10.690680 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b59e2-961f-4855-8890-2a6cb903a0bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:10.690988 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b59e2-961f-4855-8890-2a6cb903a0bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:10.692357 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b59e2-961f-4855-8890-2a6cb903a0bc None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:10.704911 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 430/848] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:10.710496 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413932d-1ec4-4140-9ecc-8f2aef33a46a None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:10.769310 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:10.822171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413932d-1ec4-4140-9ecc-8f2aef33a46a None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:10.857474 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca00ee0-18a8-4769-b5a4-9dab63b71c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:10.858236 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca00ee0-18a8-4769-b5a4-9dab63b71c68 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:10.858427 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca00ee0-18a8-4769-b5a4-9dab63b71c68 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:10.858700 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca00ee0-18a8-4769-b5a4-9dab63b71c68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:10.866094 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca00ee0-18a8-4769-b5a4-9dab63b71c68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:10.867550 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca00ee0-18a8-4769-b5a4-9dab63b71c68 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:10.872846 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf6ff1-ec66-4c27-8cab-c4e4cb9985ea None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:10.873131 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf6ff1-ec66-4c27-8cab-c4e4cb9985ea None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:10.873411 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf6ff1-ec66-4c27-8cab-c4e4cb9985ea None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:10.875072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 431/849] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:10.879893 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb94e7f-10f5-4984-b108-4a458853ffac None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:10.880133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-1ca00ee0-18a8-4769-b5a4-9dab63b71c68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:39:10.880133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:10.880133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:10.880133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:10.880133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:10.880133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:10.880133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:10.880133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:10.880133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:10.880133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:10.880133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:10.880133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:10.880133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:39:10.880133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:39:10.880133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:39:10.880987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:39:10.880987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:10.880987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:10.880987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:10.880987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:10.880987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:10.880987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:10.880987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:10.880987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:10.880987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:10.880987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:10.880987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:10.880987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:10.880987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:10.880987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:10.880987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:10.880987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:10.882457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:39:10.882457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:39:10.882457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:39:10.882457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:39:10.882457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:39:10.882457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:39:10.882457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:39:10.882457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:10.883084 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb94e7f-10f5-4984-b108-4a458853ffac None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:10.883084 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb94e7f-10f5-4984-b108-4a458853ffac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:10.883353 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 419/850] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:39:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:10.890471 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca00ee0-18a8-4769-b5a4-9dab63b71c68 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:10.899620 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-3cb94e7f-10f5-4984-b108-4a458853ffac None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:10.900903 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-3cb94e7f-10f5-4984-b108-4a458853ffac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:10.986437 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 432/851] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:10 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:39:11.003776 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb94e7f-10f5-4984-b108-4a458853ffac None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:11.013575 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca00ee0-18a8-4769-b5a4-9dab63b71c68 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:11.036446 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:11.061762 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffd04d-988a-4dc7-94d5-1ae1ea60642d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:11.062953 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffd04d-988a-4dc7-94d5-1ae1ea60642d None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:11.063446 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffd04d-988a-4dc7-94d5-1ae1ea60642d None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:11.064101 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffd04d-988a-4dc7-94d5-1ae1ea60642d None admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:11.065602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ffd04d-988a-4dc7-94d5-1ae1ea60642d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:11.065953 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ffd04d-988a-4dc7-94d5-1ae1ea60642d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:11.067628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ffd04d-988a-4dc7-94d5-1ae1ea60642d None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:11.092942 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 420/852] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 3 12:39:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:11.094109 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffd04d-988a-4dc7-94d5-1ae1ea60642d None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:11.116245 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:11.130452 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb94e7f-10f5-4984-b108-4a458853ffac None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:11.167213 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0fcfa-354a-40d0-baa8-977f796b0ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:11.168590 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0fcfa-354a-40d0-baa8-977f796b0ac6 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:11.168874 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0fcfa-354a-40d0-baa8-977f796b0ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:11.169150 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0fcfa-354a-40d0-baa8-977f796b0ac6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:11.169822 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0fcfa-354a-40d0-baa8-977f796b0ac6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:11.171185 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0fcfa-354a-40d0-baa8-977f796b0ac6 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:11.180293 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-45d0fcfa-354a-40d0-baa8-977f796b0ac6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 03 12:39:11.180293 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:11.180293 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:39:11.180293 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:39:11.180293 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:39:11.180293 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:39:11.180293 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:39:11.180293 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:11.180293 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 03 12:39:11.180293 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:11.180293 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:39:11.180293 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:11.180293 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:11.180293 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:11.180293 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:11.180293 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:11.181195 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:11.181195 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:11.181195 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:11.181195 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:11.181195 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:11.181195 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:11.181195 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:11.181195 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:39:11.181195 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:39:11.181195 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:39:11.181195 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:39:11.181195 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:11.181195 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:11.181195 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:11.181195 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:11.181195 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:11.182066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:11.182066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:11.182066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:11.182066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:11.182066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:11.182066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:11.182066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:11.182066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:11.182066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:11.182066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:11.182066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:11.182066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:39:11.182066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:11.182066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 03 12:39:11.182066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:11.182066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 433/853] 10.222.0.46 () {56 vars in 1132 bytes} [Wed Aug 3 12:39:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:39:11.187621 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc20424-b8f0-48e3-9140-55a29580947d None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:11.187964 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc20424-b8f0-48e3-9140-55a29580947d None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:11.188245 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc20424-b8f0-48e3-9140-55a29580947d None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:11.189774 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 434/854] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:11.190333 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc20424-b8f0-48e3-9140-55a29580947d None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:11.228936 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffd04d-988a-4dc7-94d5-1ae1ea60642d None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:11.267693 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbf7ae-e965-4dc1-97c3-8bba34f7d9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:11.268311 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbf7ae-e965-4dc1-97c3-8bba34f7d9dc None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:11.268593 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbf7ae-e965-4dc1-97c3-8bba34f7d9dc None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:11.268866 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbf7ae-e965-4dc1-97c3-8bba34f7d9dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:11.270028 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bbf7ae-e965-4dc1-97c3-8bba34f7d9dc None admin] RBAC: Adding query filter params (role.id=0e57d142f86c471883fc07a89fe66ec8, scope.project.id=6ac833dfff634496816842c851545d21, user.id=67df369737ea4c83bae134f4bf2de20d) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:11.270028 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bbf7ae-e965-4dc1-97c3-8bba34f7d9dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:11.271401 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bbf7ae-e965-4dc1-97c3-8bba34f7d9dc None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:11.278709 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 421/855] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:39:11 2022] GET /identity/v3/role_assignments?user.id=67df369737ea4c83bae134f4bf2de20d&scope.project.id=6ac833dfff634496816842c851545d21&role.id=0e57d142f86c471883fc07a89fe66ec8 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:11.279930 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220228b-e852-4505-bf84-44acdd535198 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:11.280219 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220228b-e852-4505-bf84-44acdd535198 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:11.280493 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220228b-e852-4505-bf84-44acdd535198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:11.299845 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-8220228b-e852-4505-bf84-44acdd535198 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:11.301992 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-8220228b-e852-4505-bf84-44acdd535198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:11.312618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc20424-b8f0-48e3-9140-55a29580947d None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:11.353438 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c894a-5217-4009-b029-8edbb1333abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:11.354487 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c894a-5217-4009-b029-8edbb1333abf None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:11.354973 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c894a-5217-4009-b029-8edbb1333abf None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:11.355483 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c894a-5217-4009-b029-8edbb1333abf None admin] PATH_INFO: `/v3/services` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:11.356435 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c894a-5217-4009-b029-8edbb1333abf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:11.356976 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c894a-5217-4009-b029-8edbb1333abf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:11.358636 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c894a-5217-4009-b029-8edbb1333abf None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:11.364639 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 435/856] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Aug 3 12:39:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:11.365900 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:11.371282 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c894a-5217-4009-b029-8edbb1333abf None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:11.399828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:11.410956 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 422/857] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:11 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:39:11.429152 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220228b-e852-4505-bf84-44acdd535198 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:11.497988 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c894a-5217-4009-b029-8edbb1333abf None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:11.538295 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6619a7-133d-4a6f-aeb1-dc4431fde9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:11.538920 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6619a7-133d-4a6f-aeb1-dc4431fde9a0 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:11.539202 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6619a7-133d-4a6f-aeb1-dc4431fde9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:11.539476 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6619a7-133d-4a6f-aeb1-dc4431fde9a0 None admin] PATH_INFO: `/v3/services` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:11.540266 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6619a7-133d-4a6f-aeb1-dc4431fde9a0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:11.540469 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6619a7-133d-4a6f-aeb1-dc4431fde9a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:11.541870 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6619a7-133d-4a6f-aeb1-dc4431fde9a0 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:11.547482 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 436/858] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Aug 3 12:39:11 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:11.553751 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220228b-e852-4505-bf84-44acdd535198 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:11.595802 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d59817-ad59-4143-a5f1-b2af8aafee1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:11.596846 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d59817-ad59-4143-a5f1-b2af8aafee1d None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:11.597367 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d59817-ad59-4143-a5f1-b2af8aafee1d None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:11.597891 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d59817-ad59-4143-a5f1-b2af8aafee1d None admin] PATH_INFO: `/v3/roles/service` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:11.611130 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d59817-ad59-4143-a5f1-b2af8aafee1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:39:11.616987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-c3d59817-ad59-4143-a5f1-b2af8aafee1d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:39:11.616987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:11.616987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:11.616987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:11.616987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:11.616987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:11.616987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:11.616987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:11.616987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:11.616987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:11.616987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:11.616987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:11.616987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:39:11.616987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:39:11.616987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:39:11.616987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:39:11.618026 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:39:11.618026 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:39:11.618026 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:39:11.618026 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:39:11.618026 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:11.618026 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:11.618026 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:11.618026 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:11.618026 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:11.618026 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:11.618026 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:11.618026 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:11.618026 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:11.618026 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:11.618026 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:11.618026 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:11.618874 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:11.618874 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:11.618874 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:11.618874 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:11.618874 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:39:11.618874 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:39:11.618874 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:39:11.618874 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:39:11.618874 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:39:11.618874 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:39:11.618874 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:39:11.618874 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:11.627104 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 423/859] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 3 12:39:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:39:11.630619 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6619a7-133d-4a6f-aeb1-dc4431fde9a0 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:11.728080 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:11.731626 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333fcde-3501-41df-9be9-c9e886b64d56 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:11.732132 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333fcde-3501-41df-9be9-c9e886b64d56 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:11.732601 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333fcde-3501-41df-9be9-c9e886b64d56 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:11.735177 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 424/860] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:11.742293 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e46be-3fa0-445a-be56-9f1c4a3c6d08 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:11.742293 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e46be-3fa0-445a-be56-9f1c4a3c6d08 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:11.742516 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e46be-3fa0-445a-be56-9f1c4a3c6d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:11.751150 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6619a7-133d-4a6f-aeb1-dc4431fde9a0 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:11.764216 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-865e46be-3fa0-445a-be56-9f1c4a3c6d08 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:11.765441 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-865e46be-3fa0-445a-be56-9f1c4a3c6d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:11.791571 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:11.791879 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb3f8e-122c-4a35-a8d1-aedbe3f00881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:11.792451 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb3f8e-122c-4a35-a8d1-aedbe3f00881 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:11.792768 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb3f8e-122c-4a35-a8d1-aedbe3f00881 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:11.793054 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb3f8e-122c-4a35-a8d1-aedbe3f00881 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:11.793799 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb3f8e-122c-4a35-a8d1-aedbe3f00881 None admin] RBAC: Adding query filter params (name=service) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:11.794154 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb3f8e-122c-4a35-a8d1-aedbe3f00881 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:11.795599 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb3f8e-122c-4a35-a8d1-aedbe3f00881 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:11.804930 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 437/861] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 3 12:39:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:11.811798 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb3f8e-122c-4a35-a8d1-aedbe3f00881 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:11.838669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 425/862] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:11 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:39:11.860941 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e46be-3fa0-445a-be56-9f1c4a3c6d08 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:11.941770 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb3f8e-122c-4a35-a8d1-aedbe3f00881 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:11.978764 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e46be-3fa0-445a-be56-9f1c4a3c6d08 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:11.983825 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cfa82-aad7-46c9-b909-5e1c994f8557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:11.984478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cfa82-aad7-46c9-b909-5e1c994f8557 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:11.984757 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cfa82-aad7-46c9-b909-5e1c994f8557 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:11.985030 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cfa82-aad7-46c9-b909-5e1c994f8557 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:11.997930 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361cfa82-aad7-46c9-b909-5e1c994f8557 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:11.999390 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361cfa82-aad7-46c9-b909-5e1c994f8557 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:12.008285 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:12.019608 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-361cfa82-aad7-46c9-b909-5e1c994f8557 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:12.019608 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:12.019608 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:12.019608 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:12.019608 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:12.019608 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:12.019608 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:12.019608 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:12.019608 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:12.019608 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:12.019608 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:12.019608 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:12.019608 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:39:12.019608 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:39:12.019608 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:39:12.020545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:39:12.020545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:12.020545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:12.020545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:12.020545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:12.020545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:12.020545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:12.020545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:12.020545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:12.020545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:12.020545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:12.020545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:12.020545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:12.020545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:12.020545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:12.020545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:12.020545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:12.021433 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:39:12.021433 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:39:12.021433 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:12.021433 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:12.021433 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 438/863] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:39:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:39:12.021760 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1023e-db00-422c-ba61-2a22aa32e9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:12.022293 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1023e-db00-422c-ba61-2a22aa32e9a0 None admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:12.022293 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1023e-db00-422c-ba61-2a22aa32e9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:12.025307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1023e-db00-422c-ba61-2a22aa32e9a0 None admin] PATH_INFO: `/v3/services` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:12.025307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e1023e-db00-422c-ba61-2a22aa32e9a0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:12.025307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e1023e-db00-422c-ba61-2a22aa32e9a0 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:12.026420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cfa82-aad7-46c9-b909-5e1c994f8557 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:12.047910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 426/864] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Aug 3 12:39:11 2022] POST /identity/v3/services => generated 251 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:39:12.156131 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cfa82-aad7-46c9-b909-5e1c994f8557 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:12.201636 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e678385-9f68-464f-9591-aadc30c7ff2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:12.202269 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e678385-9f68-464f-9591-aadc30c7ff2b None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:12.202549 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e678385-9f68-464f-9591-aadc30c7ff2b None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:12.202826 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e678385-9f68-464f-9591-aadc30c7ff2b None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:12.203526 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e678385-9f68-464f-9591-aadc30c7ff2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:12.203833 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e678385-9f68-464f-9591-aadc30c7ff2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:12.205211 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e678385-9f68-464f-9591-aadc30c7ff2b None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:12.221571 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 439/865] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:12.223599 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1023e-db00-422c-ba61-2a22aa32e9a0 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:12.252691 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:12.341742 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1023e-db00-422c-ba61-2a22aa32e9a0 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:12.377908 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a68967-f8d4-4aae-9783-2d0199ceaf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:12.378932 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a68967-f8d4-4aae-9783-2d0199ceaf74 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:12.379418 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a68967-f8d4-4aae-9783-2d0199ceaf74 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:12.379900 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a68967-f8d4-4aae-9783-2d0199ceaf74 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:12.388189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a68967-f8d4-4aae-9783-2d0199ceaf74 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:12.389912 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a68967-f8d4-4aae-9783-2d0199ceaf74 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:12.402775 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-70a68967-f8d4-4aae-9783-2d0199ceaf74 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 12:39:12.402775 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:12.402775 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:12.402775 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:12.402775 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:12.402775 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:12.402775 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:12.402775 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:12.402775 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:12.402775 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:12.402775 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:12.402775 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:12.402775 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:39:12.402775 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:39:12.402775 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:39:12.402775 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:39:12.403827 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:12.403827 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:12.403827 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:39:12.403827 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:39:12.403827 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:39:12.403827 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:39:12.403827 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:12.403827 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:12.403827 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:12.403827 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:12.403827 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:12.403827 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:12.403827 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:12.403827 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:12.403827 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:12.403827 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:12.403827 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:12.403827 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:12.404757 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:12.404757 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:12.404757 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:39:12.404757 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:39:12.404757 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:39:12.404757 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:39:12.404757 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:39:12.404757 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:39:12.404757 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 12:39:12.404757 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:12.411056 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 427/866] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Aug 3 12:39:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:12.413405 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e678385-9f68-464f-9591-aadc30c7ff2b None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:12.476626 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:12.524681 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e678385-9f68-464f-9591-aadc30c7ff2b None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:12.559943 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205dfc1a-dca5-4685-88a6-a61e751d7beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:12.560562 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205dfc1a-dca5-4685-88a6-a61e751d7beb None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:12.560846 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205dfc1a-dca5-4685-88a6-a61e751d7beb None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:12.561120 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205dfc1a-dca5-4685-88a6-a61e751d7beb None admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:12.561951 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205dfc1a-dca5-4685-88a6-a61e751d7beb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:12.562260 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205dfc1a-dca5-4685-88a6-a61e751d7beb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:12.563693 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205dfc1a-dca5-4685-88a6-a61e751d7beb None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:12.583076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 440/867] 10.222.0.46 () {56 vars in 1149 bytes} [Wed Aug 3 12:39:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:12.588726 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a68967-f8d4-4aae-9783-2d0199ceaf74 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:12.676298 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:12.697925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a68967-f8d4-4aae-9783-2d0199ceaf74 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:12.733933 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10072cf4-7013-4560-8cec-62b82e418b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:12.734926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10072cf4-7013-4560-8cec-62b82e418b03 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:12.735410 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10072cf4-7013-4560-8cec-62b82e418b03 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:12.735896 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10072cf4-7013-4560-8cec-62b82e418b03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:12.810277 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10072cf4-7013-4560-8cec-62b82e418b03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:12.812063 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10072cf4-7013-4560-8cec-62b82e418b03 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:12.894766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:12.920855 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 428/868] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:39:12 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:39:12.922591 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205dfc1a-dca5-4685-88a6-a61e751d7beb None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:13.031287 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205dfc1a-dca5-4685-88a6-a61e751d7beb None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:13.044223 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:13.066085 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded4329-bf9d-4927-91ff-7141c2758ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:13.066729 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded4329-bf9d-4927-91ff-7141c2758ab7 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:13.067010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded4329-bf9d-4927-91ff-7141c2758ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:13.067284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded4329-bf9d-4927-91ff-7141c2758ab7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:13.077818 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded4329-bf9d-4927-91ff-7141c2758ab7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:13.080578 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded4329-bf9d-4927-91ff-7141c2758ab7 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:13.096563 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-dded4329-bf9d-4927-91ff-7141c2758ab7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:13.096563 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:13.096563 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:13.096563 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:13.096563 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:13.096563 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:13.096563 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:13.096563 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:13.096563 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:13.096563 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:13.096563 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:13.096563 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:13.096563 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:39:13.096563 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:39:13.096563 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:39:13.097481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:39:13.097481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:13.097481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:13.097481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:13.097481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:13.097481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:13.097481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:13.097481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:13.097481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:13.097481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:13.097481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:13.097481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:13.097481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:13.097481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:13.097481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:13.097481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:13.097481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:13.098656 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:39:13.098656 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:39:13.098656 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:13.098656 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:13.098656 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 441/869] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:13.104538 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10072cf4-7013-4560-8cec-62b82e418b03 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:13.220215 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10072cf4-7013-4560-8cec-62b82e418b03 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:13.256037 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e23baf-5c3f-423a-abcd-811387ffae17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:13.256656 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e23baf-5c3f-423a-abcd-811387ffae17 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:13.256936 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e23baf-5c3f-423a-abcd-811387ffae17 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:13.257207 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e23baf-5c3f-423a-abcd-811387ffae17 None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:13.257925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e23baf-5c3f-423a-abcd-811387ffae17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:13.258226 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e23baf-5c3f-423a-abcd-811387ffae17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:13.259581 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e23baf-5c3f-423a-abcd-811387ffae17 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:13.272414 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 429/870] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:13.281045 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded4329-bf9d-4927-91ff-7141c2758ab7 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:13.387582 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded4329-bf9d-4927-91ff-7141c2758ab7 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:13.423360 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10808bf1-d50e-4ef4-8175-5c2afa43f279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:13.423991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10808bf1-d50e-4ef4-8175-5c2afa43f279 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:13.424275 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10808bf1-d50e-4ef4-8175-5c2afa43f279 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:13.424550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10808bf1-d50e-4ef4-8175-5c2afa43f279 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:13.431763 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10808bf1-d50e-4ef4-8175-5c2afa43f279 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:13.433860 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10808bf1-d50e-4ef4-8175-5c2afa43f279 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:13.441119 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb3520-4570-49eb-8aaa-2d20091049fb None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:13.441407 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb3520-4570-49eb-8aaa-2d20091049fb None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:13.441732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb3520-4570-49eb-8aaa-2d20091049fb None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:13.443314 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 430/871] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:39:13.445779 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-10808bf1-d50e-4ef4-8175-5c2afa43f279 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:39:13.445779 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:13.445779 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:13.445779 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:13.445779 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:13.445779 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:13.445779 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:13.445779 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:13.445779 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:13.445779 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:13.445779 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:13.445779 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:13.445779 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:39:13.445779 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:39:13.445779 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:39:13.446638 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:39:13.446638 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:13.446638 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:13.446638 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:13.446638 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:13.446638 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:13.446638 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:13.446638 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:13.446638 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:13.446638 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:13.446638 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:13.446638 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:13.446638 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:13.446638 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:13.446638 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:13.446638 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:13.446638 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:13.448363 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:39:13.448363 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:39:13.448363 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:39:13.448363 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:39:13.448363 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:39:13.448363 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:39:13.448363 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:39:13.448363 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:13.448363 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 442/872] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:39:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:13.453298 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c80e5-a0a3-4858-ac1b-7cfb4438cc9c None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:13.453610 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c80e5-a0a3-4858-ac1b-7cfb4438cc9c None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:13.453890 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c80e5-a0a3-4858-ac1b-7cfb4438cc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:13.454814 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10808bf1-d50e-4ef4-8175-5c2afa43f279 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:13.475395 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-0f9c80e5-a0a3-4858-ac1b-7cfb4438cc9c None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:13.476770 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-0f9c80e5-a0a3-4858-ac1b-7cfb4438cc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:13.485329 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:13.520862 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:13.574083 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 431/873] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:13 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:39:13.579171 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10808bf1-d50e-4ef4-8175-5c2afa43f279 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:13.588600 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c80e5-a0a3-4858-ac1b-7cfb4438cc9c None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:13.614139 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d5184-c571-4b4d-97b1-4cf18c71e50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:13.614759 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d5184-c571-4b4d-97b1-4cf18c71e50b None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:13.615374 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d5184-c571-4b4d-97b1-4cf18c71e50b None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:13.615572 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d5184-c571-4b4d-97b1-4cf18c71e50b None admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:13.616381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d5184-c571-4b4d-97b1-4cf18c71e50b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:13.616939 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d5184-c571-4b4d-97b1-4cf18c71e50b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:13.618143 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d5184-c571-4b4d-97b1-4cf18c71e50b None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:13.636052 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 443/874] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 3 12:39:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:13.637660 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d5184-c571-4b4d-97b1-4cf18c71e50b None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:13.701312 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c80e5-a0a3-4858-ac1b-7cfb4438cc9c None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:13.725889 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:13.739219 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1b3be-272b-40a3-8684-f038fadf60c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:13.739867 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1b3be-272b-40a3-8684-f038fadf60c5 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:13.740414 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1b3be-272b-40a3-8684-f038fadf60c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:13.740690 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1b3be-272b-40a3-8684-f038fadf60c5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:13.741326 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1b3be-272b-40a3-8684-f038fadf60c5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:13.742726 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1b3be-272b-40a3-8684-f038fadf60c5 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:13.746622 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d5184-c571-4b4d-97b1-4cf18c71e50b None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:13.752669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-37b1b3be-272b-40a3-8684-f038fadf60c5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:39:13.752669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:13.752669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:39:13.752669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:39:13.752669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:39:13.752669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:39:13.752669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:39:13.752669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:13.752669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:39:13.752669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:13.752669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:39:13.752669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:13.752669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:13.752669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:13.752669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:13.752669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:13.752669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:13.753635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:13.753635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:13.753635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:13.753635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:13.753635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:13.753635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:13.753635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:39:13.753635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:39:13.753635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:39:13.753635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:39:13.753635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:13.753635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:13.753635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:13.753635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:13.753635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:13.753635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:13.760606 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:13.760606 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:13.760606 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:13.760606 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:13.760606 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:13.760606 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:13.760606 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:13.760606 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:13.760606 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:13.760606 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:13.760606 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:39:13.760606 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:13.760606 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:39:13.760606 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:13.760606 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 432/875] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Aug 3 12:39:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:13.761535 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2627855-3c4d-4bb6-8d32-2b90fd86b111 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:13.761535 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2627855-3c4d-4bb6-8d32-2b90fd86b111 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:13.761535 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2627855-3c4d-4bb6-8d32-2b90fd86b111 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:13.761535 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 433/876] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:13.761535 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2627855-3c4d-4bb6-8d32-2b90fd86b111 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:13.790160 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fce84d-d0d6-467e-8109-ec9bd609359e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:13.790770 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fce84d-d0d6-467e-8109-ec9bd609359e None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:13.791047 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fce84d-d0d6-467e-8109-ec9bd609359e None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:13.791318 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fce84d-d0d6-467e-8109-ec9bd609359e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:13.792123 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fce84d-d0d6-467e-8109-ec9bd609359e None admin] RBAC: Adding query filter params (role.id=39d74def259b415ca634ad9c715e1332, scope.project.id=6ac833dfff634496816842c851545d21, user.id=a994c976b95744ed9723bf9c4386bde1) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:13.792415 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fce84d-d0d6-467e-8109-ec9bd609359e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:13.794385 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fce84d-d0d6-467e-8109-ec9bd609359e None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:13.800484 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 444/877] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:39:13 2022] GET /identity/v3/role_assignments?user.id=a994c976b95744ed9723bf9c4386bde1&scope.project.id=6ac833dfff634496816842c851545d21&role.id=39d74def259b415ca634ad9c715e1332 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:13.801703 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6a18c-b831-4e9c-b792-45d37423551b None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:13.801876 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6a18c-b831-4e9c-b792-45d37423551b None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:13.802171 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6a18c-b831-4e9c-b792-45d37423551b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:13.816012 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:13.824444 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-2fc6a18c-b831-4e9c-b792-45d37423551b None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:13.825724 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-2fc6a18c-b831-4e9c-b792-45d37423551b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:13.904293 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2627855-3c4d-4bb6-8d32-2b90fd86b111 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:13.906860 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 445/878] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:13 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:39:13.928602 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6a18c-b831-4e9c-b792-45d37423551b None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:13.946177 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01223ae5-2bd5-4063-97bd-f42305db70c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:13.947190 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01223ae5-2bd5-4063-97bd-f42305db70c9 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:13.947668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01223ae5-2bd5-4063-97bd-f42305db70c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:13.948134 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01223ae5-2bd5-4063-97bd-f42305db70c9 None admin] PATH_INFO: `/v3/services` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:13.949107 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01223ae5-2bd5-4063-97bd-f42305db70c9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:13.949671 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01223ae5-2bd5-4063-97bd-f42305db70c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:13.951258 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01223ae5-2bd5-4063-97bd-f42305db70c9 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:13.961531 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 434/879] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Aug 3 12:39:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:13.963621 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01223ae5-2bd5-4063-97bd-f42305db70c9 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:14.019874 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:14.052924 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6a18c-b831-4e9c-b792-45d37423551b None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:14.084007 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:14.088984 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01223ae5-2bd5-4063-97bd-f42305db70c9 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:14.097400 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f9a46-a88d-48f4-92ec-78dae4f3c393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:14.098155 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f9a46-a88d-48f4-92ec-78dae4f3c393 None admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:14.098509 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f9a46-a88d-48f4-92ec-78dae4f3c393 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:14.098859 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f9a46-a88d-48f4-92ec-78dae4f3c393 None admin] PATH_INFO: `/v3/services` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:14.099648 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f9a46-a88d-48f4-92ec-78dae4f3c393 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:14.101713 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f9a46-a88d-48f4-92ec-78dae4f3c393 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:14.124371 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 446/880] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Aug 3 12:39:13 2022] POST /identity/v3/services => generated 269 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:39:14.144279 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d4b38-4e87-4afd-becf-52890828bdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:14.145228 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d4b38-4e87-4afd-becf-52890828bdb8 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:14.145741 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d4b38-4e87-4afd-becf-52890828bdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:14.146189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d4b38-4e87-4afd-becf-52890828bdb8 None admin] PATH_INFO: `/v3/services` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:14.147085 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d4b38-4e87-4afd-becf-52890828bdb8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:14.147587 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d4b38-4e87-4afd-becf-52890828bdb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:14.149176 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d4b38-4e87-4afd-becf-52890828bdb8 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:14.158573 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 435/881] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Aug 3 12:39:13 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:14.279169 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977f76d-c648-4bc4-94d8-f69ee6f2c5a8 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:14.279516 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977f76d-c648-4bc4-94d8-f69ee6f2c5a8 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:14.279738 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977f76d-c648-4bc4-94d8-f69ee6f2c5a8 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:14.281571 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 447/882] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:14.287469 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62a075-902b-4a21-88cf-2488f9bde0ab None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:14.287766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62a075-902b-4a21-88cf-2488f9bde0ab None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:14.288082 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62a075-902b-4a21-88cf-2488f9bde0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:14.309717 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-6f62a075-902b-4a21-88cf-2488f9bde0ab None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:14.311389 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-6f62a075-902b-4a21-88cf-2488f9bde0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:14.390294 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 436/883] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:14 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:39:14.412696 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977f76d-c648-4bc4-94d8-f69ee6f2c5a8 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:14.522925 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977f76d-c648-4bc4-94d8-f69ee6f2c5a8 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:14.558375 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3debe-6179-422d-9c2e-4fb9de760c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:14.559169 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3debe-6179-422d-9c2e-4fb9de760c62 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:14.559452 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3debe-6179-422d-9c2e-4fb9de760c62 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:14.559719 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3debe-6179-422d-9c2e-4fb9de760c62 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:14.560350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed3debe-6179-422d-9c2e-4fb9de760c62 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:14.561803 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed3debe-6179-422d-9c2e-4fb9de760c62 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:14.571026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-fed3debe-6179-422d-9c2e-4fb9de760c62 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 03 12:39:14.571026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:14.571026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:39:14.571026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:39:14.571026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:39:14.571026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:39:14.571026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:39:14.571026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:14.571026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 03 12:39:14.571026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:14.571026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:39:14.571026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:14.571026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:14.571026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:14.571026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:14.571026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:14.571026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:14.572021 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:14.572021 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:14.572021 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:14.572021 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:14.572021 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:14.572021 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:14.572021 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:39:14.572021 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:39:14.572021 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:39:14.572021 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:39:14.572021 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:14.572021 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:14.572021 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:14.572021 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:14.572021 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:14.572021 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:14.573264 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:14.573264 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:14.573264 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:14.573264 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:14.573264 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:14.573264 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:14.573264 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:14.573264 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:14.573264 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:14.573264 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:14.573264 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:39:14.573264 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:14.573264 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 03 12:39:14.573264 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:14.573264 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 448/884] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 3 12:39:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:14.578431 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62a075-902b-4a21-88cf-2488f9bde0ab None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:14.670471 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:14.689530 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62a075-902b-4a21-88cf-2488f9bde0ab None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:14.725199 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84290ccc-672f-4f7f-86de-e8e5a800adbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:14.726244 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84290ccc-672f-4f7f-86de-e8e5a800adbb None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:14.726731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84290ccc-672f-4f7f-86de-e8e5a800adbb None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:14.727225 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84290ccc-672f-4f7f-86de-e8e5a800adbb None admin] PATH_INFO: `/v3/services` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:14.728109 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84290ccc-672f-4f7f-86de-e8e5a800adbb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:14.728632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84290ccc-672f-4f7f-86de-e8e5a800adbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:14.731024 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84290ccc-672f-4f7f-86de-e8e5a800adbb None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:14.736669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 437/885] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 3 12:39:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:14.742534 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3debe-6179-422d-9c2e-4fb9de760c62 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:14.746175 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:14.858605 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3debe-6179-422d-9c2e-4fb9de760c62 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:14.894000 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689ac49-777f-4a93-ba63-edd9be631b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:14.894629 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689ac49-777f-4a93-ba63-edd9be631b41 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:14.894913 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689ac49-777f-4a93-ba63-edd9be631b41 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:14.895188 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689ac49-777f-4a93-ba63-edd9be631b41 None admin] PATH_INFO: `/v3/services` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:14.895881 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689ac49-777f-4a93-ba63-edd9be631b41 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:14.896188 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689ac49-777f-4a93-ba63-edd9be631b41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:14.897593 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689ac49-777f-4a93-ba63-edd9be631b41 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:14.903868 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 449/886] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 3 12:39:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:14.909437 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84290ccc-672f-4f7f-86de-e8e5a800adbb None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:15.018368 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84290ccc-672f-4f7f-86de-e8e5a800adbb None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:15.053183 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b880759-0e51-42d3-8242-bfba79304425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:15.054173 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b880759-0e51-42d3-8242-bfba79304425 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:15.054661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b880759-0e51-42d3-8242-bfba79304425 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:15.055139 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b880759-0e51-42d3-8242-bfba79304425 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:15.056103 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b880759-0e51-42d3-8242-bfba79304425 None admin] RBAC: Adding query filter params (interface=public, service_id=3b32659c42804058b8f4e7274a59bd11, region_id=RegionOne) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:15.056618 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b880759-0e51-42d3-8242-bfba79304425 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:15.058335 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b880759-0e51-42d3-8242-bfba79304425 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:15.064187 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 438/887] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Aug 3 12:39:14 2022] GET /identity/v3/endpoints?service_id=3b32659c42804058b8f4e7274a59bd11&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:15.069282 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689ac49-777f-4a93-ba63-edd9be631b41 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:15.142979 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:15.184274 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689ac49-777f-4a93-ba63-edd9be631b41 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:15.221061 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb5b1e-8e33-42d0-bd61-1807d5754acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:15.221706 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb5b1e-8e33-42d0-bd61-1807d5754acc None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:15.221993 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb5b1e-8e33-42d0-bd61-1807d5754acc None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:15.222269 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb5b1e-8e33-42d0-bd61-1807d5754acc None admin] PATH_INFO: `/v3/services` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:15.222929 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb5b1e-8e33-42d0-bd61-1807d5754acc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:15.224299 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb5b1e-8e33-42d0-bd61-1807d5754acc None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:15.230523 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 450/888] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Aug 3 12:39:15 2022] GET /identity/v3/services => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:39:16.065308 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bbd2c-cb3c-4789-9740-552514c10c8b None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:16.065856 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bbd2c-cb3c-4789-9740-552514c10c8b None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:16.065856 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bbd2c-cb3c-4789-9740-552514c10c8b None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:16.067471 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 439/889] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:16.072728 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ed488-8931-4122-bc9a-2b95a555a6ba None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:16.073108 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ed488-8931-4122-bc9a-2b95a555a6ba None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:16.073288 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ed488-8931-4122-bc9a-2b95a555a6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:16.092266 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-fe5ed488-8931-4122-bc9a-2b95a555a6ba None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:16.093472 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-fe5ed488-8931-4122-bc9a-2b95a555a6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:16.166525 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 451/890] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:16 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:39:16.190570 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168bbd2c-cb3c-4789-9740-552514c10c8b None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:16.210147 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:16.243797 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db6115-6dac-46ae-9480-81ea9140e660 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:16.244130 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db6115-6dac-46ae-9480-81ea9140e660 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:16.244358 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db6115-6dac-46ae-9480-81ea9140e660 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:16.246812 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 452/891] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:39:16.251826 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c20f2c-dc65-40d1-b8e8-1f477c59a3e5 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:16.252112 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c20f2c-dc65-40d1-b8e8-1f477c59a3e5 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:16.252387 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c20f2c-dc65-40d1-b8e8-1f477c59a3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:16.273519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-b2c20f2c-dc65-40d1-b8e8-1f477c59a3e5 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:16.273519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-b2c20f2c-dc65-40d1-b8e8-1f477c59a3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:16.319621 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168bbd2c-cb3c-4789-9740-552514c10c8b None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:16.333433 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:16.353517 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 453/892] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:16 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:39:16.353517 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1918a95-184a-4d43-9a83-cc4ea48e569f None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:16.353517 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1918a95-184a-4d43-9a83-cc4ea48e569f None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:16.353517 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1918a95-184a-4d43-9a83-cc4ea48e569f None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:16.353517 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 454/893] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:16.355120 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ab499-3577-4af6-bcd1-b9fe9020402a None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:16.355948 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ab499-3577-4af6-bcd1-b9fe9020402a None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:16.356356 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ab499-3577-4af6-bcd1-b9fe9020402a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:16.365330 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475530d0-e532-4c4b-a2c1-d390a6bd28f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:16.366026 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475530d0-e532-4c4b-a2c1-d390a6bd28f2 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:16.366311 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475530d0-e532-4c4b-a2c1-d390a6bd28f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:16.366590 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475530d0-e532-4c4b-a2c1-d390a6bd28f2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:16.375078 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-a75ab499-3577-4af6-bcd1-b9fe9020402a None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:16.376303 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-a75ab499-3577-4af6-bcd1-b9fe9020402a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:16.377714 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475530d0-e532-4c4b-a2c1-d390a6bd28f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:39:16.382848 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-475530d0-e532-4c4b-a2c1-d390a6bd28f2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 12:39:16.382848 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:16.382848 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:16.382848 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:16.382848 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:16.382848 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:16.382848 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:16.382848 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:16.382848 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:16.382848 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:16.382848 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:16.382848 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:16.382848 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:39:16.382848 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:39:16.382848 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:39:16.382848 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:39:16.383867 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:39:16.383867 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:39:16.383867 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:39:16.383867 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:39:16.383867 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:16.383867 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:16.383867 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:16.383867 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:16.383867 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:16.383867 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:16.383867 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:16.383867 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:16.383867 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:16.383867 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:16.383867 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:16.383867 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:16.384744 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:16.384744 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:16.384744 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:16.384744 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:16.384744 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:39:16.384744 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:39:16.384744 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:39:16.384744 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:39:16.384744 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:39:16.384744 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:39:16.384744 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 12:39:16.384744 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:16.386144 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 440/894] 10.222.0.46 () {56 vars in 1120 bytes} [Wed Aug 3 12:39:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:16.387462 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475530d0-e532-4c4b-a2c1-d390a6bd28f2 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:16.461857 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 455/895] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:16 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:39:16.463056 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ab499-3577-4af6-bcd1-b9fe9020402a None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:16.472988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:16.502877 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475530d0-e532-4c4b-a2c1-d390a6bd28f2 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:16.539872 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09392d64-b44f-42ae-a9aa-d510cbade599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:16.540492 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09392d64-b44f-42ae-a9aa-d510cbade599 None admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:16.540777 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09392d64-b44f-42ae-a9aa-d510cbade599 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:16.541050 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09392d64-b44f-42ae-a9aa-d510cbade599 None admin] PATH_INFO: `/v3/services` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:16.541769 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09392d64-b44f-42ae-a9aa-d510cbade599 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:16.543818 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09392d64-b44f-42ae-a9aa-d510cbade599 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:16.567681 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 441/896] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Aug 3 12:39:16 2022] POST /identity/v3/services => generated 241 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:39:16.568671 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09392d64-b44f-42ae-a9aa-d510cbade599 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:16.575032 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ab499-3577-4af6-bcd1-b9fe9020402a None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:16.601289 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:16.627077 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448c5c4-501e-4641-b28b-5f52e0fa8692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:16.628085 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448c5c4-501e-4641-b28b-5f52e0fa8692 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:16.628570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448c5c4-501e-4641-b28b-5f52e0fa8692 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:16.629091 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448c5c4-501e-4641-b28b-5f52e0fa8692 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:16.630201 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448c5c4-501e-4641-b28b-5f52e0fa8692 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:16.630796 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448c5c4-501e-4641-b28b-5f52e0fa8692 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:16.632537 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448c5c4-501e-4641-b28b-5f52e0fa8692 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:16.648815 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 456/897] 10.222.0.46 () {56 vars in 1115 bytes} [Wed Aug 3 12:39:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:16.650335 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448c5c4-501e-4641-b28b-5f52e0fa8692 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:16.719594 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09392d64-b44f-42ae-a9aa-d510cbade599 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:16.763105 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc950491-2900-47e5-bde2-6d09eacdddab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:16.764038 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc950491-2900-47e5-bde2-6d09eacdddab None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:16.764324 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc950491-2900-47e5-bde2-6d09eacdddab None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:16.764745 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc950491-2900-47e5-bde2-6d09eacdddab None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:16.766352 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc950491-2900-47e5-bde2-6d09eacdddab None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:16.767502 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc950491-2900-47e5-bde2-6d09eacdddab None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:16.771013 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:16.772035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448c5c4-501e-4641-b28b-5f52e0fa8692 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:16.780411 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-cc950491-2900-47e5-bde2-6d09eacdddab None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 03 12:39:16.780411 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:16.780411 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:39:16.780411 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:39:16.780411 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:39:16.780411 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:39:16.780411 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:39:16.780411 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:16.780411 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 03 12:39:16.780411 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:16.780411 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:39:16.780411 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:16.780411 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:16.780411 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:16.780411 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:16.780411 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:16.781384 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:16.781384 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:16.781384 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:16.781384 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:16.781384 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:16.781384 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:16.781384 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:16.781384 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:39:16.781384 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:39:16.781384 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:39:16.781384 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:39:16.781384 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:16.781384 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:16.781384 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:16.781384 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:16.781384 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:16.782309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:16.782309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:16.782309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:16.782309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:16.782309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:16.782309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:16.782309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:16.782309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:16.782309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:16.782309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:16.782309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:16.782309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:39:16.782309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:16.782309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 03 12:39:16.782309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:16.785580 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 442/898] 10.222.0.46 () {56 vars in 1132 bytes} [Wed Aug 3 12:39:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:16.788864 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc950491-2900-47e5-bde2-6d09eacdddab None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:16.818178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da6cc3-c939-42dd-a379-bf2da55a91da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:16.818835 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da6cc3-c939-42dd-a379-bf2da55a91da None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:16.819373 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da6cc3-c939-42dd-a379-bf2da55a91da None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:16.819656 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da6cc3-c939-42dd-a379-bf2da55a91da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:16.834742 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da6cc3-c939-42dd-a379-bf2da55a91da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:16.837036 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da6cc3-c939-42dd-a379-bf2da55a91da None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:16.856570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-55da6cc3-c939-42dd-a379-bf2da55a91da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:16.856570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:16.856570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:16.856570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:16.856570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:16.856570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:16.856570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:16.856570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:16.856570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:16.856570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:16.856570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:16.856570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:16.856570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:39:16.856570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:39:16.856570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:39:16.857530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:39:16.857530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:16.857530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:16.857530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:16.857530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:16.857530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:16.857530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:16.857530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:16.857530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:16.857530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:16.857530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:16.857530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:16.857530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:16.857530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:16.857530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:16.857530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:16.857530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:16.858598 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:39:16.858598 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:39:16.858598 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:16.858598 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:16.858598 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 457/899] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:39:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:16.865542 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da6cc3-c939-42dd-a379-bf2da55a91da None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:16.905833 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:16.908209 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc950491-2900-47e5-bde2-6d09eacdddab None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:16.960580 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d710b-ebe4-4749-817e-b61e8afcee5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:16.961206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d710b-ebe4-4749-817e-b61e8afcee5d None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:16.961524 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d710b-ebe4-4749-817e-b61e8afcee5d None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:16.961794 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d710b-ebe4-4749-817e-b61e8afcee5d None admin] PATH_INFO: `/v3/services` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:16.962487 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d710b-ebe4-4749-817e-b61e8afcee5d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:16.962792 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d710b-ebe4-4749-817e-b61e8afcee5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:16.964731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d710b-ebe4-4749-817e-b61e8afcee5d None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:16.975803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 443/900] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Aug 3 12:39:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:16.977405 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d710b-ebe4-4749-817e-b61e8afcee5d None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:16.994933 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da6cc3-c939-42dd-a379-bf2da55a91da None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:17.031527 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71af2e-c6fc-434a-8fb2-966354b5a248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:17.032149 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71af2e-c6fc-434a-8fb2-966354b5a248 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:17.032424 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71af2e-c6fc-434a-8fb2-966354b5a248 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:17.032693 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71af2e-c6fc-434a-8fb2-966354b5a248 None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:17.033455 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71af2e-c6fc-434a-8fb2-966354b5a248 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:17.033796 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71af2e-c6fc-434a-8fb2-966354b5a248 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:17.035179 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71af2e-c6fc-434a-8fb2-966354b5a248 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:17.046585 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:17.049153 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 458/901] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:17.055096 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71af2e-c6fc-434a-8fb2-966354b5a248 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:17.090675 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d710b-ebe4-4749-817e-b61e8afcee5d None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:17.128546 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574e6a4-11e0-4f88-aeb2-df53bbfc8c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:17.129554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574e6a4-11e0-4f88-aeb2-df53bbfc8c02 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:17.130037 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574e6a4-11e0-4f88-aeb2-df53bbfc8c02 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:17.130505 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574e6a4-11e0-4f88-aeb2-df53bbfc8c02 None admin] PATH_INFO: `/v3/services` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:17.131386 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c574e6a4-11e0-4f88-aeb2-df53bbfc8c02 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:17.131886 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c574e6a4-11e0-4f88-aeb2-df53bbfc8c02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:17.133430 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c574e6a4-11e0-4f88-aeb2-df53bbfc8c02 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:17.144293 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 444/902] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Aug 3 12:39:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:17.146254 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574e6a4-11e0-4f88-aeb2-df53bbfc8c02 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:17.160025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:17.176738 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71af2e-c6fc-434a-8fb2-966354b5a248 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:17.213420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ec4ee-ad26-4d37-973b-09835c3de64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:17.214131 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ec4ee-ad26-4d37-973b-09835c3de64c None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:17.214458 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ec4ee-ad26-4d37-973b-09835c3de64c None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:17.214796 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ec4ee-ad26-4d37-973b-09835c3de64c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:17.222429 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ec4ee-ad26-4d37-973b-09835c3de64c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:17.223880 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ec4ee-ad26-4d37-973b-09835c3de64c None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:17.236490 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-861ec4ee-ad26-4d37-973b-09835c3de64c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 12:39:17.236490 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:17.236490 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:17.236490 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:17.236490 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:17.236490 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:17.236490 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:17.236490 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:17.236490 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:17.236490 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:17.236490 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:17.236490 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:17.236490 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:39:17.236490 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:39:17.236490 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:39:17.236490 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:39:17.237452 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:17.237452 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:17.237452 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:39:17.237452 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:39:17.237452 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:39:17.237452 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:39:17.237452 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:17.237452 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:17.237452 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:17.237452 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:17.237452 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:17.237452 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:17.237452 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:17.237452 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:17.237452 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:17.237452 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:17.237452 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:17.237452 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:17.238886 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:17.238886 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:17.238886 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:39:17.238886 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:39:17.238886 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:39:17.238886 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:39:17.238886 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:39:17.238886 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:39:17.238886 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 12:39:17.238886 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:17.238886 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 459/903] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Aug 3 12:39:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:17.243958 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ec4ee-ad26-4d37-973b-09835c3de64c None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:17.278537 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574e6a4-11e0-4f88-aeb2-df53bbfc8c02 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:17.307433 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:17.316777 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601b0db-117a-45a3-b238-9b86ec9586d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:17.317486 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601b0db-117a-45a3-b238-9b86ec9586d5 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:17.317798 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601b0db-117a-45a3-b238-9b86ec9586d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:17.318072 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601b0db-117a-45a3-b238-9b86ec9586d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:17.318831 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8601b0db-117a-45a3-b238-9b86ec9586d5 None admin] RBAC: Adding query filter params (interface=public, service_id=c02c933c8a6b4d4eaf693c122ebab8f0, region_id=RegionOne) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:17.319141 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8601b0db-117a-45a3-b238-9b86ec9586d5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:17.320498 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8601b0db-117a-45a3-b238-9b86ec9586d5 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:17.330685 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 445/904] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Aug 3 12:39:17 2022] GET /identity/v3/endpoints?service_id=c02c933c8a6b4d4eaf693c122ebab8f0&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:17.330685 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821684d-777b-4514-9445-06f04bf53347 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:17.330685 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821684d-777b-4514-9445-06f04bf53347 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:17.330685 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821684d-777b-4514-9445-06f04bf53347 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:17.330685 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 446/905] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:17.332184 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821684d-777b-4514-9445-06f04bf53347 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:17.358796 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ec4ee-ad26-4d37-973b-09835c3de64c None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:17.398352 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9a5fb-7826-4bcd-b93c-1dbb96d8f3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:17.398976 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9a5fb-7826-4bcd-b93c-1dbb96d8f3f1 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:17.399260 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9a5fb-7826-4bcd-b93c-1dbb96d8f3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:17.399532 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9a5fb-7826-4bcd-b93c-1dbb96d8f3f1 None admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:17.400328 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f9a5fb-7826-4bcd-b93c-1dbb96d8f3f1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:17.400631 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f9a5fb-7826-4bcd-b93c-1dbb96d8f3f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:17.402839 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f9a5fb-7826-4bcd-b93c-1dbb96d8f3f1 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:17.420883 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 460/906] 10.222.0.46 () {56 vars in 1149 bytes} [Wed Aug 3 12:39:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:17.426512 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7f9d4-8c57-494a-a8dc-3ec6196fa59b None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:17.426804 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7f9d4-8c57-494a-a8dc-3ec6196fa59b None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:17.427085 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7f9d4-8c57-494a-a8dc-3ec6196fa59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:17.447399 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-5da7f9d4-8c57-494a-a8dc-3ec6196fa59b None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:17.448282 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821684d-777b-4514-9445-06f04bf53347 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:17.448590 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-5da7f9d4-8c57-494a-a8dc-3ec6196fa59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:17.451960 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:17.484935 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b9c2f-d232-42e0-bf73-6c00219fa596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:17.485604 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b9c2f-d232-42e0-bf73-6c00219fa596 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:17.485892 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b9c2f-d232-42e0-bf73-6c00219fa596 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:17.486166 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b9c2f-d232-42e0-bf73-6c00219fa596 None admin] PATH_INFO: `/v3/services` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:17.486821 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b9c2f-d232-42e0-bf73-6c00219fa596 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:17.488184 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b9c2f-d232-42e0-bf73-6c00219fa596 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:17.505535 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 447/907] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Aug 3 12:39:17 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:39:17.505535 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b9c2f-d232-42e0-bf73-6c00219fa596 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:17.546228 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 461/908] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:39:17.560217 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7f9d4-8c57-494a-a8dc-3ec6196fa59b None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:17.575876 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:17.637607 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b9c2f-d232-42e0-bf73-6c00219fa596 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:17.681608 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1d1b2-9685-44f1-93f5-b6aec8a8577b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:17.682498 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1d1b2-9685-44f1-93f5-b6aec8a8577b None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:17.682776 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1d1b2-9685-44f1-93f5-b6aec8a8577b None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:17.683048 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1d1b2-9685-44f1-93f5-b6aec8a8577b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:17.695454 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7f9d4-8c57-494a-a8dc-3ec6196fa59b None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:17.747276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9cb31-df71-419f-a22b-7c50c621ecd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:17.748782 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9cb31-df71-419f-a22b-7c50c621ecd1 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:17.749378 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9cb31-df71-419f-a22b-7c50c621ecd1 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:17.749938 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9cb31-df71-419f-a22b-7c50c621ecd1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:17.750976 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9cb31-df71-419f-a22b-7c50c621ecd1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:17.753178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9cb31-df71-419f-a22b-7c50c621ecd1 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:17.765216 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1d1b2-9685-44f1-93f5-b6aec8a8577b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:17.766025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-efd9cb31-df71-419f-a22b-7c50c621ecd1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 03 12:39:17.766025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:17.766025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:39:17.766025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:39:17.766025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:39:17.766025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:39:17.766025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:39:17.766025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:17.766025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 03 12:39:17.766025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:17.766025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:39:17.766025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:17.766025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:17.766025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:17.766025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:17.766025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:17.766025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:17.767192 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:17.767192 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:17.767192 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:17.767192 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:17.767192 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:17.767192 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:17.767192 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:39:17.767192 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:39:17.767192 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:39:17.767192 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:39:17.767192 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:17.767192 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:17.767192 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:17.767192 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:17.767192 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:17.767192 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:17.768210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:17.768210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:17.768210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:17.768210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:17.768210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:17.768210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:17.768210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:17.768210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:17.768210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:17.768210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:17.768210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:39:17.768210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:17.768210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 03 12:39:17.768210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:17.769116 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1d1b2-9685-44f1-93f5-b6aec8a8577b None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:17.771293 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 462/909] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 3 12:39:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:17.781549 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9cb31-df71-419f-a22b-7c50c621ecd1 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:17.799912 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:17.832972 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:17.888345 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 448/910] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:39:17 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:39:17.890484 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1d1b2-9685-44f1-93f5-b6aec8a8577b None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:17.914136 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9cb31-df71-419f-a22b-7c50c621ecd1 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:17.951687 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5721bf1-2847-4028-aaec-00875a195576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:17.952316 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5721bf1-2847-4028-aaec-00875a195576 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:17.952598 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5721bf1-2847-4028-aaec-00875a195576 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:17.952874 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5721bf1-2847-4028-aaec-00875a195576 None admin] PATH_INFO: `/v3/services` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:17.953583 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5721bf1-2847-4028-aaec-00875a195576 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:17.953890 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5721bf1-2847-4028-aaec-00875a195576 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:17.955263 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5721bf1-2847-4028-aaec-00875a195576 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:17.960616 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 463/911] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 3 12:39:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:17.967209 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5721bf1-2847-4028-aaec-00875a195576 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:18.015123 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1d1b2-9685-44f1-93f5-b6aec8a8577b None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:18.051337 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:18.057419 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33a234-1779-42a1-b8b4-0089c28cc816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:18.058165 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33a234-1779-42a1-b8b4-0089c28cc816 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:18.059798 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33a234-1779-42a1-b8b4-0089c28cc816 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:18.059798 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33a234-1779-42a1-b8b4-0089c28cc816 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:18.070228 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33a234-1779-42a1-b8b4-0089c28cc816 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:18.071772 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33a234-1779-42a1-b8b4-0089c28cc816 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:18.089871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-5f33a234-1779-42a1-b8b4-0089c28cc816 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:18.089871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:18.089871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:18.089871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:18.089871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:18.089871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:18.089871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:18.089871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:18.089871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:18.089871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:18.089871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:18.089871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:18.089871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:39:18.089871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:39:18.089871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:39:18.091219 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:39:18.091219 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:18.091219 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:18.091219 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:18.091219 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:18.091219 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:18.091219 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:18.091219 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:18.091219 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:18.091219 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:18.091219 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:18.091219 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:18.091219 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:18.091219 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:18.091219 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:18.091219 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:18.091219 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:18.092549 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:39:18.092549 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:39:18.092549 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:18.092549 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:18.096263 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 449/912] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:39:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:18.097199 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33a234-1779-42a1-b8b4-0089c28cc816 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:18.098011 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5721bf1-2847-4028-aaec-00875a195576 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:18.109211 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:18.139154 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7d1b0-0cc3-4ca3-b238-8ab6a0ed5df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:18.140073 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7d1b0-0cc3-4ca3-b238-8ab6a0ed5df8 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:18.140533 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7d1b0-0cc3-4ca3-b238-8ab6a0ed5df8 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:18.140998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7d1b0-0cc3-4ca3-b238-8ab6a0ed5df8 None admin] PATH_INFO: `/v3/services` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:18.142037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7d1b0-0cc3-4ca3-b238-8ab6a0ed5df8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:18.142522 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7d1b0-0cc3-4ca3-b238-8ab6a0ed5df8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:18.144235 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7d1b0-0cc3-4ca3-b238-8ab6a0ed5df8 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:18.155556 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 464/913] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Aug 3 12:39:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:18.157162 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7d1b0-0cc3-4ca3-b238-8ab6a0ed5df8 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:18.205398 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33a234-1779-42a1-b8b4-0089c28cc816 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:18.240814 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc68f0a-55e0-41c6-a744-178459bb4c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:18.241896 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc68f0a-55e0-41c6-a744-178459bb4c4e None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:18.242276 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc68f0a-55e0-41c6-a744-178459bb4c4e None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:18.242859 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc68f0a-55e0-41c6-a744-178459bb4c4e None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:18.243449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc68f0a-55e0-41c6-a744-178459bb4c4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:18.243872 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc68f0a-55e0-41c6-a744-178459bb4c4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:18.245327 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc68f0a-55e0-41c6-a744-178459bb4c4e None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:18.261896 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 450/914] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:18.264330 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc68f0a-55e0-41c6-a744-178459bb4c4e None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:18.282379 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7d1b0-0cc3-4ca3-b238-8ab6a0ed5df8 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:18.315180 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:18.322403 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519049ec-16a1-4d2a-b481-4e8b8021e270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:18.323281 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519049ec-16a1-4d2a-b481-4e8b8021e270 None admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:18.323795 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519049ec-16a1-4d2a-b481-4e8b8021e270 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:18.324225 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519049ec-16a1-4d2a-b481-4e8b8021e270 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:18.325309 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519049ec-16a1-4d2a-b481-4e8b8021e270 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:18.326958 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519049ec-16a1-4d2a-b481-4e8b8021e270 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:18.336072 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:18.357766 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 465/915] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:39:18 2022] POST /identity/v3/endpoints => generated 346 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:39:18.378828 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc68f0a-55e0-41c6-a744-178459bb4c4e None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:18.424961 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141ff55-f2b3-4915-9ad8-bafe06e1374f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:18.425561 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141ff55-f2b3-4915-9ad8-bafe06e1374f None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:18.425848 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141ff55-f2b3-4915-9ad8-bafe06e1374f None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:18.426125 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141ff55-f2b3-4915-9ad8-bafe06e1374f None admin] PATH_INFO: `/v3/projects/service` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:18.434704 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141ff55-f2b3-4915-9ad8-bafe06e1374f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:18.436208 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141ff55-f2b3-4915-9ad8-bafe06e1374f None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:18.449459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-3141ff55-f2b3-4915-9ad8-bafe06e1374f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:39:18.449459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:18.449459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:18.449459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:18.449459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:18.449459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:18.449459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:18.449459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:18.449459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:18.449459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:18.449459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:18.449459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:18.449459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:39:18.449459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:39:18.449459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:39:18.450482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:39:18.450482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:18.450482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:18.450482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:18.450482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:18.450482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:18.450482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:18.450482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:18.450482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:18.450482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:18.450482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:18.450482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:18.450482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:18.450482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:18.450482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:18.450482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:18.450482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:18.451886 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:39:18.451886 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:39:18.451886 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:39:18.451886 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:39:18.451886 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:39:18.451886 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:39:18.451886 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:39:18.451886 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:18.451886 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 451/916] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:39:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:39:18.457023 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519049ec-16a1-4d2a-b481-4e8b8021e270 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:18.569685 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519049ec-16a1-4d2a-b481-4e8b8021e270 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:18.606126 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d396a7a-2ef5-49d8-9683-db2c9c701d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:18.606756 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d396a7a-2ef5-49d8-9683-db2c9c701d03 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:18.607043 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d396a7a-2ef5-49d8-9683-db2c9c701d03 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:18.607325 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d396a7a-2ef5-49d8-9683-db2c9c701d03 None admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:18.608092 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d396a7a-2ef5-49d8-9683-db2c9c701d03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:18.608402 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d396a7a-2ef5-49d8-9683-db2c9c701d03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:18.609883 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d396a7a-2ef5-49d8-9683-db2c9c701d03 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:18.624084 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 466/917] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 3 12:39:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:18.629836 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141ff55-f2b3-4915-9ad8-bafe06e1374f None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:18.738298 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141ff55-f2b3-4915-9ad8-bafe06e1374f None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:18.755685 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6367a7d-c71b-4707-8fdf-95ea98b3ae6a None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:18.756110 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6367a7d-c71b-4707-8fdf-95ea98b3ae6a None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:18.756494 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6367a7d-c71b-4707-8fdf-95ea98b3ae6a None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:18.758283 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 467/918] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:39:18.763558 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44029435-8921-401c-be38-6d06f7c02de0 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:18.763954 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44029435-8921-401c-be38-6d06f7c02de0 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:18.764396 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44029435-8921-401c-be38-6d06f7c02de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:18.764873 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:18.775598 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdca96b-00f9-4c82-b1aa-97709042f27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:18.776222 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdca96b-00f9-4c82-b1aa-97709042f27e None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:18.776510 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdca96b-00f9-4c82-b1aa-97709042f27e None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:18.776815 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdca96b-00f9-4c82-b1aa-97709042f27e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:18.777657 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdca96b-00f9-4c82-b1aa-97709042f27e None admin] RBAC: Adding query filter params (role.id=a7ac56aa0b134a9e925725f41c54d4b3, scope.project.id=6ac833dfff634496816842c851545d21, user.id=a994c976b95744ed9723bf9c4386bde1) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:18.777977 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdca96b-00f9-4c82-b1aa-97709042f27e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:18.779540 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdca96b-00f9-4c82-b1aa-97709042f27e None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:18.784658 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-44029435-8921-401c-be38-6d06f7c02de0 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:18.785523 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 452/919] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:39:18 2022] GET /identity/v3/role_assignments?user.id=a994c976b95744ed9723bf9c4386bde1&scope.project.id=6ac833dfff634496816842c851545d21&role.id=a7ac56aa0b134a9e925725f41c54d4b3 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:18.786152 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-44029435-8921-401c-be38-6d06f7c02de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:18.835764 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:18.864496 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 468/920] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:39:18.889043 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdca96b-00f9-4c82-b1aa-97709042f27e None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:19.000178 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdca96b-00f9-4c82-b1aa-97709042f27e None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:19.035667 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e01e93-7c27-4e8b-a333-7a0836010888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:19.036315 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e01e93-7c27-4e8b-a333-7a0836010888 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:19.036602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e01e93-7c27-4e8b-a333-7a0836010888 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:19.037063 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e01e93-7c27-4e8b-a333-7a0836010888 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:19.037784 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e01e93-7c27-4e8b-a333-7a0836010888 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:19.039217 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e01e93-7c27-4e8b-a333-7a0836010888 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:19.048439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-b7e01e93-7c27-4e8b-a333-7a0836010888 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:39:19.048439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:19.048439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:39:19.048439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:39:19.048439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:39:19.048439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:39:19.048439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:39:19.048439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:19.048439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:39:19.048439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:19.048439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:39:19.048439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:19.048439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:19.048439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:19.048439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:19.048439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:19.048439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:19.049422 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:19.049422 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:19.049422 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:19.049422 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:19.049422 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:19.049422 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:19.049422 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:39:19.049422 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:39:19.049422 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:39:19.049422 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:39:19.049422 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:19.049422 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:19.049422 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:19.049422 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:19.049422 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:19.049422 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:19.050676 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:19.050676 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:19.050676 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:19.050676 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:19.050676 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:19.050676 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:19.050676 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:19.050676 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:19.050676 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:19.050676 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:19.050676 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:39:19.050676 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:19.050676 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:39:19.050676 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:19.050676 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 453/921] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Aug 3 12:39:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:19.056009 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44029435-8921-401c-be38-6d06f7c02de0 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:19.161923 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44029435-8921-401c-be38-6d06f7c02de0 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:19.208565 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018dfb0-5d36-4b10-984e-fa6eb43102f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:19.209587 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018dfb0-5d36-4b10-984e-fa6eb43102f9 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:19.210075 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018dfb0-5d36-4b10-984e-fa6eb43102f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:19.210549 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018dfb0-5d36-4b10-984e-fa6eb43102f9 None admin] PATH_INFO: `/v3/services` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:19.211431 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018dfb0-5d36-4b10-984e-fa6eb43102f9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:19.211955 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018dfb0-5d36-4b10-984e-fa6eb43102f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:19.213533 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018dfb0-5d36-4b10-984e-fa6eb43102f9 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:19.219604 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 469/922] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Aug 3 12:39:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:19.228228 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e01e93-7c27-4e8b-a333-7a0836010888 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:19.284773 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:19.334210 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e01e93-7c27-4e8b-a333-7a0836010888 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:19.375078 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa96aaa-8fbe-472d-a98c-8ed0a70bbd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:19.375698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa96aaa-8fbe-472d-a98c-8ed0a70bbd94 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:19.375983 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa96aaa-8fbe-472d-a98c-8ed0a70bbd94 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:19.376265 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa96aaa-8fbe-472d-a98c-8ed0a70bbd94 None admin] PATH_INFO: `/v3/services` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:19.376949 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa96aaa-8fbe-472d-a98c-8ed0a70bbd94 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:19.377255 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa96aaa-8fbe-472d-a98c-8ed0a70bbd94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:19.378691 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa96aaa-8fbe-472d-a98c-8ed0a70bbd94 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:19.384153 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 454/923] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Aug 3 12:39:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:19.389869 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018dfb0-5d36-4b10-984e-fa6eb43102f9 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:19.434792 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:19.494396 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018dfb0-5d36-4b10-984e-fa6eb43102f9 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:19.529792 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b0763-33be-402e-abb7-a5406bc8dde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:19.530392 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b0763-33be-402e-abb7-a5406bc8dde8 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:19.530677 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b0763-33be-402e-abb7-a5406bc8dde8 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:19.530949 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b0763-33be-402e-abb7-a5406bc8dde8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:19.531700 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b0763-33be-402e-abb7-a5406bc8dde8 None admin] RBAC: Adding query filter params (interface=public, service_id=a0139ba16c0b40948086d3161e92beff, region_id=RegionOne) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:19.532056 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b0763-33be-402e-abb7-a5406bc8dde8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:19.533484 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b0763-33be-402e-abb7-a5406bc8dde8 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:19.539043 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 470/924] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Aug 3 12:39:19 2022] GET /identity/v3/endpoints?service_id=a0139ba16c0b40948086d3161e92beff&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:19.545057 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa96aaa-8fbe-472d-a98c-8ed0a70bbd94 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:19.575426 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c05b1-e62a-4399-8c5a-dff3aeb8891f None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:19.575709 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c05b1-e62a-4399-8c5a-dff3aeb8891f None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:19.575983 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c05b1-e62a-4399-8c5a-dff3aeb8891f None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:19.581233 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 471/925] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:39:19.582365 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ef4b0-4c0e-499d-b257-2edd9643d577 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:19.582644 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ef4b0-4c0e-499d-b257-2edd9643d577 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:19.582918 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ef4b0-4c0e-499d-b257-2edd9643d577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:19.601192 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-6f2ef4b0-4c0e-499d-b257-2edd9643d577 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:19.602488 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-6f2ef4b0-4c0e-499d-b257-2edd9643d577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:19.664188 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa96aaa-8fbe-472d-a98c-8ed0a70bbd94 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:19.683798 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:19.703758 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607c06a-e5a6-49ae-8298-05d88ebcfa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:19.704601 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607c06a-e5a6-49ae-8298-05d88ebcfa76 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:19.705029 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607c06a-e5a6-49ae-8298-05d88ebcfa76 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:19.705471 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607c06a-e5a6-49ae-8298-05d88ebcfa76 None admin] PATH_INFO: `/v3/services` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:19.706366 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 472/926] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:39:19.706485 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3607c06a-e5a6-49ae-8298-05d88ebcfa76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:19.708027 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3607c06a-e5a6-49ae-8298-05d88ebcfa76 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:19.718537 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 455/927] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Aug 3 12:39:19 2022] GET /identity/v3/services => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:39:19.728088 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ef4b0-4c0e-499d-b257-2edd9643d577 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:19.768698 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:19.843337 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ef4b0-4c0e-499d-b257-2edd9643d577 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:19.880299 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274bf6b-09f0-4e36-a09f-3a32a2f93492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:19.880949 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274bf6b-09f0-4e36-a09f-3a32a2f93492 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:19.881233 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274bf6b-09f0-4e36-a09f-3a32a2f93492 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:19.881519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274bf6b-09f0-4e36-a09f-3a32a2f93492 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:19.882164 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274bf6b-09f0-4e36-a09f-3a32a2f93492 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:19.883531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274bf6b-09f0-4e36-a09f-3a32a2f93492 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:19.892786 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-d274bf6b-09f0-4e36-a09f-3a32a2f93492 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 03 12:39:19.892786 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:19.892786 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:39:19.892786 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:39:19.892786 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:39:19.892786 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:39:19.892786 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:39:19.892786 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:19.892786 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 03 12:39:19.892786 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:19.892786 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:39:19.892786 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:19.892786 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:19.892786 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:19.892786 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:19.892786 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:19.893726 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:19.893726 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:19.893726 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:19.893726 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:19.893726 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:19.893726 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:19.893726 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:19.893726 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:39:19.893726 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:39:19.893726 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:39:19.893726 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:39:19.893726 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:19.893726 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:19.893726 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:19.893726 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:19.893726 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:19.894550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:19.894550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:19.894550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:19.894550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:19.894550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:19.894550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:19.894550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:19.894550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:19.894550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:19.894550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:19.894550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:19.894550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:39:19.894550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:19.894550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 03 12:39:19.894550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:19.894550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 473/928] 10.222.0.46 () {56 vars in 1132 bytes} [Wed Aug 3 12:39:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:19.901362 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607c06a-e5a6-49ae-8298-05d88ebcfa76 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:20.005262 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607c06a-e5a6-49ae-8298-05d88ebcfa76 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:20.041514 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d63bb-5c7c-478d-9c09-41326c3ff303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:20.042139 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d63bb-5c7c-478d-9c09-41326c3ff303 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:20.042441 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d63bb-5c7c-478d-9c09-41326c3ff303 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:20.043246 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d63bb-5c7c-478d-9c09-41326c3ff303 None admin] PATH_INFO: `/v3/services` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:20.043935 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d63bb-5c7c-478d-9c09-41326c3ff303 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:20.044238 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d63bb-5c7c-478d-9c09-41326c3ff303 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:20.045668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d63bb-5c7c-478d-9c09-41326c3ff303 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:20.051159 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 456/929] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Aug 3 12:39:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:20.056857 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274bf6b-09f0-4e36-a09f-3a32a2f93492 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:20.158681 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:20.162618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274bf6b-09f0-4e36-a09f-3a32a2f93492 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:20.197732 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb64056-4386-4c25-ae32-479f1d12b7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:20.198354 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb64056-4386-4c25-ae32-479f1d12b7e1 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:20.199163 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb64056-4386-4c25-ae32-479f1d12b7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:20.199485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb64056-4386-4c25-ae32-479f1d12b7e1 None admin] PATH_INFO: `/v3/services` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:20.200267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb64056-4386-4c25-ae32-479f1d12b7e1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:20.200573 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb64056-4386-4c25-ae32-479f1d12b7e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:20.201970 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb64056-4386-4c25-ae32-479f1d12b7e1 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:20.207287 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 474/930] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Aug 3 12:39:20 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:20.212802 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d63bb-5c7c-478d-9c09-41326c3ff303 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:20.278147 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:20.319105 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d63bb-5c7c-478d-9c09-41326c3ff303 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:20.354947 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da94b9-369e-4c5a-83bc-c2d7acef40f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:20.356086 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da94b9-369e-4c5a-83bc-c2d7acef40f2 None admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:20.356366 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da94b9-369e-4c5a-83bc-c2d7acef40f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:20.356638 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da94b9-369e-4c5a-83bc-c2d7acef40f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:20.357337 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da94b9-369e-4c5a-83bc-c2d7acef40f2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:20.358726 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da94b9-369e-4c5a-83bc-c2d7acef40f2 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:20.383811 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 457/931] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:39:20 2022] POST /identity/v3/endpoints => generated 347 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:39:20.674835 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9828227-38be-4a70-8405-c716c9270a39 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:20.675359 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9828227-38be-4a70-8405-c716c9270a39 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:20.675435 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9828227-38be-4a70-8405-c716c9270a39 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:20.677028 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 475/932] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:20.682581 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be6113-b0d0-4b0c-8a20-777540c63380 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:20.682870 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be6113-b0d0-4b0c-8a20-777540c63380 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:20.683704 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be6113-b0d0-4b0c-8a20-777540c63380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:20.703308 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-c6be6113-b0d0-4b0c-8a20-777540c63380 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:20.704522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-c6be6113-b0d0-4b0c-8a20-777540c63380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:20.782402 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 458/933] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:39:20.805083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9828227-38be-4a70-8405-c716c9270a39 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:20.916383 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9828227-38be-4a70-8405-c716c9270a39 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:20.930416 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3008ff6-4ebc-4f06-9bda-79719f49f1ab None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:20.930686 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3008ff6-4ebc-4f06-9bda-79719f49f1ab None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:20.930896 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3008ff6-4ebc-4f06-9bda-79719f49f1ab None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:20.933904 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 459/934] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:20.940805 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f1708-8a9b-424a-855e-b19c4b8dc99c None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:20.941111 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f1708-8a9b-424a-855e-b19c4b8dc99c None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:20.941392 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f1708-8a9b-424a-855e-b19c4b8dc99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:20.957244 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5104613-d3a6-4481-9f51-487c6715639b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:20.957962 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5104613-d3a6-4481-9f51-487c6715639b None admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:20.958251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5104613-d3a6-4481-9f51-487c6715639b None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:20.958528 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5104613-d3a6-4481-9f51-487c6715639b None admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:20.959270 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5104613-d3a6-4481-9f51-487c6715639b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:20.960266 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-714f1708-8a9b-424a-855e-b19c4b8dc99c None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:20.960925 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5104613-d3a6-4481-9f51-487c6715639b None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:20.961463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-714f1708-8a9b-424a-855e-b19c4b8dc99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:20.963752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: WARNING keystone.server.flask.common [None req-f5104613-d3a6-4481-9f51-487c6715639b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 03 12:39:20.983027 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:20.986543 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.sql.core [None req-f5104613-d3a6-4481-9f51-487c6715639b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 03 12:39:20.986543 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 03 12:39:20.986543 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [parameters: {'id': '0531d08808314a7b934481bfa7501842', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 03 12:39:20.986543 dv-cinder-850836-4-smb devstack@keystone.service[91789]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91789) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 03 12:39:21.008579 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-f5104613-d3a6-4481-9f51-487c6715639b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0531d08808314a7b934481bfa7501842.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0531d08808314a7b934481bfa7501842. Aug 03 12:39:21.008579 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:21.008579 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 03 12:39:21.008579 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 03 12:39:21.008579 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 03 12:39:21.008579 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 03 12:39:21.008579 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 03 12:39:21.008579 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application result = self._query(query) Aug 03 12:39:21.008579 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 03 12:39:21.008579 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application conn.query(q) Aug 03 12:39:21.008579 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 03 12:39:21.008579 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 03 12:39:21.008579 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 03 12:39:21.009485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application result.read() Aug 03 12:39:21.009485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 03 12:39:21.009485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 03 12:39:21.009485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 03 12:39:21.009485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 03 12:39:21.009485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 03 12:39:21.009485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 03 12:39:21.009485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 03 12:39:21.009485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 03 12:39:21.009485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 03 12:39:21.009485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:21.009485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 03 12:39:21.009485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:21.009485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:21.009485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 03 12:39:21.009485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 03 12:39:21.009485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 03 12:39:21.009485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 03 12:39:21.010463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 03 12:39:21.010463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application next(self.gen) Aug 03 12:39:21.010463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 03 12:39:21.010463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application yield resource Aug 03 12:39:21.010463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 03 12:39:21.010463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application next(self.gen) Aug 03 12:39:21.010463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 03 12:39:21.010463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application self.session.rollback() Aug 03 12:39:21.010463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 12:39:21.010463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application self.force_reraise() Aug 03 12:39:21.010463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 12:39:21.010463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise self.value Aug 03 12:39:21.010463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 03 12:39:21.010463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 03 12:39:21.010463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 03 12:39:21.010463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application session.commit() Aug 03 12:39:21.010463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 03 12:39:21.011473 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 03 12:39:21.011473 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 03 12:39:21.011473 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application self._prepare_impl() Aug 03 12:39:21.011473 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 03 12:39:21.011473 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application self.session.flush() Aug 03 12:39:21.011473 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 03 12:39:21.011473 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application self._flush(objects) Aug 03 12:39:21.011473 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 03 12:39:21.011473 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 03 12:39:21.011473 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 03 12:39:21.011473 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application compat.raise_( Aug 03 12:39:21.011473 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 03 12:39:21.011473 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception Aug 03 12:39:21.011473 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 03 12:39:21.011473 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application flush_context.execute() Aug 03 12:39:21.011473 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 03 12:39:21.011473 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rec.execute(self) Aug 03 12:39:21.013289 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 03 12:39:21.013289 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 03 12:39:21.013289 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 03 12:39:21.013289 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 03 12:39:21.013289 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 03 12:39:21.013289 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 03 12:39:21.013289 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 03 12:39:21.013289 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 03 12:39:21.013289 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 03 12:39:21.013289 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 03 12:39:21.013289 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 03 12:39:21.013289 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 03 12:39:21.013289 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 03 12:39:21.013289 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 03 12:39:21.013289 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 03 12:39:21.015330 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 03 12:39:21.015330 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 03 12:39:21.015330 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception Aug 03 12:39:21.015330 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 03 12:39:21.015330 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 03 12:39:21.015330 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 03 12:39:21.015330 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 03 12:39:21.015330 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 03 12:39:21.015330 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application result = self._query(query) Aug 03 12:39:21.015330 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 03 12:39:21.015330 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application conn.query(q) Aug 03 12:39:21.015330 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 03 12:39:21.015330 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 03 12:39:21.015330 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 03 12:39:21.015330 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application result.read() Aug 03 12:39:21.015330 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 03 12:39:21.015330 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 03 12:39:21.017178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 03 12:39:21.017178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 03 12:39:21.017178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 03 12:39:21.017178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 03 12:39:21.017178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 03 12:39:21.017178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 03 12:39:21.017178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 03 12:39:21.017178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 03 12:39:21.017178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [parameters: {'id': '0531d08808314a7b934481bfa7501842', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 03 12:39:21.017178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 03 12:39:21.017178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:21.017178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:39:21.017178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:21.017178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:21.017178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 03 12:39:21.018889 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 03 12:39:21.018889 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 03 12:39:21.018889 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 03 12:39:21.018889 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 03 12:39:21.018889 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:21.018889 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:39:21.018889 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:21.018889 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:21.018889 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:21.018889 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:21.018889 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:21.018889 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:21.018889 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:21.018889 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:21.018889 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:21.018889 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:21.018889 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:21.022379 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:21.022379 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 03 12:39:21.022379 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 03 12:39:21.022379 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:21.022379 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:21.022379 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 03 12:39:21.022379 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 03 12:39:21.022379 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0531d08808314a7b934481bfa7501842. Aug 03 12:39:21.022379 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:21.022379 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 476/935] 10.222.0.46 () {60 vars in 1140 bytes} [Wed Aug 3 12:39:20 2022] POST /identity/v3/projects => generated 262 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:21.022379 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5104613-d3a6-4481-9f51-487c6715639b None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:21.061776 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 460/936] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:39:21.069968 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:21.080621 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f1708-8a9b-424a-855e-b19c4b8dc99c None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:21.157514 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5104613-d3a6-4481-9f51-487c6715639b None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:21.196587 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f1708-8a9b-424a-855e-b19c4b8dc99c None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:21.203050 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47e99c-dacd-440c-adbb-84da789b6cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:21.203715 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47e99c-dacd-440c-adbb-84da789b6cda None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:21.204000 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47e99c-dacd-440c-adbb-84da789b6cda None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:21.204276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47e99c-dacd-440c-adbb-84da789b6cda None admin] PATH_INFO: `/v3/projects/service` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:21.212303 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47e99c-dacd-440c-adbb-84da789b6cda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:21.213983 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47e99c-dacd-440c-adbb-84da789b6cda None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:21.231185 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-3c47e99c-dacd-440c-adbb-84da789b6cda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:39:21.231185 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:21.231185 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:21.231185 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:21.231185 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:21.231185 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:21.231185 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:21.231185 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:21.231185 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:21.231185 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:21.231185 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:21.231185 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:21.231185 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:39:21.231185 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:39:21.231185 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:39:21.232178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:39:21.232178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:21.232178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:21.232178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:21.232178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:21.232178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:21.232178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:21.232178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:21.232178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:21.232178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:21.232178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:21.232178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:21.232178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:21.232178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:21.232178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:21.232178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:21.232178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:21.233115 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:39:21.233115 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:39:21.233115 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:39:21.233115 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:39:21.233115 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:39:21.233115 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:39:21.233115 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:39:21.233115 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:21.237468 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 477/937] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:39:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:21.238478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47e99c-dacd-440c-adbb-84da789b6cda None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:21.250087 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a9e5c-8e2e-4925-b8ec-7c22347cde29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:21.251083 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a9e5c-8e2e-4925-b8ec-7c22347cde29 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:21.251580 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a9e5c-8e2e-4925-b8ec-7c22347cde29 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:21.252116 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a9e5c-8e2e-4925-b8ec-7c22347cde29 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:21.264063 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a9e5c-8e2e-4925-b8ec-7c22347cde29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:39:21.270279 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-874a9e5c-8e2e-4925-b8ec-7c22347cde29 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 12:39:21.270279 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:21.270279 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:21.270279 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:21.270279 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:21.270279 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:21.270279 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:21.270279 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:21.270279 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:21.270279 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:21.270279 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:21.270279 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:21.270279 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:39:21.270279 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:39:21.270279 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:39:21.270279 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:39:21.271231 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:39:21.271231 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:39:21.271231 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:39:21.271231 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:39:21.271231 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:21.271231 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:21.271231 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:21.271231 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:21.271231 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:21.271231 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:21.271231 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:21.271231 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:21.271231 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:21.271231 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:21.271231 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:21.271231 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:21.272089 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:21.272089 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:21.272089 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:21.272089 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:21.272089 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:39:21.272089 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:39:21.272089 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:39:21.272089 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:39:21.272089 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:39:21.272089 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:39:21.272089 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 12:39:21.272089 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:21.280196 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 461/938] 10.222.0.46 () {56 vars in 1120 bytes} [Wed Aug 3 12:39:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:21.282217 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a9e5c-8e2e-4925-b8ec-7c22347cde29 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:21.303677 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:21.345181 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:21.376855 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47e99c-dacd-440c-adbb-84da789b6cda None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:21.403255 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a9e5c-8e2e-4925-b8ec-7c22347cde29 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:21.423990 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d31deb-cb6f-4fa6-9ace-32d2ee785c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:21.424621 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d31deb-cb6f-4fa6-9ace-32d2ee785c70 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:21.424907 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d31deb-cb6f-4fa6-9ace-32d2ee785c70 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:21.425183 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d31deb-cb6f-4fa6-9ace-32d2ee785c70 None admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:21.425936 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d31deb-cb6f-4fa6-9ace-32d2ee785c70 None admin] RBAC: Adding query filter params (name=service) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:21.426242 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d31deb-cb6f-4fa6-9ace-32d2ee785c70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:21.428297 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d31deb-cb6f-4fa6-9ace-32d2ee785c70 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:21.442517 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff3328-84e3-428a-9bbb-53d2b671f329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:21.443463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff3328-84e3-428a-9bbb-53d2b671f329 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:21.443958 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff3328-84e3-428a-9bbb-53d2b671f329 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:21.444436 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff3328-84e3-428a-9bbb-53d2b671f329 None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:21.445352 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff3328-84e3-428a-9bbb-53d2b671f329 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:21.445896 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff3328-84e3-428a-9bbb-53d2b671f329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:21.447629 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff3328-84e3-428a-9bbb-53d2b671f329 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:21.454052 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 478/939] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Aug 3 12:39:21 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:21.469925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 462/940] 10.222.0.46 () {56 vars in 1115 bytes} [Wed Aug 3 12:39:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:21.471353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d31deb-cb6f-4fa6-9ace-32d2ee785c70 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:21.595916 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d31deb-cb6f-4fa6-9ace-32d2ee785c70 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:21.638681 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af99b8-b817-4b18-a43b-79f37b9676e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:21.639351 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af99b8-b817-4b18-a43b-79f37b9676e1 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:21.639623 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af99b8-b817-4b18-a43b-79f37b9676e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:21.639900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af99b8-b817-4b18-a43b-79f37b9676e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:21.647291 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:21.651158 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af99b8-b817-4b18-a43b-79f37b9676e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:21.653323 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af99b8-b817-4b18-a43b-79f37b9676e1 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:21.670991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-53af99b8-b817-4b18-a43b-79f37b9676e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:21.670991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:21.670991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:21.670991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:21.670991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:21.670991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:21.670991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:21.670991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:21.670991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:21.670991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:21.670991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:21.670991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:21.670991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:39:21.670991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:39:21.670991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:39:21.671958 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:39:21.671958 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:21.671958 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:21.671958 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:21.671958 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:21.671958 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:21.671958 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:21.671958 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:21.671958 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:21.671958 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:21.671958 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:21.671958 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:21.671958 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:21.671958 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:21.671958 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:21.671958 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:21.671958 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:21.672865 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:39:21.672865 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:39:21.672865 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:21.672865 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:21.672865 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 479/941] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:21.679075 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff3328-84e3-428a-9bbb-53d2b671f329 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:21.765404 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:21.789447 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff3328-84e3-428a-9bbb-53d2b671f329 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:21.814835 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ba25a-4980-4d63-8318-0700ab23403c None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:21.815370 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ba25a-4980-4d63-8318-0700ab23403c None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:21.815631 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ba25a-4980-4d63-8318-0700ab23403c None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:21.820986 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 480/942] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:21.822648 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39bc78-51c6-42de-9452-9eee79b1076a None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:21.822947 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39bc78-51c6-42de-9452-9eee79b1076a None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:21.823230 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39bc78-51c6-42de-9452-9eee79b1076a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:21.826738 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70c01d-d4cc-4ca2-9855-acfa44371c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:21.826738 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70c01d-d4cc-4ca2-9855-acfa44371c51 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:21.826983 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70c01d-d4cc-4ca2-9855-acfa44371c51 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:21.827054 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70c01d-d4cc-4ca2-9855-acfa44371c51 None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:21.827862 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70c01d-d4cc-4ca2-9855-acfa44371c51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:21.828233 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70c01d-d4cc-4ca2-9855-acfa44371c51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:21.829675 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70c01d-d4cc-4ca2-9855-acfa44371c51 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:21.842797 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 463/943] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:21.843434 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-0a39bc78-51c6-42de-9452-9eee79b1076a None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:21.844961 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-0a39bc78-51c6-42de-9452-9eee79b1076a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:21.848097 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70c01d-d4cc-4ca2-9855-acfa44371c51 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:21.942901 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 481/944] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:39:21.966297 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39bc78-51c6-42de-9452-9eee79b1076a None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:21.967178 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70c01d-d4cc-4ca2-9855-acfa44371c51 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:22.004632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b318828-c0a9-4830-9db0-4586ab0465f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:22.005579 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b318828-c0a9-4830-9db0-4586ab0465f0 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:22.006035 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b318828-c0a9-4830-9db0-4586ab0465f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:22.006510 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b318828-c0a9-4830-9db0-4586ab0465f0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:22.014479 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b318828-c0a9-4830-9db0-4586ab0465f0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:22.016204 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b318828-c0a9-4830-9db0-4586ab0465f0 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:22.018231 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:22.029951 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-9b318828-c0a9-4830-9db0-4586ab0465f0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 12:39:22.029951 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:22.029951 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:22.029951 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:22.029951 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:22.029951 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:22.029951 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:22.029951 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:22.029951 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:22.029951 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:22.029951 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:22.029951 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:22.029951 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:39:22.029951 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:39:22.029951 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:39:22.029951 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:39:22.031171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:22.031171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:22.031171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:39:22.031171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:39:22.031171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:39:22.031171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:39:22.031171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:22.031171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:22.031171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:22.031171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:22.031171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:22.031171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:22.031171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:22.031171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:22.031171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:22.031171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:22.031171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:22.031171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:22.032324 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:22.032324 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:22.032324 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:39:22.032324 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:39:22.032324 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:39:22.032324 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:39:22.032324 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:39:22.032324 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:39:22.032324 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 12:39:22.032324 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:22.034606 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 464/945] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Aug 3 12:39:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:22.040174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b318828-c0a9-4830-9db0-4586ab0465f0 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:22.092258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39bc78-51c6-42de-9452-9eee79b1076a None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:22.114993 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:22.131445 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704ff62-492e-45fe-92e9-dd66b582cb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:22.132186 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704ff62-492e-45fe-92e9-dd66b582cb39 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:22.132537 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704ff62-492e-45fe-92e9-dd66b582cb39 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:22.132881 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704ff62-492e-45fe-92e9-dd66b582cb39 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:22.133628 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704ff62-492e-45fe-92e9-dd66b582cb39 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:22.135084 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704ff62-492e-45fe-92e9-dd66b582cb39 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:22.145469 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-b704ff62-492e-45fe-92e9-dd66b582cb39 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:39:22.145469 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:22.145469 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:39:22.145469 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:39:22.145469 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:39:22.145469 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:39:22.145469 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:39:22.145469 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:22.145469 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:39:22.145469 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:22.145469 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:39:22.145469 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:22.145469 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:22.145469 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:22.145469 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:22.145469 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:22.145469 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:22.146559 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:22.146559 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:22.146559 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:22.146559 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:22.146559 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:22.146559 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:22.146559 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:39:22.146559 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:39:22.146559 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:39:22.146559 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:39:22.146559 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:22.146559 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:22.146559 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:22.146559 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:22.146559 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:22.146559 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:22.147392 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:22.147392 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:22.147392 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:22.147392 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:22.147392 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:22.147392 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:22.147392 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:22.147392 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:22.147392 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:22.147392 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:22.147392 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:39:22.147392 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:22.147392 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:39:22.147392 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:22.147392 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 482/946] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Aug 3 12:39:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:22.153720 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704ff62-492e-45fe-92e9-dd66b582cb39 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:22.169273 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b318828-c0a9-4830-9db0-4586ab0465f0 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:22.205131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea1509-d44b-4f96-958d-3598ecc88aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:22.205865 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea1509-d44b-4f96-958d-3598ecc88aeb None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:22.206208 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea1509-d44b-4f96-958d-3598ecc88aeb None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:22.206553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea1509-d44b-4f96-958d-3598ecc88aeb None admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:22.207413 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea1509-d44b-4f96-958d-3598ecc88aeb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:22.207804 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea1509-d44b-4f96-958d-3598ecc88aeb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:22.209356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea1509-d44b-4f96-958d-3598ecc88aeb None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:22.233845 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 465/947] 10.222.0.46 () {56 vars in 1149 bytes} [Wed Aug 3 12:39:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:22.235111 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea1509-d44b-4f96-958d-3598ecc88aeb None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:22.268643 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704ff62-492e-45fe-92e9-dd66b582cb39 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:22.297936 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:22.307864 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d1e76-0275-4416-9ab4-ac15822a6da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:22.308915 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d1e76-0275-4416-9ab4-ac15822a6da0 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:22.309414 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d1e76-0275-4416-9ab4-ac15822a6da0 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:22.309967 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d1e76-0275-4416-9ab4-ac15822a6da0 None admin] PATH_INFO: `/v3/services` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:22.310866 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d1e76-0275-4416-9ab4-ac15822a6da0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:22.311413 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d1e76-0275-4416-9ab4-ac15822a6da0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:22.313041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d1e76-0275-4416-9ab4-ac15822a6da0 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:22.319040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 483/948] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Aug 3 12:39:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:22.324598 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d1e76-0275-4416-9ab4-ac15822a6da0 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:22.356732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea1509-d44b-4f96-958d-3598ecc88aeb None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:22.384570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:22.399262 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9515d-7645-42fd-bff9-fd1e1f5d15dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:22.400441 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9515d-7645-42fd-bff9-fd1e1f5d15dc None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:22.400939 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9515d-7645-42fd-bff9-fd1e1f5d15dc None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:22.401428 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9515d-7645-42fd-bff9-fd1e1f5d15dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:22.413336 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d9515d-7645-42fd-bff9-fd1e1f5d15dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:22.415167 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d9515d-7645-42fd-bff9-fd1e1f5d15dc None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:22.433542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-a3d9515d-7645-42fd-bff9-fd1e1f5d15dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:22.433542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:22.433542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:22.433542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:22.433542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:22.433542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:22.433542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:22.433542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:22.433542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:22.433542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:22.433542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:22.433542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:22.433542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:39:22.433542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:39:22.433542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:39:22.434669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:39:22.434669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:22.434669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:22.434669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:22.434669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:22.434669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:22.434669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:22.434669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:22.434669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:22.434669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:22.434669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:22.434669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:22.434669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:22.434669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:22.434669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:22.434669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:22.434669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:22.435590 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:39:22.435590 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:39:22.435590 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:22.435590 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:22.438394 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 466/949] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:39:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:22.443677 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9515d-7645-42fd-bff9-fd1e1f5d15dc None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:22.452216 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d1e76-0275-4416-9ab4-ac15822a6da0 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:22.491964 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f039f79-65a2-4ec4-89f9-7236a99457a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:22.492740 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f039f79-65a2-4ec4-89f9-7236a99457a0 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:22.493029 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f039f79-65a2-4ec4-89f9-7236a99457a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:22.493699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f039f79-65a2-4ec4-89f9-7236a99457a0 None admin] PATH_INFO: `/v3/services` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:22.494665 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f039f79-65a2-4ec4-89f9-7236a99457a0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:22.494976 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f039f79-65a2-4ec4-89f9-7236a99457a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:22.496538 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f039f79-65a2-4ec4-89f9-7236a99457a0 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:22.507611 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 484/950] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Aug 3 12:39:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:22.507611 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf67e6-fbce-4b5b-9288-567935ef4f65 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:22.507611 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf67e6-fbce-4b5b-9288-567935ef4f65 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:22.507611 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf67e6-fbce-4b5b-9288-567935ef4f65 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:22.507611 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 485/951] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:22.509163 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf67e6-fbce-4b5b-9288-567935ef4f65 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:22.551053 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9515d-7645-42fd-bff9-fd1e1f5d15dc None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:22.559948 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:22.592710 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16b07c-f589-4ae5-9958-8d4c59d0c578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:22.593330 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16b07c-f589-4ae5-9958-8d4c59d0c578 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:22.593642 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16b07c-f589-4ae5-9958-8d4c59d0c578 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:22.593921 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16b07c-f589-4ae5-9958-8d4c59d0c578 None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:22.595162 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c16b07c-f589-4ae5-9958-8d4c59d0c578 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:22.595475 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c16b07c-f589-4ae5-9958-8d4c59d0c578 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:22.597335 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c16b07c-f589-4ae5-9958-8d4c59d0c578 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:22.612929 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 467/952] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:22.614212 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369e6d3-3efd-4026-9d2a-6202ee9a6ecf None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:22.614530 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369e6d3-3efd-4026-9d2a-6202ee9a6ecf None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:22.614808 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369e6d3-3efd-4026-9d2a-6202ee9a6ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:22.627080 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf67e6-fbce-4b5b-9288-567935ef4f65 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:22.633171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-e369e6d3-3efd-4026-9d2a-6202ee9a6ecf None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:22.634409 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-e369e6d3-3efd-4026-9d2a-6202ee9a6ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:22.642206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:22.666434 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047277bf-de93-4cef-8a71-dfd4489e5094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:22.667051 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047277bf-de93-4cef-8a71-dfd4489e5094 None admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:22.667346 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047277bf-de93-4cef-8a71-dfd4489e5094 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:22.667798 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047277bf-de93-4cef-8a71-dfd4489e5094 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:22.668629 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047277bf-de93-4cef-8a71-dfd4489e5094 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:22.670024 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047277bf-de93-4cef-8a71-dfd4489e5094 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:22.691257 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 486/953] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:39:22 2022] POST /identity/v3/endpoints => generated 349 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:39:22.700073 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047277bf-de93-4cef-8a71-dfd4489e5094 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:22.715722 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 468/954] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:39:22.737955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369e6d3-3efd-4026-9d2a-6202ee9a6ecf None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:22.847113 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047277bf-de93-4cef-8a71-dfd4489e5094 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:22.861603 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:22.869065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369e6d3-3efd-4026-9d2a-6202ee9a6ecf None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:22.893810 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df11477-da16-49dd-88f1-3f903e829e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:22.894566 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df11477-da16-49dd-88f1-3f903e829e67 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:22.894849 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df11477-da16-49dd-88f1-3f903e829e67 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:22.895126 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df11477-da16-49dd-88f1-3f903e829e67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:22.902987 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df11477-da16-49dd-88f1-3f903e829e67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:22.904438 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df11477-da16-49dd-88f1-3f903e829e67 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:22.916011 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c632822-ad53-48d7-bf58-462312c9b358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:22.916647 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c632822-ad53-48d7-bf58-462312c9b358 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:22.916933 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c632822-ad53-48d7-bf58-462312c9b358 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:22.917107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-9df11477-da16-49dd-88f1-3f903e829e67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:39:22.917107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:22.917107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:22.917107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:22.917107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:22.917107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:22.917107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:22.917107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:22.917107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:22.917107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:22.917107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:22.917107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:22.917107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:39:22.917107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:39:22.917107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:39:22.918838 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:39:22.918838 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:22.918838 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:22.918838 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:22.918838 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:22.918838 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:22.918838 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:22.918838 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:22.918838 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:22.918838 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:22.918838 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:22.918838 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:22.918838 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:22.918838 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:22.918838 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:22.918838 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:22.918838 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:22.920406 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:39:22.920406 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:39:22.920406 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:39:22.920406 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:39:22.920406 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:39:22.920406 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:39:22.920406 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:39:22.920406 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:22.920914 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c632822-ad53-48d7-bf58-462312c9b358 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:22.920914 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c632822-ad53-48d7-bf58-462312c9b358 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:22.921082 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 487/955] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:39:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:22.921168 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c632822-ad53-48d7-bf58-462312c9b358 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:22.924800 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df11477-da16-49dd-88f1-3f903e829e67 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:22.932698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-7c632822-ad53-48d7-bf58-462312c9b358 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 03 12:39:22.932698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:22.932698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:39:22.932698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:39:22.932698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:39:22.932698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:39:22.932698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:39:22.932698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:22.932698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 03 12:39:22.932698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:22.932698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:39:22.932698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:22.932698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:22.932698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:22.932698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:22.932698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:22.932698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:22.934698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:22.934698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:22.934698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:22.934698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:22.934698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:22.934698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:22.934698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:39:22.934698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:39:22.934698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:39:22.934698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:39:22.934698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:22.934698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:22.934698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:22.934698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:22.934698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:22.934698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:22.935588 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:22.935588 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:22.935588 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:22.935588 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:22.935588 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:22.935588 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:22.935588 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:22.935588 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:22.935588 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:22.935588 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:22.935588 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:39:22.935588 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:22.935588 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 03 12:39:22.935588 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:22.935588 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 469/956] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:39:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:22.941455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c632822-ad53-48d7-bf58-462312c9b358 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:22.969776 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:23.046481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df11477-da16-49dd-88f1-3f903e829e67 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:23.060692 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c632822-ad53-48d7-bf58-462312c9b358 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:23.081316 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03944086-078d-4519-807e-f5eff814ff50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:23.081968 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03944086-078d-4519-807e-f5eff814ff50 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:23.082247 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03944086-078d-4519-807e-f5eff814ff50 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:23.082520 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03944086-078d-4519-807e-f5eff814ff50 None admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:23.083570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03944086-078d-4519-807e-f5eff814ff50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:23.083570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03944086-078d-4519-807e-f5eff814ff50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:23.085048 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03944086-078d-4519-807e-f5eff814ff50 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:23.098858 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 488/957] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 3 12:39:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:23.099917 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a0b24-943d-4032-a92e-ed9a2cc364f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:23.100538 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a0b24-943d-4032-a92e-ed9a2cc364f2 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:23.100991 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a0b24-943d-4032-a92e-ed9a2cc364f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:23.101277 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a0b24-943d-4032-a92e-ed9a2cc364f2 None admin] PATH_INFO: `/v3/services` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:23.102056 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a0b24-943d-4032-a92e-ed9a2cc364f2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:23.102370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a0b24-943d-4032-a92e-ed9a2cc364f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:23.103960 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a0b24-943d-4032-a92e-ed9a2cc364f2 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:23.104331 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03944086-078d-4519-807e-f5eff814ff50 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:23.113613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 470/958] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Aug 3 12:39:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:23.116392 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a0b24-943d-4032-a92e-ed9a2cc364f2 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:23.143066 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:23.205965 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:23.214067 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03944086-078d-4519-807e-f5eff814ff50 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:23.227950 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a0b24-943d-4032-a92e-ed9a2cc364f2 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:23.253304 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b045972-daf2-40cf-8c3a-cf7b965ffb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:23.254270 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b045972-daf2-40cf-8c3a-cf7b965ffb9e None admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:23.254706 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b045972-daf2-40cf-8c3a-cf7b965ffb9e None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:23.255213 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b045972-daf2-40cf-8c3a-cf7b965ffb9e None admin] PATH_INFO: `/v3/projects/6ac833dfff634496816842c851545d21/users/a994c976b95744ed9723bf9c4386bde1/roles/a7ac56aa0b134a9e925725f41c54d4b3` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:23.257752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b045972-daf2-40cf-8c3a-cf7b965ffb9e None admin] RBAC: Authorizing `identity:create_grant(project_id=6ac833dfff634496816842c851545d21, user_id=a994c976b95744ed9723bf9c4386bde1, role_id=a7ac56aa0b134a9e925725f41c54d4b3)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:23.259352 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b045972-daf2-40cf-8c3a-cf7b965ffb9e None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:23.265374 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94f47e-ea3a-4fd5-b6bf-cea5809c98a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:23.266182 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94f47e-ea3a-4fd5-b6bf-cea5809c98a7 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:23.266369 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94f47e-ea3a-4fd5-b6bf-cea5809c98a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:23.266648 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94f47e-ea3a-4fd5-b6bf-cea5809c98a7 None admin] PATH_INFO: `/v3/services` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:23.267397 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf94f47e-ea3a-4fd5-b6bf-cea5809c98a7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:23.267705 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf94f47e-ea3a-4fd5-b6bf-cea5809c98a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:23.269137 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf94f47e-ea3a-4fd5-b6bf-cea5809c98a7 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:23.281700 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 471/959] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Aug 3 12:39:23 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:23.288531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 489/960] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 3 12:39:23 2022] PUT /identity/v3/projects/6ac833dfff634496816842c851545d21/users/a994c976b95744ed9723bf9c4386bde1/roles/a7ac56aa0b134a9e925725f41c54d4b3 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:39:23.707143 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf2590-d0b4-468b-b59c-30c94478a0a0 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:23.708110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf2590-d0b4-468b-b59c-30c94478a0a0 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:23.708610 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf2590-d0b4-468b-b59c-30c94478a0a0 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:23.710495 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 472/961] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:23.716691 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2aa971-4538-44cd-960b-ed99d083ce69 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:23.717223 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2aa971-4538-44cd-960b-ed99d083ce69 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:23.717729 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2aa971-4538-44cd-960b-ed99d083ce69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:23.737438 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-7a2aa971-4538-44cd-960b-ed99d083ce69 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:23.738966 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-7a2aa971-4538-44cd-960b-ed99d083ce69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:23.811659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 490/962] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:39:23.836920 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf2590-d0b4-468b-b59c-30c94478a0a0 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:23.931340 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:23.951459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf2590-d0b4-468b-b59c-30c94478a0a0 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:23.990990 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5506a-363f-49a8-94a1-88186d5174a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:23.991532 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5506a-363f-49a8-94a1-88186d5174a0 None admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:23.991814 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5506a-363f-49a8-94a1-88186d5174a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:23.992089 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5506a-363f-49a8-94a1-88186d5174a0 None admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:23.992778 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5506a-363f-49a8-94a1-88186d5174a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:23.994249 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5506a-363f-49a8-94a1-88186d5174a0 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:23.997526 dv-cinder-850836-4-smb devstack@keystone.service[91788]: WARNING keystone.server.flask.common [None req-b4d5506a-363f-49a8-94a1-88186d5174a0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 03 12:39:24.014333 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.sql.core [None req-b4d5506a-363f-49a8-94a1-88186d5174a0 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 03 12:39:24.014333 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 03 12:39:24.014333 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [parameters: {'user_id': '7bfef66dc28d4f9b9cc3cd0d6aca35bd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 03 12:39:24.014333 dv-cinder-850836-4-smb devstack@keystone.service[91788]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91788) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 03 12:39:24.021307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-b4d5506a-363f-49a8-94a1-88186d5174a0 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 03 12:39:24.021307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:24.021307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 03 12:39:24.021307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 03 12:39:24.021307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 03 12:39:24.021307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 03 12:39:24.021307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 03 12:39:24.021307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application result = self._query(query) Aug 03 12:39:24.021307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 03 12:39:24.021307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application conn.query(q) Aug 03 12:39:24.021307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 03 12:39:24.021307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 03 12:39:24.021307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 03 12:39:24.021307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application result.read() Aug 03 12:39:24.021307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 03 12:39:24.022206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 03 12:39:24.022206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 03 12:39:24.022206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 03 12:39:24.022206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 03 12:39:24.022206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 03 12:39:24.022206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 03 12:39:24.022206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 03 12:39:24.022206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 03 12:39:24.022206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:24.022206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 03 12:39:24.022206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:24.022206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:24.022206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 03 12:39:24.022206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 03 12:39:24.022206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 03 12:39:24.022206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 03 12:39:24.022206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 03 12:39:24.022206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application next(self.gen) Aug 03 12:39:24.023218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 03 12:39:24.023218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application yield resource Aug 03 12:39:24.023218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 03 12:39:24.023218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application next(self.gen) Aug 03 12:39:24.023218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 03 12:39:24.023218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self.session.rollback() Aug 03 12:39:24.023218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 03 12:39:24.023218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self.force_reraise() Aug 03 12:39:24.023218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 03 12:39:24.023218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise self.value Aug 03 12:39:24.023218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 03 12:39:24.023218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 03 12:39:24.023218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 03 12:39:24.023218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application session.commit() Aug 03 12:39:24.023218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 03 12:39:24.023218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 03 12:39:24.023218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 03 12:39:24.024625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self._prepare_impl() Aug 03 12:39:24.024625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 03 12:39:24.024625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self.session.flush() Aug 03 12:39:24.024625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 03 12:39:24.024625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self._flush(objects) Aug 03 12:39:24.024625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 03 12:39:24.024625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 03 12:39:24.024625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 03 12:39:24.024625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application compat.raise_( Aug 03 12:39:24.024625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 03 12:39:24.024625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception Aug 03 12:39:24.024625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 03 12:39:24.024625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application flush_context.execute() Aug 03 12:39:24.024625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 03 12:39:24.024625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rec.execute(self) Aug 03 12:39:24.024625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 03 12:39:24.024625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 03 12:39:24.025568 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 03 12:39:24.025568 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 03 12:39:24.025568 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 03 12:39:24.025568 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 03 12:39:24.025568 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 03 12:39:24.025568 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 03 12:39:24.025568 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 03 12:39:24.025568 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 03 12:39:24.025568 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 03 12:39:24.025568 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 03 12:39:24.025568 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 03 12:39:24.025568 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 03 12:39:24.025568 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 03 12:39:24.025568 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 03 12:39:24.025568 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 03 12:39:24.025568 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception Aug 03 12:39:24.027871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 03 12:39:24.027871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 03 12:39:24.027871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 03 12:39:24.027871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 03 12:39:24.027871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 03 12:39:24.027871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application result = self._query(query) Aug 03 12:39:24.027871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 03 12:39:24.027871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application conn.query(q) Aug 03 12:39:24.027871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 03 12:39:24.027871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 03 12:39:24.027871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 03 12:39:24.027871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application result.read() Aug 03 12:39:24.027871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 03 12:39:24.027871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 03 12:39:24.027871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 03 12:39:24.027871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 03 12:39:24.029901 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 03 12:39:24.029901 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 03 12:39:24.029901 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 03 12:39:24.029901 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 03 12:39:24.029901 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 03 12:39:24.029901 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 03 12:39:24.029901 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [parameters: {'user_id': '7bfef66dc28d4f9b9cc3cd0d6aca35bd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 03 12:39:24.029901 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 03 12:39:24.029901 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:24.029901 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:39:24.029901 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:24.029901 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:24.029901 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:24.029901 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:24.029901 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:24.031791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:24.031791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:24.031791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:24.031791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:24.031791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:24.031791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:24.031791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:24.031791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 03 12:39:24.031791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 03 12:39:24.031791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:24.031791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:24.031791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:39:24.031791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:39:24.031791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:39:24.031791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:39:24.031791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 03 12:39:24.031791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 03 12:39:24.037735 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 03 12:39:24.037735 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 03 12:39:24.037735 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 03 12:39:24.037735 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 03 12:39:24.037735 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 03 12:39:24.037735 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:24.037735 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 473/963] 10.222.0.46 () {60 vars in 1131 bytes} [Wed Aug 3 12:39:23 2022] POST /identity/v3/users => generated 160 bytes in 186 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:39:24.041573 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2aa971-4538-44cd-960b-ed99d083ce69 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:24.126269 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:24.148618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2aa971-4538-44cd-960b-ed99d083ce69 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:24.182965 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fe62c-a36f-4b88-a03f-caa199f10994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:24.184298 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fe62c-a36f-4b88-a03f-caa199f10994 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:24.184577 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fe62c-a36f-4b88-a03f-caa199f10994 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:24.184847 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fe62c-a36f-4b88-a03f-caa199f10994 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:24.191941 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fe62c-a36f-4b88-a03f-caa199f10994 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:24.193380 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fe62c-a36f-4b88-a03f-caa199f10994 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:24.205284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-078fe62c-a36f-4b88-a03f-caa199f10994 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 03 12:39:24.205284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:24.205284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:24.205284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:24.205284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:24.205284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:24.205284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:24.205284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:24.205284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:24.205284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:24.205284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:24.205284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:24.205284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:39:24.205284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:39:24.205284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:39:24.205284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:39:24.206251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:24.206251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:24.206251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:39:24.206251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:39:24.206251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:39:24.206251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:39:24.206251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:24.206251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:24.206251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:24.206251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:24.206251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:24.206251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:24.206251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:24.206251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:24.206251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:24.206251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:24.206251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:24.206251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:24.207181 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:24.207181 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:24.207181 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:39:24.207181 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:39:24.207181 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:39:24.207181 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:39:24.207181 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:39:24.207181 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:39:24.207181 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 03 12:39:24.207181 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:24.207181 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 491/964] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:39:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:24.215255 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5506a-363f-49a8-94a1-88186d5174a0 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:24.323274 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5506a-363f-49a8-94a1-88186d5174a0 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:24.358961 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8afb9-1e6c-4b8d-9df6-799938e5b4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:24.359577 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8afb9-1e6c-4b8d-9df6-799938e5b4c9 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:24.359858 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8afb9-1e6c-4b8d-9df6-799938e5b4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:24.360134 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8afb9-1e6c-4b8d-9df6-799938e5b4c9 None admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:24.360898 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8afb9-1e6c-4b8d-9df6-799938e5b4c9 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:24.361200 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8afb9-1e6c-4b8d-9df6-799938e5b4c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:24.362863 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8afb9-1e6c-4b8d-9df6-799938e5b4c9 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:24.401614 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 474/965] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Aug 3 12:39:24 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:24.934699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063021d-d251-4423-aadf-ff12a86c5c06 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:24.935077 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063021d-d251-4423-aadf-ff12a86c5c06 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:24.935285 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063021d-d251-4423-aadf-ff12a86c5c06 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:24.936779 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 492/966] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:24.942008 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b2633-d1ec-49ee-8951-7df562bf6fba None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:24.942451 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b2633-d1ec-49ee-8951-7df562bf6fba None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:24.942635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b2633-d1ec-49ee-8951-7df562bf6fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:24.956125 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:24.962559 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-1f0b2633-d1ec-49ee-8951-7df562bf6fba None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:24.965267 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-1f0b2633-d1ec-49ee-8951-7df562bf6fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:25.035607 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 475/967] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:39:25.058801 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063021d-d251-4423-aadf-ff12a86c5c06 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:25.162126 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063021d-d251-4423-aadf-ff12a86c5c06 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:25.197710 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2734e4-f655-41cb-9747-525a30ab3bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:25.198435 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2734e4-f655-41cb-9747-525a30ab3bf1 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:25.198940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2734e4-f655-41cb-9747-525a30ab3bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:25.199345 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2734e4-f655-41cb-9747-525a30ab3bf1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:25.200081 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2734e4-f655-41cb-9747-525a30ab3bf1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:25.201637 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2734e4-f655-41cb-9747-525a30ab3bf1 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:25.210744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-5d2734e4-f655-41cb-9747-525a30ab3bf1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:39:25.210744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:25.210744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:39:25.210744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:39:25.210744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:39:25.210744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:39:25.210744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:39:25.210744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:25.210744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:39:25.210744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:25.210744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:39:25.210744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:25.210744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:25.210744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:25.210744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:25.210744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:25.210744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:25.211895 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:25.211895 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:25.211895 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:25.211895 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:25.211895 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:25.211895 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:25.211895 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:39:25.211895 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:39:25.211895 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:39:25.211895 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:39:25.211895 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:25.211895 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:25.211895 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:25.211895 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:25.211895 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:25.211895 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:25.212913 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:25.212913 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:25.212913 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:25.212913 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:25.212913 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:25.212913 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:25.212913 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:25.212913 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:25.212913 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:25.212913 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:25.212913 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:39:25.212913 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:25.212913 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:39:25.212913 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:25.215664 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 493/968] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Aug 3 12:39:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:25.221697 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b2633-d1ec-49ee-8951-7df562bf6fba None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:25.327720 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1c8bc-561e-4d18-b906-39ee7a8cd6d8 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:25.328048 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1c8bc-561e-4d18-b906-39ee7a8cd6d8 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:25.328849 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1c8bc-561e-4d18-b906-39ee7a8cd6d8 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:25.332452 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 494/969] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:39:25.332584 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b2633-d1ec-49ee-8951-7df562bf6fba None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:25.335203 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbb194-9cd8-4280-b6fb-a030afb521f4 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:25.335491 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbb194-9cd8-4280-b6fb-a030afb521f4 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:25.335801 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbb194-9cd8-4280-b6fb-a030afb521f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:25.342962 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:25.357675 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-0afbb194-9cd8-4280-b6fb-a030afb521f4 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:25.359132 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-0afbb194-9cd8-4280-b6fb-a030afb521f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:25.369599 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62cbf7-64dc-4de8-a28e-a225106da28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:25.370210 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62cbf7-64dc-4de8-a28e-a225106da28c None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:25.370534 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62cbf7-64dc-4de8-a28e-a225106da28c None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:25.370812 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62cbf7-64dc-4de8-a28e-a225106da28c None admin] PATH_INFO: `/v3/services` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:25.371503 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e62cbf7-64dc-4de8-a28e-a225106da28c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:25.371808 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e62cbf7-64dc-4de8-a28e-a225106da28c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:25.373174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e62cbf7-64dc-4de8-a28e-a225106da28c None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:25.375446 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:25.381236 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 476/970] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Aug 3 12:39:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:25.382430 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003b204-facb-4db6-b854-cba1c519b577 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:25.382716 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003b204-facb-4db6-b854-cba1c519b577 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:25.382994 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003b204-facb-4db6-b854-cba1c519b577 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:25.384486 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 477/971] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:25.385178 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003b204-facb-4db6-b854-cba1c519b577 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:25.428270 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 495/972] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:39:25.429521 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ce291-ba77-46d4-a572-9997375d2e15 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:25.429820 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ce291-ba77-46d4-a572-9997375d2e15 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:25.430091 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ce291-ba77-46d4-a572-9997375d2e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:25.450561 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-431ce291-ba77-46d4-a572-9997375d2e15 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:25.451762 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-431ce291-ba77-46d4-a572-9997375d2e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:25.489967 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003b204-facb-4db6-b854-cba1c519b577 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:25.517023 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 496/973] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:39:25.517854 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ce291-ba77-46d4-a572-9997375d2e15 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:25.524012 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355573b-9b4e-41e7-8ae7-383e72286065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:25.524629 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355573b-9b4e-41e7-8ae7-383e72286065 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:25.524912 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355573b-9b4e-41e7-8ae7-383e72286065 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:25.525190 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355573b-9b4e-41e7-8ae7-383e72286065 None admin] PATH_INFO: `/v3/services` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:25.525929 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355573b-9b4e-41e7-8ae7-383e72286065 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:25.526260 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355573b-9b4e-41e7-8ae7-383e72286065 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:25.527763 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355573b-9b4e-41e7-8ae7-383e72286065 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:25.532761 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 478/974] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Aug 3 12:39:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:25.538582 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355573b-9b4e-41e7-8ae7-383e72286065 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:25.579609 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:25.600849 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:25.617172 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ce291-ba77-46d4-a572-9997375d2e15 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:25.640494 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355573b-9b4e-41e7-8ae7-383e72286065 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:25.651022 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd284b-fc81-48e0-ac3b-4d684cb612c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:25.651651 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd284b-fc81-48e0-ac3b-4d684cb612c9 None admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:25.651953 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd284b-fc81-48e0-ac3b-4d684cb612c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:25.652259 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd284b-fc81-48e0-ac3b-4d684cb612c9 None admin] PATH_INFO: `/v3/services` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:25.652971 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd284b-fc81-48e0-ac3b-4d684cb612c9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:25.654381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd284b-fc81-48e0-ac3b-4d684cb612c9 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:25.669623 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 497/975] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Aug 3 12:39:25 2022] POST /identity/v3/services => generated 242 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:39:25.670438 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd284b-fc81-48e0-ac3b-4d684cb612c9 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:25.689416 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da88238-6957-4c8e-b110-fa0a92af6092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:25.690108 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da88238-6957-4c8e-b110-fa0a92af6092 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:25.690393 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da88238-6957-4c8e-b110-fa0a92af6092 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:25.690671 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da88238-6957-4c8e-b110-fa0a92af6092 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:25.692016 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da88238-6957-4c8e-b110-fa0a92af6092 None admin] RBAC: Adding query filter params (interface=admin, service_id=a0139ba16c0b40948086d3161e92beff, region_id=RegionOne) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:25.692336 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da88238-6957-4c8e-b110-fa0a92af6092 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:25.693788 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da88238-6957-4c8e-b110-fa0a92af6092 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:25.700014 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 479/976] 10.222.0.46 () {56 vars in 1249 bytes} [Wed Aug 3 12:39:25 2022] GET /identity/v3/endpoints?service_id=a0139ba16c0b40948086d3161e92beff&interface=admin®ion_id=RegionOne => generated 193 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:25.706049 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da88238-6957-4c8e-b110-fa0a92af6092 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:25.796995 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd284b-fc81-48e0-ac3b-4d684cb612c9 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:25.822101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:25.827093 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da88238-6957-4c8e-b110-fa0a92af6092 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:25.837780 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2adc538-7988-4cde-935e-58599fcfa748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:25.838763 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adc538-7988-4cde-935e-58599fcfa748 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:25.839047 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adc538-7988-4cde-935e-58599fcfa748 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:25.840188 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adc538-7988-4cde-935e-58599fcfa748 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:25.854478 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:25.854650 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2adc538-7988-4cde-935e-58599fcfa748 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:39:25.861124 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-d2adc538-7988-4cde-935e-58599fcfa748 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 12:39:25.861124 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:25.861124 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:25.861124 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:25.861124 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:25.861124 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:25.861124 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:25.861124 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:25.861124 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:25.861124 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:25.861124 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:25.861124 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:25.861124 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:39:25.861124 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:39:25.861124 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:39:25.861124 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:39:25.862258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:39:25.862258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:39:25.862258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:39:25.862258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:39:25.862258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:25.862258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:25.862258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:25.862258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:25.862258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:25.862258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:25.862258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:25.862258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:25.862258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:25.862258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:25.862258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:25.862258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:25.863278 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:25.863278 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:25.863278 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:25.863278 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:25.863278 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:39:25.863278 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:39:25.863278 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:39:25.863278 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:39:25.863278 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:39:25.863278 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:39:25.863278 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 12:39:25.863278 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:25.863278 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 498/977] 10.222.0.46 () {56 vars in 1120 bytes} [Wed Aug 3 12:39:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:25.869003 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2adc538-7988-4cde-935e-58599fcfa748 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:25.869135 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4fa60e-d554-4b5e-9d9d-3c4330c02cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:25.871373 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fa60e-d554-4b5e-9d9d-3c4330c02cf5 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:25.871373 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fa60e-d554-4b5e-9d9d-3c4330c02cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:25.871373 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fa60e-d554-4b5e-9d9d-3c4330c02cf5 None admin] PATH_INFO: `/v3/services` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:25.871373 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4fa60e-d554-4b5e-9d9d-3c4330c02cf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:25.872128 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4fa60e-d554-4b5e-9d9d-3c4330c02cf5 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:25.878680 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 480/978] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Aug 3 12:39:25 2022] GET /identity/v3/services => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:39:25.983104 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2adc538-7988-4cde-935e-58599fcfa748 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:26.018995 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c2daa-11b4-480e-9f00-7c6fbec25307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:26.019632 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c2daa-11b4-480e-9f00-7c6fbec25307 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:26.019911 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c2daa-11b4-480e-9f00-7c6fbec25307 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:26.020184 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c2daa-11b4-480e-9f00-7c6fbec25307 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:26.020915 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c2daa-11b4-480e-9f00-7c6fbec25307 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:26.021214 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c2daa-11b4-480e-9f00-7c6fbec25307 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:26.022628 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c2daa-11b4-480e-9f00-7c6fbec25307 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:26.032090 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 499/979] 10.222.0.46 () {56 vars in 1115 bytes} [Wed Aug 3 12:39:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:26.037777 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4fa60e-d554-4b5e-9d9d-3c4330c02cf5 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:26.143948 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4fa60e-d554-4b5e-9d9d-3c4330c02cf5 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:26.179564 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b0b27-4fe6-453e-8087-a4c449108c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:26.180445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b0b27-4fe6-453e-8087-a4c449108c65 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:26.180882 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b0b27-4fe6-453e-8087-a4c449108c65 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:26.181327 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b0b27-4fe6-453e-8087-a4c449108c65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:26.192508 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b0b27-4fe6-453e-8087-a4c449108c65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:26.194197 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b0b27-4fe6-453e-8087-a4c449108c65 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:26.209661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-f46b0b27-4fe6-453e-8087-a4c449108c65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:26.209661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:26.209661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:26.209661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:26.209661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:26.209661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:26.209661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:26.209661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:26.209661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:26.209661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:26.209661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:26.209661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:26.209661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:39:26.209661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:39:26.209661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:39:26.210822 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:39:26.210822 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:26.210822 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:26.210822 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:26.210822 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:26.210822 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:26.210822 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:26.210822 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:26.210822 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:26.210822 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:26.210822 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:26.210822 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:26.210822 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:26.210822 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:26.210822 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:26.210822 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:26.210822 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:26.211985 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:39:26.211985 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:39:26.211985 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:26.211985 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:26.219152 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 481/980] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:39:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:39:26.220350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c2daa-11b4-480e-9f00-7c6fbec25307 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:26.270309 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:26.327469 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c2daa-11b4-480e-9f00-7c6fbec25307 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:26.363418 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e10986-260a-46aa-a75d-5662ec96f4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:26.364104 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e10986-260a-46aa-a75d-5662ec96f4c7 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:26.364390 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e10986-260a-46aa-a75d-5662ec96f4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:26.364670 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e10986-260a-46aa-a75d-5662ec96f4c7 None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:26.365650 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e10986-260a-46aa-a75d-5662ec96f4c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:26.365957 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e10986-260a-46aa-a75d-5662ec96f4c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:26.367327 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e10986-260a-46aa-a75d-5662ec96f4c7 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:26.384856 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 500/981] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:26.385953 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b0b27-4fe6-453e-8087-a4c449108c65 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:26.432216 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:26.492472 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b0b27-4fe6-453e-8087-a4c449108c65 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:26.527406 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80904f21-1a5d-458b-8a6e-eb79bb5a646e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:26.527954 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80904f21-1a5d-458b-8a6e-eb79bb5a646e None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:26.528228 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80904f21-1a5d-458b-8a6e-eb79bb5a646e None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:26.528493 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80904f21-1a5d-458b-8a6e-eb79bb5a646e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:26.535536 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80904f21-1a5d-458b-8a6e-eb79bb5a646e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:26.536959 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80904f21-1a5d-458b-8a6e-eb79bb5a646e None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:26.548449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-80904f21-1a5d-458b-8a6e-eb79bb5a646e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 12:39:26.548449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:26.548449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:26.548449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:26.548449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:26.548449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:26.548449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:26.548449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:26.548449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:26.548449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:26.548449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:26.548449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:26.548449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:39:26.548449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:39:26.548449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:39:26.548449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:39:26.549386 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:26.549386 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:26.549386 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:39:26.549386 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:39:26.549386 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:39:26.549386 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:39:26.549386 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:26.549386 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:26.549386 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:26.549386 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:26.549386 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:26.549386 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:26.549386 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:26.549386 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:26.549386 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:26.549386 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:26.549386 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:26.549386 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:26.550455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:26.550455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:26.550455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:39:26.550455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:39:26.550455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:39:26.550455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:39:26.550455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:39:26.550455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:39:26.550455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 03 12:39:26.550455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:26.550455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 482/982] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Aug 3 12:39:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:39:26.557130 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e10986-260a-46aa-a75d-5662ec96f4c7 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:26.658568 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e10986-260a-46aa-a75d-5662ec96f4c7 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:26.660875 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:26.693789 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68462dd2-802a-49f6-aa98-062a0da1f75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:26.694404 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68462dd2-802a-49f6-aa98-062a0da1f75c None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:26.694686 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68462dd2-802a-49f6-aa98-062a0da1f75c None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:26.694960 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68462dd2-802a-49f6-aa98-062a0da1f75c None admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:26.695757 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68462dd2-802a-49f6-aa98-062a0da1f75c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:26.696063 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68462dd2-802a-49f6-aa98-062a0da1f75c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:26.697481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68462dd2-802a-49f6-aa98-062a0da1f75c None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:26.715680 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 501/983] 10.222.0.46 () {56 vars in 1149 bytes} [Wed Aug 3 12:39:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:26.721097 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80904f21-1a5d-458b-8a6e-eb79bb5a646e None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:26.820213 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:26.824443 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80904f21-1a5d-458b-8a6e-eb79bb5a646e None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:26.860153 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c896f-15ac-4170-ba0d-aee022230768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:26.860769 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c896f-15ac-4170-ba0d-aee022230768 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:26.861052 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c896f-15ac-4170-ba0d-aee022230768 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:26.861325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c896f-15ac-4170-ba0d-aee022230768 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:26.928858 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c896f-15ac-4170-ba0d-aee022230768 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:26.930329 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c896f-15ac-4170-ba0d-aee022230768 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:27.028384 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:27.033144 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 483/984] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:39:26 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:39:27.038409 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68462dd2-802a-49f6-aa98-062a0da1f75c None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:27.138148 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68462dd2-802a-49f6-aa98-062a0da1f75c None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:27.171793 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadfd8e-5774-482c-8344-db99d940328a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:27.172434 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadfd8e-5774-482c-8344-db99d940328a None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:27.172716 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadfd8e-5774-482c-8344-db99d940328a None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:27.172991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadfd8e-5774-482c-8344-db99d940328a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:27.183594 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fadfd8e-5774-482c-8344-db99d940328a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:27.185044 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fadfd8e-5774-482c-8344-db99d940328a None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:27.200593 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-6fadfd8e-5774-482c-8344-db99d940328a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:27.200593 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:27.200593 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:27.200593 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:27.200593 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:27.200593 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:27.200593 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:27.200593 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:27.200593 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:27.200593 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:27.200593 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:27.200593 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:27.200593 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:39:27.200593 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:39:27.200593 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:39:27.201572 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:39:27.201572 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:27.201572 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:27.201572 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:27.201572 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:27.201572 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:27.201572 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:27.201572 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:27.201572 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:27.201572 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:27.201572 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:27.201572 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:27.201572 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:27.201572 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:27.201572 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:27.201572 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:27.201572 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:27.202480 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:39:27.202480 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:39:27.202480 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:27.202480 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:27.205820 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 502/985] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:39:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:27.207294 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c896f-15ac-4170-ba0d-aee022230768 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:27.324721 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c896f-15ac-4170-ba0d-aee022230768 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:27.359590 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa790fe9-fc7d-4192-892e-8b9a100fae88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:27.360205 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa790fe9-fc7d-4192-892e-8b9a100fae88 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:27.360479 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa790fe9-fc7d-4192-892e-8b9a100fae88 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:27.360747 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa790fe9-fc7d-4192-892e-8b9a100fae88 None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:27.361432 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa790fe9-fc7d-4192-892e-8b9a100fae88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:27.361757 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa790fe9-fc7d-4192-892e-8b9a100fae88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:27.363111 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa790fe9-fc7d-4192-892e-8b9a100fae88 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:27.379408 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 484/986] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:27.380730 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadfd8e-5774-482c-8344-db99d940328a None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:27.397739 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:27.486146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadfd8e-5774-482c-8344-db99d940328a None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:27.520641 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f85a15-5c42-4c46-b8e9-df82d47b5be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:27.521285 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f85a15-5c42-4c46-b8e9-df82d47b5be8 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:27.521596 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f85a15-5c42-4c46-b8e9-df82d47b5be8 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:27.521875 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f85a15-5c42-4c46-b8e9-df82d47b5be8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:27.528653 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f85a15-5c42-4c46-b8e9-df82d47b5be8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:27.530126 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f85a15-5c42-4c46-b8e9-df82d47b5be8 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:27.541316 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-02f85a15-5c42-4c46-b8e9-df82d47b5be8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:39:27.541316 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:27.541316 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:27.541316 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:27.541316 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:27.541316 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:27.541316 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:27.541316 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:27.541316 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:27.541316 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:27.541316 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:27.541316 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:27.541316 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:39:27.541316 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:39:27.541316 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:39:27.542463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:39:27.542463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:27.542463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:27.542463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:27.542463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:27.542463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:27.542463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:27.542463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:27.542463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:27.542463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:27.542463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:27.542463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:27.542463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:27.542463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:27.542463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:27.542463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:27.542463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:27.543610 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:39:27.543610 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:39:27.543610 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:39:27.543610 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:39:27.543610 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:39:27.543610 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:39:27.543610 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:39:27.543610 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:27.545823 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 503/987] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:39:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:27.548176 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa790fe9-fc7d-4192-892e-8b9a100fae88 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:27.608854 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:27.651922 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa790fe9-fc7d-4192-892e-8b9a100fae88 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:27.685344 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfe1e2-c0ee-48ec-9d9c-0818e80ca3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:27.685994 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfe1e2-c0ee-48ec-9d9c-0818e80ca3eb None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:27.686278 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfe1e2-c0ee-48ec-9d9c-0818e80ca3eb None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:27.686551 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfe1e2-c0ee-48ec-9d9c-0818e80ca3eb None admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:27.687303 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dfe1e2-c0ee-48ec-9d9c-0818e80ca3eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:27.687669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dfe1e2-c0ee-48ec-9d9c-0818e80ca3eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:27.689090 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dfe1e2-c0ee-48ec-9d9c-0818e80ca3eb None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:27.702708 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 485/988] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 3 12:39:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:27.708473 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f85a15-5c42-4c46-b8e9-df82d47b5be8 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:27.737222 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74baf36a-e549-4b49-8adb-d4f51ebba65c None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:27.737545 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74baf36a-e549-4b49-8adb-d4f51ebba65c None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:27.737817 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74baf36a-e549-4b49-8adb-d4f51ebba65c None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:27.739209 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 486/989] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:39:27.744867 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016eeea3-f915-42ea-b5b4-768abdce6641 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:27.745150 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016eeea3-f915-42ea-b5b4-768abdce6641 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:27.746012 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016eeea3-f915-42ea-b5b4-768abdce6641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:27.764528 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-016eeea3-f915-42ea-b5b4-768abdce6641 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:27.766194 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-016eeea3-f915-42ea-b5b4-768abdce6641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:27.788403 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:27.815911 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f85a15-5c42-4c46-b8e9-df82d47b5be8 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:27.837228 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 487/990] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:27 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:39:27.850516 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100f1ad-58f2-4b20-ac86-3488861489f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:27.851135 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100f1ad-58f2-4b20-ac86-3488861489f8 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:27.851416 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100f1ad-58f2-4b20-ac86-3488861489f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:27.851688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100f1ad-58f2-4b20-ac86-3488861489f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:27.852484 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9100f1ad-58f2-4b20-ac86-3488861489f8 None admin] RBAC: Adding query filter params (role.id=a7ac56aa0b134a9e925725f41c54d4b3, scope.project.id=6ac833dfff634496816842c851545d21, user.id=a994c976b95744ed9723bf9c4386bde1) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:27.852793 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9100f1ad-58f2-4b20-ac86-3488861489f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:27.854253 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9100f1ad-58f2-4b20-ac86-3488861489f8 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:27.859678 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016eeea3-f915-42ea-b5b4-768abdce6641 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:27.869540 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 504/991] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:39:27 2022] GET /identity/v3/role_assignments?user.id=a994c976b95744ed9723bf9c4386bde1&scope.project.id=6ac833dfff634496816842c851545d21&role.id=a7ac56aa0b134a9e925725f41c54d4b3 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:27.915437 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:27.918168 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d579f-37dc-4733-8038-ca0dec26e9b2 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:27.918513 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d579f-37dc-4733-8038-ca0dec26e9b2 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:27.918839 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d579f-37dc-4733-8038-ca0dec26e9b2 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:27.920996 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 505/992] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:39:27.926924 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37743a89-2c2a-4bc9-8f92-5126e9809770 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:27.927215 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37743a89-2c2a-4bc9-8f92-5126e9809770 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:27.927715 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37743a89-2c2a-4bc9-8f92-5126e9809770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:27.946848 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-37743a89-2c2a-4bc9-8f92-5126e9809770 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:27.948105 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-37743a89-2c2a-4bc9-8f92-5126e9809770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:27.973790 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016eeea3-f915-42ea-b5b4-768abdce6641 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:28.013518 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c9793-c224-4f02-819e-1f8213a10519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:28.014170 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c9793-c224-4f02-819e-1f8213a10519 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:28.014455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c9793-c224-4f02-819e-1f8213a10519 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:28.014734 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c9793-c224-4f02-819e-1f8213a10519 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:28.015367 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c9793-c224-4f02-819e-1f8213a10519 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:28.017110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c9793-c224-4f02-819e-1f8213a10519 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:28.026318 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-be0c9793-c224-4f02-819e-1f8213a10519 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 03 12:39:28.026318 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:28.026318 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:39:28.026318 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:39:28.026318 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:39:28.026318 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:39:28.026318 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:39:28.026318 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:28.026318 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 03 12:39:28.026318 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:28.026318 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:39:28.026318 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:28.026318 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:28.026318 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:28.026318 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:28.026318 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:28.026318 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:28.027325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:28.027325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:28.027325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:28.027325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:28.027325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:28.027325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:28.027325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:39:28.027325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:39:28.027325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:39:28.027325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:39:28.027325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:28.027325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:28.027325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:28.027325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:28.027325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:28.027325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:28.028151 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:28.028151 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:28.028151 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:28.028151 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:28.028151 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:28.028151 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:28.028151 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:28.028151 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:28.028151 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:28.028151 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:28.028151 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:39:28.028151 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:28.028151 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 03 12:39:28.028151 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:28.028899 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 488/993] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:39:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:39:28.034931 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 506/994] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:27 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:39:28.035662 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c9793-c224-4f02-819e-1f8213a10519 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:28.059195 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37743a89-2c2a-4bc9-8f92-5126e9809770 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:28.133028 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:28.145651 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c9793-c224-4f02-819e-1f8213a10519 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:28.160866 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:28.170166 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37743a89-2c2a-4bc9-8f92-5126e9809770 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:28.184331 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67534f2-9311-4b90-9702-2a39b8f697d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:28.184952 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67534f2-9311-4b90-9702-2a39b8f697d4 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:28.185236 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67534f2-9311-4b90-9702-2a39b8f697d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:28.185542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67534f2-9311-4b90-9702-2a39b8f697d4 None admin] PATH_INFO: `/v3/services` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:28.186220 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67534f2-9311-4b90-9702-2a39b8f697d4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:28.186527 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67534f2-9311-4b90-9702-2a39b8f697d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:28.187891 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67534f2-9311-4b90-9702-2a39b8f697d4 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:28.193831 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 489/995] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Aug 3 12:39:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:28.199075 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67534f2-9311-4b90-9702-2a39b8f697d4 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:28.213474 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf730b-d7e8-468c-bd01-d0f0f040e40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:28.214730 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf730b-d7e8-468c-bd01-d0f0f040e40d None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:28.215018 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf730b-d7e8-468c-bd01-d0f0f040e40d None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:28.215295 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf730b-d7e8-468c-bd01-d0f0f040e40d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:28.215938 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cf730b-d7e8-468c-bd01-d0f0f040e40d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:28.217307 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cf730b-d7e8-468c-bd01-d0f0f040e40d None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:28.227155 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-37cf730b-d7e8-468c-bd01-d0f0f040e40d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:39:28.227155 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:28.227155 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:39:28.227155 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:39:28.227155 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:39:28.227155 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:39:28.227155 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:39:28.227155 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:28.227155 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:39:28.227155 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:28.227155 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:39:28.227155 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:28.227155 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:28.227155 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:28.227155 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:28.227155 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:28.227155 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:28.228218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:28.228218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:28.228218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:28.228218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:28.228218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:28.228218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:28.228218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:39:28.228218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:39:28.228218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:39:28.228218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:39:28.228218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:28.228218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:28.228218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:28.228218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:28.228218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:28.228218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:28.229091 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:28.229091 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:28.229091 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:28.229091 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:28.229091 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:28.229091 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:28.229091 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:28.229091 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:28.229091 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:28.229091 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:28.229091 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:39:28.229091 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:28.229091 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 03 12:39:28.229091 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:28.234098 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 507/996] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Aug 3 12:39:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:39:28.235104 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf730b-d7e8-468c-bd01-d0f0f040e40d None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:28.308283 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67534f2-9311-4b90-9702-2a39b8f697d4 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:28.342817 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729987ca-4fea-43b0-9533-6794de658d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:28.343431 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729987ca-4fea-43b0-9533-6794de658d28 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:28.343719 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729987ca-4fea-43b0-9533-6794de658d28 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:28.343997 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729987ca-4fea-43b0-9533-6794de658d28 None admin] PATH_INFO: `/v3/services` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:28.344680 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729987ca-4fea-43b0-9533-6794de658d28 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:28.344990 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729987ca-4fea-43b0-9533-6794de658d28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:28.346455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729987ca-4fea-43b0-9533-6794de658d28 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:28.348921 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf730b-d7e8-468c-bd01-d0f0f040e40d None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:28.351339 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 490/997] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Aug 3 12:39:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:28.357689 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729987ca-4fea-43b0-9533-6794de658d28 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:28.385787 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:28.393719 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d3144-38be-42d8-817c-71838abe2319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:28.393719 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d3144-38be-42d8-817c-71838abe2319 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:28.393719 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d3144-38be-42d8-817c-71838abe2319 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:28.393719 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d3144-38be-42d8-817c-71838abe2319 None admin] PATH_INFO: `/v3/services` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:28.396056 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d3144-38be-42d8-817c-71838abe2319 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:28.396056 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d3144-38be-42d8-817c-71838abe2319 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:28.396056 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d3144-38be-42d8-817c-71838abe2319 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:28.401539 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 508/998] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Aug 3 12:39:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:28.406778 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d3144-38be-42d8-817c-71838abe2319 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:28.418482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:28.481351 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729987ca-4fea-43b0-9533-6794de658d28 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:28.516913 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59352c86-d6d5-41c8-9606-e44e96adea38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:28.517838 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59352c86-d6d5-41c8-9606-e44e96adea38 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:28.518120 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59352c86-d6d5-41c8-9606-e44e96adea38 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:28.518393 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59352c86-d6d5-41c8-9606-e44e96adea38 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:28.519150 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59352c86-d6d5-41c8-9606-e44e96adea38 None admin] RBAC: Adding query filter params (interface=public, service_id=4c1a3cc01be7441884bdc87091a7aa4f, region_id=RegionOne) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:28.519470 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59352c86-d6d5-41c8-9606-e44e96adea38 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:28.520829 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59352c86-d6d5-41c8-9606-e44e96adea38 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:28.526483 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 491/999] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Aug 3 12:39:28 2022] GET /identity/v3/endpoints?service_id=4c1a3cc01be7441884bdc87091a7aa4f&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:28.531519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d3144-38be-42d8-817c-71838abe2319 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:28.532420 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59352c86-d6d5-41c8-9606-e44e96adea38 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:28.567468 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8767405-2dc7-43d7-823b-f7ae9f8d401a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:28.568091 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8767405-2dc7-43d7-823b-f7ae9f8d401a None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:28.568380 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8767405-2dc7-43d7-823b-f7ae9f8d401a None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:28.568655 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8767405-2dc7-43d7-823b-f7ae9f8d401a None admin] PATH_INFO: `/v3/services` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:28.569340 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8767405-2dc7-43d7-823b-f7ae9f8d401a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:28.569681 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8767405-2dc7-43d7-823b-f7ae9f8d401a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:28.571058 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8767405-2dc7-43d7-823b-f7ae9f8d401a None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:28.581270 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 509/1000] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Aug 3 12:39:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:28.582222 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8767405-2dc7-43d7-823b-f7ae9f8d401a None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:28.643059 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59352c86-d6d5-41c8-9606-e44e96adea38 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:28.645725 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:28.651219 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:28.682071 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce004d-f688-4caa-8a01-ec3a26f6ef04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:28.682795 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce004d-f688-4caa-8a01-ec3a26f6ef04 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:28.683183 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce004d-f688-4caa-8a01-ec3a26f6ef04 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:28.683621 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce004d-f688-4caa-8a01-ec3a26f6ef04 None admin] PATH_INFO: `/v3/services` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:28.684283 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce004d-f688-4caa-8a01-ec3a26f6ef04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:28.685658 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce004d-f688-4caa-8a01-ec3a26f6ef04 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:28.689701 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8767405-2dc7-43d7-823b-f7ae9f8d401a None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:28.692063 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 492/1001] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Aug 3 12:39:28 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:39:28.734388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9dc127-45e8-434d-a145-1eea42253c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:28.734940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dc127-45e8-434d-a145-1eea42253c57 None admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:28.735224 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dc127-45e8-434d-a145-1eea42253c57 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:28.735500 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dc127-45e8-434d-a145-1eea42253c57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:28.736343 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9dc127-45e8-434d-a145-1eea42253c57 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:28.737792 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9dc127-45e8-434d-a145-1eea42253c57 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:28.756315 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 510/1002] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:39:28 2022] POST /identity/v3/endpoints => generated 325 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:39:29.909945 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0a39b-c2dc-4a95-89ef-8aa91a70e295 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:29.910465 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0a39b-c2dc-4a95-89ef-8aa91a70e295 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:29.910465 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0a39b-c2dc-4a95-89ef-8aa91a70e295 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:29.912019 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 493/1003] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:29.916951 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd6e32-0578-4b4e-ba3e-f00d3761f737 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:29.917975 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd6e32-0578-4b4e-ba3e-f00d3761f737 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:29.918316 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd6e32-0578-4b4e-ba3e-f00d3761f737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:29.937295 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-15cd6e32-0578-4b4e-ba3e-f00d3761f737 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:29.938529 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-15cd6e32-0578-4b4e-ba3e-f00d3761f737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:30.014957 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 511/1004] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:29 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:39:30.036665 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0a39b-c2dc-4a95-89ef-8aa91a70e295 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:30.143350 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0a39b-c2dc-4a95-89ef-8aa91a70e295 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:30.177396 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0954745-60e8-4fa6-be59-4ed5056d35b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:30.177987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0954745-60e8-4fa6-be59-4ed5056d35b4 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:30.178272 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0954745-60e8-4fa6-be59-4ed5056d35b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:30.178544 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0954745-60e8-4fa6-be59-4ed5056d35b4 None admin] PATH_INFO: `/v3/services/image` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:30.179174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0954745-60e8-4fa6-be59-4ed5056d35b4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:30.180524 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0954745-60e8-4fa6-be59-4ed5056d35b4 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:30.189556 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-d0954745-60e8-4fa6-be59-4ed5056d35b4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 03 12:39:30.189556 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:30.189556 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:39:30.189556 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:39:30.189556 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:39:30.189556 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:39:30.189556 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:39:30.189556 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:30.189556 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 03 12:39:30.189556 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:30.189556 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:39:30.189556 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:30.189556 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:30.189556 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:30.189556 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:30.189556 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:30.189556 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:30.190553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:30.190553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:30.190553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:30.190553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:30.190553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:30.190553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:30.190553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:39:30.190553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:39:30.190553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:39:30.190553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:39:30.190553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:30.190553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:30.190553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:30.190553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:30.190553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:30.190553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:30.191424 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:30.191424 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:30.191424 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:30.191424 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:30.191424 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:30.191424 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:30.191424 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:30.191424 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:30.191424 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:30.191424 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:30.191424 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:39:30.191424 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:30.191424 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 03 12:39:30.191424 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:30.193833 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 494/1005] 10.222.0.46 () {56 vars in 1105 bytes} [Wed Aug 3 12:39:30 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:30.196703 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd6e32-0578-4b4e-ba3e-f00d3761f737 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:30.244010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:30.309243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd6e32-0578-4b4e-ba3e-f00d3761f737 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:30.344743 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45672ea2-ca55-48e1-838f-b18867aeb569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:30.345371 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45672ea2-ca55-48e1-838f-b18867aeb569 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:30.345684 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45672ea2-ca55-48e1-838f-b18867aeb569 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:30.345964 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45672ea2-ca55-48e1-838f-b18867aeb569 None admin] PATH_INFO: `/v3/services` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:30.346654 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45672ea2-ca55-48e1-838f-b18867aeb569 None admin] RBAC: Adding query filter params (name=image) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:30.346962 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45672ea2-ca55-48e1-838f-b18867aeb569 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:30.348336 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45672ea2-ca55-48e1-838f-b18867aeb569 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:30.358041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 512/1006] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:39:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:30.359091 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0954745-60e8-4fa6-be59-4ed5056d35b4 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:30.395380 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:30.464444 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0954745-60e8-4fa6-be59-4ed5056d35b4 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:30.498453 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779adb2-2c0d-4251-9733-e1b9cdea1dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:30.499071 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779adb2-2c0d-4251-9733-e1b9cdea1dd1 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:30.499353 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779adb2-2c0d-4251-9733-e1b9cdea1dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:30.499629 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779adb2-2c0d-4251-9733-e1b9cdea1dd1 None admin] PATH_INFO: `/v3/services` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:30.500315 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b779adb2-2c0d-4251-9733-e1b9cdea1dd1 None admin] RBAC: Adding query filter params (type=image) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:30.500619 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b779adb2-2c0d-4251-9733-e1b9cdea1dd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:30.502011 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b779adb2-2c0d-4251-9733-e1b9cdea1dd1 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:30.513539 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 495/1007] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:39:30 2022] GET /identity/v3/services?type=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:30.767074 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87f4ec-e1a2-48bc-a8ec-f7917b86ac50 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:30.767484 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87f4ec-e1a2-48bc-a8ec-f7917b86ac50 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:30.767660 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87f4ec-e1a2-48bc-a8ec-f7917b86ac50 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:30.769148 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 513/1008] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:30.774029 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811da59-a6b1-4151-bd0c-a88eaf4765a4 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:30.774316 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811da59-a6b1-4151-bd0c-a88eaf4765a4 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:30.774591 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811da59-a6b1-4151-bd0c-a88eaf4765a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:30.783125 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb972d-6fcc-4d83-b599-d66943b4a373 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:30.783413 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb972d-6fcc-4d83-b599-d66943b4a373 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:30.783687 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb972d-6fcc-4d83-b599-d66943b4a373 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:30.785155 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 514/1009] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:39:30.789901 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a66fef-d859-4307-b5d1-a095d9a56780 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:30.790169 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a66fef-d859-4307-b5d1-a095d9a56780 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:30.790355 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a66fef-d859-4307-b5d1-a095d9a56780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:30.793896 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-f811da59-a6b1-4151-bd0c-a88eaf4765a4 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:30.795155 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-f811da59-a6b1-4151-bd0c-a88eaf4765a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:30.808307 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-17a66fef-d859-4307-b5d1-a095d9a56780 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:30.809629 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-17a66fef-d859-4307-b5d1-a095d9a56780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:30.873540 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 496/1010] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:30 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:39:30.885526 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 515/1011] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:30 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:39:30.891287 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811da59-a6b1-4151-bd0c-a88eaf4765a4 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:30.908488 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a66fef-d859-4307-b5d1-a095d9a56780 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:30.919592 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:30.958940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:30.997059 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811da59-a6b1-4151-bd0c-a88eaf4765a4 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:31.019866 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a66fef-d859-4307-b5d1-a095d9a56780 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:31.031662 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327908e1-5857-461c-a23f-971a767627d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:31.032312 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327908e1-5857-461c-a23f-971a767627d3 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:31.032590 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327908e1-5857-461c-a23f-971a767627d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:31.032868 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327908e1-5857-461c-a23f-971a767627d3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:31.033515 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327908e1-5857-461c-a23f-971a767627d3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:31.034875 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327908e1-5857-461c-a23f-971a767627d3 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:31.044082 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-327908e1-5857-461c-a23f-971a767627d3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 03 12:39:31.044082 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:31.044082 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:39:31.044082 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:39:31.044082 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:39:31.044082 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:39:31.044082 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:39:31.044082 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:31.044082 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 03 12:39:31.044082 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:31.044082 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:39:31.044082 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:31.044082 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:31.044082 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:31.044082 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:31.044082 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:31.044082 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:31.045102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:31.045102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:31.045102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:31.045102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:31.045102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:31.045102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:31.045102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:39:31.045102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:39:31.045102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:39:31.045102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:39:31.045102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:31.045102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:31.045102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:31.045102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:31.045102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:31.045102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:31.045993 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:31.045993 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:31.045993 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:31.045993 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:31.045993 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:31.045993 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:31.045993 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:31.045993 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:31.045993 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:31.045993 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:31.045993 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:39:31.045993 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:31.045993 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 03 12:39:31.045993 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:31.045993 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 497/1012] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:39:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:31.051044 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327908e1-5857-461c-a23f-971a767627d3 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:31.061725 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae771829-7d3a-47fd-a309-f719f8393604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:31.062728 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae771829-7d3a-47fd-a309-f719f8393604 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:31.063010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae771829-7d3a-47fd-a309-f719f8393604 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:31.063282 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae771829-7d3a-47fd-a309-f719f8393604 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:31.064749 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae771829-7d3a-47fd-a309-f719f8393604 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:31.066218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae771829-7d3a-47fd-a309-f719f8393604 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:31.067820 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 516/1013] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:39:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:31.074816 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae771829-7d3a-47fd-a309-f719f8393604 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:31.149447 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:31.161883 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327908e1-5857-461c-a23f-971a767627d3 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:31.183863 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae771829-7d3a-47fd-a309-f719f8393604 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:31.193236 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:31.200432 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da0ee4-e827-49b3-8cf0-23aa1035fc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:31.201051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da0ee4-e827-49b3-8cf0-23aa1035fc66 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:31.201331 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da0ee4-e827-49b3-8cf0-23aa1035fc66 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:31.201631 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da0ee4-e827-49b3-8cf0-23aa1035fc66 None admin] PATH_INFO: `/v3/services` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:31.202316 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da0ee4-e827-49b3-8cf0-23aa1035fc66 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:31.202618 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da0ee4-e827-49b3-8cf0-23aa1035fc66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:31.203966 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da0ee4-e827-49b3-8cf0-23aa1035fc66 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:31.209275 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 498/1014] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Aug 3 12:39:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:31.214797 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da0ee4-e827-49b3-8cf0-23aa1035fc66 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:31.225023 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30fc1bc-17c7-4957-b258-5403f60bfc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:31.226442 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fc1bc-17c7-4957-b258-5403f60bfc78 None admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:31.226879 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fc1bc-17c7-4957-b258-5403f60bfc78 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:31.227325 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fc1bc-17c7-4957-b258-5403f60bfc78 None admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:31.228686 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30fc1bc-17c7-4957-b258-5403f60bfc78 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:31.231173 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30fc1bc-17c7-4957-b258-5403f60bfc78 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:31.273643 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 517/1015] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Aug 3 12:39:31 2022] POST /identity/v3/projects => generated 311 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:39:31.337375 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da0ee4-e827-49b3-8cf0-23aa1035fc66 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:31.373790 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ba2a6-cb26-4270-92eb-32c4854fa487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:31.374515 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ba2a6-cb26-4270-92eb-32c4854fa487 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:31.374794 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ba2a6-cb26-4270-92eb-32c4854fa487 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:31.375099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ba2a6-cb26-4270-92eb-32c4854fa487 None admin] PATH_INFO: `/v3/services` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:31.375757 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ba2a6-cb26-4270-92eb-32c4854fa487 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:31.376061 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ba2a6-cb26-4270-92eb-32c4854fa487 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:31.377453 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ba2a6-cb26-4270-92eb-32c4854fa487 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:31.383003 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 499/1016] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Aug 3 12:39:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:31.389796 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30fc1bc-17c7-4957-b258-5403f60bfc78 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:31.503698 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30fc1bc-17c7-4957-b258-5403f60bfc78 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:31.537837 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae553e-0998-4bbe-be0a-5a46c2c17857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:31.538382 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae553e-0998-4bbe-be0a-5a46c2c17857 None admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:31.538670 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae553e-0998-4bbe-be0a-5a46c2c17857 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:31.538929 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae553e-0998-4bbe-be0a-5a46c2c17857 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:31.539640 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae553e-0998-4bbe-be0a-5a46c2c17857 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:31.540999 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae553e-0998-4bbe-be0a-5a46c2c17857 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:31.562919 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 518/1017] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:39:31 2022] POST /identity/v3/endpoints => generated 334 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:39:32.544375 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a410c-ffcd-4fc7-a557-b42cc0183f35 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:32.544892 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a410c-ffcd-4fc7-a557-b42cc0183f35 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:32.544892 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a410c-ffcd-4fc7-a557-b42cc0183f35 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:32.546367 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 500/1018] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:32.551250 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc4fb9-da05-4f49-a38a-2d5827881051 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:32.551625 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc4fb9-da05-4f49-a38a-2d5827881051 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:32.551795 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc4fb9-da05-4f49-a38a-2d5827881051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:32.570272 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-cacc4fb9-da05-4f49-a38a-2d5827881051 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:32.571462 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-cacc4fb9-da05-4f49-a38a-2d5827881051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:32.582762 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:32.648889 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 519/1019] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:32 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:39:32.671713 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a410c-ffcd-4fc7-a557-b42cc0183f35 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:32.694884 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:32.782769 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a410c-ffcd-4fc7-a557-b42cc0183f35 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:32.817836 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e3130-2cf2-45c3-8535-e05b8ada0076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:32.818377 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e3130-2cf2-45c3-8535-e05b8ada0076 None admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:32.818661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e3130-2cf2-45c3-8535-e05b8ada0076 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:32.818939 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e3130-2cf2-45c3-8535-e05b8ada0076 None admin] PATH_INFO: `/v3/services` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:32.819642 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e3130-2cf2-45c3-8535-e05b8ada0076 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:32.821005 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e3130-2cf2-45c3-8535-e05b8ada0076 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:32.836868 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 501/1020] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Aug 3 12:39:32 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:39:33.368778 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75787b6-0e99-4a58-a6ee-371e13699ede None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:33.369129 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75787b6-0e99-4a58-a6ee-371e13699ede None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:33.369344 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75787b6-0e99-4a58-a6ee-371e13699ede None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:33.371429 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 520/1021] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:33.376401 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f75710-326e-4aae-808a-ae2d2767b92a None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:33.376690 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f75710-326e-4aae-808a-ae2d2767b92a None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:33.376966 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f75710-326e-4aae-808a-ae2d2767b92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:33.395455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-e8f75710-326e-4aae-808a-ae2d2767b92a None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:33.396643 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-e8f75710-326e-4aae-808a-ae2d2767b92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:33.469579 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 502/1022] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:39:33.493689 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75787b6-0e99-4a58-a6ee-371e13699ede None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:33.596932 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75787b6-0e99-4a58-a6ee-371e13699ede None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:33.632193 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66cbb4-114c-4ae2-84ad-680db48db5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:33.632837 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66cbb4-114c-4ae2-84ad-680db48db5f5 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:33.633122 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66cbb4-114c-4ae2-84ad-680db48db5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:33.633393 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66cbb4-114c-4ae2-84ad-680db48db5f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:33.634568 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66cbb4-114c-4ae2-84ad-680db48db5f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:33.636651 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66cbb4-114c-4ae2-84ad-680db48db5f5 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:33.639527 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 521/1023] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:39:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:33.644057 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f75710-326e-4aae-808a-ae2d2767b92a None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:33.652471 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:33.665965 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc17cc-c6a3-4b81-9954-e343d75ac803 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:33.666246 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc17cc-c6a3-4b81-9954-e343d75ac803 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:33.666521 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc17cc-c6a3-4b81-9954-e343d75ac803 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:33.667891 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 522/1024] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:39:33.672590 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cc062-2414-448c-85c9-ad79f3dc4856 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:33.672868 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cc062-2414-448c-85c9-ad79f3dc4856 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:33.673143 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cc062-2414-448c-85c9-ad79f3dc4856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:33.692076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-812cc062-2414-448c-85c9-ad79f3dc4856 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:33.693230 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-812cc062-2414-448c-85c9-ad79f3dc4856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:33.696032 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:33.754665 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f75710-326e-4aae-808a-ae2d2767b92a None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:33.770913 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 523/1025] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:39:33.793870 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812cc062-2414-448c-85c9-ad79f3dc4856 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:33.796066 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186c602-8428-4802-86da-c16167f68072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:33.796686 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186c602-8428-4802-86da-c16167f68072 None admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:33.796969 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186c602-8428-4802-86da-c16167f68072 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:33.797248 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186c602-8428-4802-86da-c16167f68072 None admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:33.797966 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186c602-8428-4802-86da-c16167f68072 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:33.799393 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186c602-8428-4802-86da-c16167f68072 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:33.821982 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 503/1026] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Aug 3 12:39:33 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:39:33.915522 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812cc062-2414-448c-85c9-ad79f3dc4856 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:33.959064 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2308c-58df-458c-935d-3a35a44d9782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:33.960089 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2308c-58df-458c-935d-3a35a44d9782 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:33.960556 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2308c-58df-458c-935d-3a35a44d9782 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:33.961073 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2308c-58df-458c-935d-3a35a44d9782 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:33.971714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:33.976391 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f2308c-58df-458c-935d-3a35a44d9782 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:39:33.982418 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-86f2308c-58df-458c-935d-3a35a44d9782 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 12:39:33.982418 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:33.982418 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:33.982418 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:33.982418 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:33.982418 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:33.982418 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:33.982418 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:33.982418 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:33.982418 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:33.982418 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:33.982418 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:33.982418 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:39:33.982418 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:39:33.982418 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:39:33.982418 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:39:33.983387 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:39:33.983387 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:39:33.983387 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:39:33.983387 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:39:33.983387 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:33.983387 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:33.983387 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:33.983387 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:33.983387 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:33.983387 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:33.983387 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:33.983387 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:33.983387 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:33.983387 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:33.983387 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:33.983387 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:33.984315 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:33.984315 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:33.984315 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:33.984315 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:33.984315 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:39:33.984315 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:39:33.984315 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:39:33.984315 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:39:33.984315 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:39:33.984315 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:39:33.984315 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 12:39:33.984315 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:33.984315 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 524/1027] 10.222.0.46 () {56 vars in 1120 bytes} [Wed Aug 3 12:39:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:33.989878 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186c602-8428-4802-86da-c16167f68072 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:34.055682 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:34.096614 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186c602-8428-4802-86da-c16167f68072 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:34.137725 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6f901-f3ab-4ad3-a766-652144de116e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:34.138447 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6f901-f3ab-4ad3-a766-652144de116e None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:34.138731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6f901-f3ab-4ad3-a766-652144de116e None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:34.139004 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6f901-f3ab-4ad3-a766-652144de116e None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:34.139728 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b6f901-f3ab-4ad3-a766-652144de116e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:34.140031 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b6f901-f3ab-4ad3-a766-652144de116e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:34.141389 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b6f901-f3ab-4ad3-a766-652144de116e None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:34.153604 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 504/1028] 10.222.0.46 () {56 vars in 1115 bytes} [Wed Aug 3 12:39:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:34.156531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2308c-58df-458c-935d-3a35a44d9782 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:34.258396 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2308c-58df-458c-935d-3a35a44d9782 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:34.298876 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd2dd2-a012-4965-a468-efddb32a564f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:34.299514 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd2dd2-a012-4965-a468-efddb32a564f None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:34.299791 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd2dd2-a012-4965-a468-efddb32a564f None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:34.300063 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd2dd2-a012-4965-a468-efddb32a564f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:34.310468 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bd2dd2-a012-4965-a468-efddb32a564f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:34.311917 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bd2dd2-a012-4965-a468-efddb32a564f None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:34.326622 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-88bd2dd2-a012-4965-a468-efddb32a564f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:34.326622 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:34.326622 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:34.326622 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:34.326622 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:34.326622 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:34.326622 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:34.326622 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:34.326622 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:34.326622 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:34.326622 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:34.326622 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:34.326622 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:39:34.326622 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:39:34.326622 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:39:34.327519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:39:34.327519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:34.327519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:34.327519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:34.327519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:34.327519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:34.327519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:34.327519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:34.327519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:34.327519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:34.327519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:34.327519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:34.327519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:34.327519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:34.327519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:34.327519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:34.327519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:34.328426 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:39:34.328426 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:39:34.328426 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:34.328426 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:34.329565 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 525/1029] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:39:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:34.333528 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6f901-f3ab-4ad3-a766-652144de116e None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:34.438097 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6f901-f3ab-4ad3-a766-652144de116e None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:34.461554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:34.473695 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29ab3c-b92f-46aa-ad44-2e3f9f2aa499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:34.474312 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29ab3c-b92f-46aa-ad44-2e3f9f2aa499 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:34.474593 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29ab3c-b92f-46aa-ad44-2e3f9f2aa499 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:34.474870 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29ab3c-b92f-46aa-ad44-2e3f9f2aa499 None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:34.475562 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29ab3c-b92f-46aa-ad44-2e3f9f2aa499 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:34.475868 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29ab3c-b92f-46aa-ad44-2e3f9f2aa499 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:34.477214 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29ab3c-b92f-46aa-ad44-2e3f9f2aa499 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:34.493589 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 505/1030] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:34.495927 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd2dd2-a012-4965-a468-efddb32a564f None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:34.553129 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:34.604420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd2dd2-a012-4965-a468-efddb32a564f None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:34.640849 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a1ecc-60e4-4fd3-bf02-79cdc43593f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:34.641511 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a1ecc-60e4-4fd3-bf02-79cdc43593f4 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:34.641799 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a1ecc-60e4-4fd3-bf02-79cdc43593f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:34.642070 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a1ecc-60e4-4fd3-bf02-79cdc43593f4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:34.650024 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a1ecc-60e4-4fd3-bf02-79cdc43593f4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:34.651535 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a1ecc-60e4-4fd3-bf02-79cdc43593f4 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:34.663165 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-a79a1ecc-60e4-4fd3-bf02-79cdc43593f4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:39:34.663165 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:34.663165 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:34.663165 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:34.663165 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:34.663165 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:34.663165 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:34.663165 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:34.663165 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:34.663165 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:34.663165 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:34.663165 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:34.663165 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:39:34.663165 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:39:34.663165 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:39:34.663165 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:39:34.664074 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:34.664074 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:34.664074 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:39:34.664074 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:39:34.664074 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:39:34.664074 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:39:34.664074 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:34.664074 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:34.664074 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:34.664074 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:34.664074 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:34.664074 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:34.664074 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:34.664074 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:34.664074 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:34.664074 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:34.664074 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:34.664074 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:34.665010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:34.665010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:34.665010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:39:34.665010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:39:34.665010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:39:34.665010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:39:34.665010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:39:34.665010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:39:34.665010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:39:34.665010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:34.665010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 526/1031] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Aug 3 12:39:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:39:34.671861 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29ab3c-b92f-46aa-ad44-2e3f9f2aa499 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:34.774016 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29ab3c-b92f-46aa-ad44-2e3f9f2aa499 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:34.807812 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56ea64-4179-4d57-832f-5538551a1558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:34.809012 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56ea64-4179-4d57-832f-5538551a1558 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:34.809288 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56ea64-4179-4d57-832f-5538551a1558 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:34.809587 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56ea64-4179-4d57-832f-5538551a1558 None admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:34.810374 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56ea64-4179-4d57-832f-5538551a1558 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:34.810678 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56ea64-4179-4d57-832f-5538551a1558 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:34.812084 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56ea64-4179-4d57-832f-5538551a1558 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:34.829134 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 506/1032] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Aug 3 12:39:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:34.834570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a1ecc-60e4-4fd3-bf02-79cdc43593f4 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:34.884231 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432ea9f-2cbe-4feb-b8b3-b50724c1a5f3 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:34.884553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432ea9f-2cbe-4feb-b8b3-b50724c1a5f3 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:34.884873 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432ea9f-2cbe-4feb-b8b3-b50724c1a5f3 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:34.886336 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 507/1033] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:39:34.891480 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9c222-c66c-4613-a51b-0baefd0994bf None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:34.891945 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9c222-c66c-4613-a51b-0baefd0994bf None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:34.892371 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9c222-c66c-4613-a51b-0baefd0994bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:34.911669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-40b9c222-c66c-4613-a51b-0baefd0994bf None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:34.912875 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-40b9c222-c66c-4613-a51b-0baefd0994bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:34.943874 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a1ecc-60e4-4fd3-bf02-79cdc43593f4 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:34.950257 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:34.958171 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:34.982363 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309a104-0837-408a-904b-61b6c2b7d965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:34.982989 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309a104-0837-408a-904b-61b6c2b7d965 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:34.983273 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309a104-0837-408a-904b-61b6c2b7d965 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:34.983552 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309a104-0837-408a-904b-61b6c2b7d965 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:34.991527 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 508/1034] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:39:35.015556 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9c222-c66c-4613-a51b-0baefd0994bf None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:35.058616 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309a104-0837-408a-904b-61b6c2b7d965 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:35.059992 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309a104-0837-408a-904b-61b6c2b7d965 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:35.124118 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9c222-c66c-4613-a51b-0baefd0994bf None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:35.158646 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 527/1035] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:39:34 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:39:35.159763 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd8ec9-65a2-4b4e-8c21-d3669e0bb20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:35.160411 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd8ec9-65a2-4b4e-8c21-d3669e0bb20d None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:35.160691 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd8ec9-65a2-4b4e-8c21-d3669e0bb20d None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:35.160964 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd8ec9-65a2-4b4e-8c21-d3669e0bb20d None admin] PATH_INFO: `/v3/services/image` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:35.161617 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd8ec9-65a2-4b4e-8c21-d3669e0bb20d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:35.162974 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd8ec9-65a2-4b4e-8c21-d3669e0bb20d None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:35.164394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309a104-0837-408a-904b-61b6c2b7d965 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:35.172463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-79cd8ec9-65a2-4b4e-8c21-d3669e0bb20d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 03 12:39:35.172463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:35.172463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:39:35.172463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:39:35.172463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:39:35.172463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:39:35.172463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:39:35.172463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:35.172463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 03 12:39:35.172463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:35.172463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:39:35.172463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:35.172463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:35.172463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:35.172463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:35.172463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:35.172463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:35.173459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:35.173459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:35.173459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:35.173459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:35.173459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:35.173459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:35.173459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:39:35.173459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:39:35.173459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:39:35.173459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:39:35.173459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:35.173459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:35.173459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:35.173459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:35.173459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:35.173459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:35.174355 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:35.174355 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:35.174355 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:35.174355 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:35.174355 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:35.174355 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:35.174355 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:35.174355 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:35.174355 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:35.174355 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:35.174355 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:39:35.174355 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:35.174355 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 03 12:39:35.174355 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:35.177802 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 509/1036] 10.222.0.46 () {56 vars in 1105 bytes} [Wed Aug 3 12:39:35 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:35.179464 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd8ec9-65a2-4b4e-8c21-d3669e0bb20d None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:35.180172 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:35.219593 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:35.276909 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309a104-0837-408a-904b-61b6c2b7d965 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:35.303597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd8ec9-65a2-4b4e-8c21-d3669e0bb20d None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:35.314517 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8629a-07f9-4654-99c3-63a8090aa132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:35.315078 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8629a-07f9-4654-99c3-63a8090aa132 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:35.315344 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8629a-07f9-4654-99c3-63a8090aa132 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:35.315641 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8629a-07f9-4654-99c3-63a8090aa132 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:35.326687 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8629a-07f9-4654-99c3-63a8090aa132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:35.328146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8629a-07f9-4654-99c3-63a8090aa132 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:35.343093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-a3e8629a-07f9-4654-99c3-63a8090aa132 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:35.343093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:35.343093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:35.343093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:35.343093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:35.343093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:35.343093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:35.343093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:35.343093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:35.343093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:35.343093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:35.343093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:35.343093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:39:35.343093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:39:35.343093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:39:35.344016 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:39:35.344016 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:35.344016 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:35.344016 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:35.344016 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:35.344016 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:35.344016 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:35.344016 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:35.344016 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:35.344016 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:35.344016 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:35.344016 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:35.344016 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:35.344016 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:35.344016 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:35.344016 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:35.344016 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:35.345806 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:39:35.345806 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:39:35.345806 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:35.345806 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:35.345806 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 528/1037] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:39:35.347493 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0494e-9491-4048-8fb1-2ed04344216b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:35.348110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0494e-9491-4048-8fb1-2ed04344216b None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:35.348390 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0494e-9491-4048-8fb1-2ed04344216b None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:35.348874 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0494e-9491-4048-8fb1-2ed04344216b None admin] PATH_INFO: `/v3/services` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:35.349420 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0494e-9491-4048-8fb1-2ed04344216b None admin] RBAC: Adding query filter params (name=image) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:35.349712 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8629a-07f9-4654-99c3-63a8090aa132 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:35.349810 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0494e-9491-4048-8fb1-2ed04344216b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:35.351093 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0494e-9491-4048-8fb1-2ed04344216b None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:35.362853 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 510/1038] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:39:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:35.364116 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0494e-9491-4048-8fb1-2ed04344216b None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:35.415498 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:35.456590 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8629a-07f9-4654-99c3-63a8090aa132 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:35.469570 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:35.472446 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0494e-9491-4048-8fb1-2ed04344216b None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:35.493176 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4d11f-80ac-4088-84ae-0d1374994d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:35.493826 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4d11f-80ac-4088-84ae-0d1374994d2c None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:35.494114 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4d11f-80ac-4088-84ae-0d1374994d2c None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:35.494391 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4d11f-80ac-4088-84ae-0d1374994d2c None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:35.495092 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4d11f-80ac-4088-84ae-0d1374994d2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:35.495940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4d11f-80ac-4088-84ae-0d1374994d2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:35.497312 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4d11f-80ac-4088-84ae-0d1374994d2c None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:35.509512 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 529/1039] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:35.514046 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695278fa-c5e8-43fa-891e-8215af50d931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:35.514520 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695278fa-c5e8-43fa-891e-8215af50d931 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:35.514808 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695278fa-c5e8-43fa-891e-8215af50d931 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:35.514907 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4d11f-80ac-4088-84ae-0d1374994d2c None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:35.515080 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695278fa-c5e8-43fa-891e-8215af50d931 None admin] PATH_INFO: `/v3/services` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:35.515769 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695278fa-c5e8-43fa-891e-8215af50d931 None admin] RBAC: Adding query filter params (type=image) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:35.516076 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695278fa-c5e8-43fa-891e-8215af50d931 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:35.517443 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695278fa-c5e8-43fa-891e-8215af50d931 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:35.523146 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 511/1040] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:39:35 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:35.528992 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695278fa-c5e8-43fa-891e-8215af50d931 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:35.626707 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4d11f-80ac-4088-84ae-0d1374994d2c None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:35.636183 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695278fa-c5e8-43fa-891e-8215af50d931 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:35.654605 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:35.667151 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dc14d-c05e-4baf-8533-d4f95157bd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:35.667806 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dc14d-c05e-4baf-8533-d4f95157bd9d None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:35.668087 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dc14d-c05e-4baf-8533-d4f95157bd9d None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:35.668359 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dc14d-c05e-4baf-8533-d4f95157bd9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:35.671729 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c91aa7-8c6c-4b89-a431-88ab4e930458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:35.672607 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c91aa7-8c6c-4b89-a431-88ab4e930458 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:35.673522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c91aa7-8c6c-4b89-a431-88ab4e930458 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:35.673978 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c91aa7-8c6c-4b89-a431-88ab4e930458 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:35.674906 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c91aa7-8c6c-4b89-a431-88ab4e930458 None admin] RBAC: Adding query filter params (interface=public, service_id=7a0d90c76b5e4b11bb92bd4255637e01, region_id=RegionOne) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:35.675156 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8dc14d-c05e-4baf-8533-d4f95157bd9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:35.675599 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c91aa7-8c6c-4b89-a431-88ab4e930458 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:35.676594 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8dc14d-c05e-4baf-8533-d4f95157bd9d None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:35.677327 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c91aa7-8c6c-4b89-a431-88ab4e930458 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:35.683778 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 512/1041] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Aug 3 12:39:35 2022] GET /identity/v3/endpoints?service_id=7a0d90c76b5e4b11bb92bd4255637e01&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:35.688921 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-7e8dc14d-c05e-4baf-8533-d4f95157bd9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:39:35.688921 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:35.688921 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:35.688921 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:35.688921 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:35.688921 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:35.688921 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:35.688921 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:35.688921 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:35.688921 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:35.688921 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:35.688921 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:35.688921 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:39:35.688921 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:39:35.688921 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:39:35.690040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:39:35.690040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:35.690040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:35.690040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:35.690040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:35.690040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:35.690040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:35.690040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:35.690040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:35.690040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:35.690040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:35.690040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:35.690040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:35.690040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:35.690040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:35.690040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:35.690040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:35.691128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:39:35.691128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:39:35.691128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:39:35.691128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:39:35.691128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:39:35.691128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:39:35.691128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:39:35.691128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:35.691128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 530/1042] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:39:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:39:35.692378 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c91aa7-8c6c-4b89-a431-88ab4e930458 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:35.697268 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dc14d-c05e-4baf-8533-d4f95157bd9d None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:35.723812 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:35.803775 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c91aa7-8c6c-4b89-a431-88ab4e930458 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:35.805219 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dc14d-c05e-4baf-8533-d4f95157bd9d None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:35.838708 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d911bd2-b843-47f7-b00a-e2f8f0a81a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:35.839902 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d911bd2-b843-47f7-b00a-e2f8f0a81a85 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:35.840241 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d911bd2-b843-47f7-b00a-e2f8f0a81a85 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:35.840467 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d911bd2-b843-47f7-b00a-e2f8f0a81a85 None admin] PATH_INFO: `/v3/services` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:35.841096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d911bd2-b843-47f7-b00a-e2f8f0a81a85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:35.842495 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d911bd2-b843-47f7-b00a-e2f8f0a81a85 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:35.843590 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2b3b8-7954-45b8-a05a-b6d513e90e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:35.844391 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2b3b8-7954-45b8-a05a-b6d513e90e1b None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:35.844674 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2b3b8-7954-45b8-a05a-b6d513e90e1b None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:35.844948 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2b3b8-7954-45b8-a05a-b6d513e90e1b None admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:35.845876 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2b3b8-7954-45b8-a05a-b6d513e90e1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:35.846099 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2b3b8-7954-45b8-a05a-b6d513e90e1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:35.847568 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2b3b8-7954-45b8-a05a-b6d513e90e1b None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:35.857768 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 513/1043] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Aug 3 12:39:35 2022] GET /identity/v3/services => generated 1957 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:39:35.868991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 531/1044] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 3 12:39:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:35.875323 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d911bd2-b843-47f7-b00a-e2f8f0a81a85 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:35.937588 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092e850-61b4-4e30-9951-18902206af28 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:35.937776 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092e850-61b4-4e30-9951-18902206af28 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:35.938229 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092e850-61b4-4e30-9951-18902206af28 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:35.940157 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 532/1045] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:39:35.946210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c16d10-3175-4a5d-8f56-0630e5cb3e0a None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:35.946718 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c16d10-3175-4a5d-8f56-0630e5cb3e0a None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:35.947218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c16d10-3175-4a5d-8f56-0630e5cb3e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:35.969283 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-b8c16d10-3175-4a5d-8f56-0630e5cb3e0a None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:35.970589 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-b8c16d10-3175-4a5d-8f56-0630e5cb3e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:35.979197 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:35.991548 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d911bd2-b843-47f7-b00a-e2f8f0a81a85 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:36.016378 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:36.031216 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5c7bc-38b9-424c-b370-9ff8d6417056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:36.031835 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5c7bc-38b9-424c-b370-9ff8d6417056 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:36.032114 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5c7bc-38b9-424c-b370-9ff8d6417056 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:36.032386 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5c7bc-38b9-424c-b370-9ff8d6417056 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:36.033177 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5c7bc-38b9-424c-b370-9ff8d6417056 None admin] RBAC: Adding query filter params (role.id=a7ac56aa0b134a9e925725f41c54d4b3, scope.project.id=6ac833dfff634496816842c851545d21, user.id=dcf670ff4f62486dbf70cf6ea0f08bbb) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:36.033845 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5c7bc-38b9-424c-b370-9ff8d6417056 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:36.034934 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5c7bc-38b9-424c-b370-9ff8d6417056 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:36.041422 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 514/1046] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:39:35 2022] GET /identity/v3/role_assignments?user.id=dcf670ff4f62486dbf70cf6ea0f08bbb&scope.project.id=6ac833dfff634496816842c851545d21&role.id=a7ac56aa0b134a9e925725f41c54d4b3 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:36.052937 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 533/1047] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:35 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:39:36.076639 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5c7bc-38b9-424c-b370-9ff8d6417056 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:36.188969 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5c7bc-38b9-424c-b370-9ff8d6417056 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:36.225462 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63348ddc-5418-4e84-879d-9b1768d83416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:36.226146 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63348ddc-5418-4e84-879d-9b1768d83416 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:36.226429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63348ddc-5418-4e84-879d-9b1768d83416 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:36.226704 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63348ddc-5418-4e84-879d-9b1768d83416 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:36.237127 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63348ddc-5418-4e84-879d-9b1768d83416 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:39:36.243537 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-63348ddc-5418-4e84-879d-9b1768d83416 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:39:36.243537 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:36.243537 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:36.243537 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:36.243537 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:36.243537 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:36.243537 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:36.243537 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:36.243537 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:36.243537 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:36.243537 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:36.243537 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:36.243537 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:39:36.243537 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:39:36.243537 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:39:36.243537 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:39:36.244478 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:39:36.244478 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:39:36.244478 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:39:36.244478 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:39:36.244478 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:36.244478 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:36.244478 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:36.244478 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:36.244478 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:36.244478 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:36.244478 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:36.244478 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:36.244478 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:36.244478 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:36.244478 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:36.244478 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:36.245449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:36.245449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:36.245449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:36.245449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:36.245449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:39:36.245449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:39:36.245449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:39:36.245449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:39:36.245449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:39:36.245449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:39:36.245449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:39:36.245449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:36.246800 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 515/1048] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 3 12:39:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:36.251015 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c16d10-3175-4a5d-8f56-0630e5cb3e0a None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:36.357620 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c16d10-3175-4a5d-8f56-0630e5cb3e0a None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:36.392633 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd1d7a-f8c0-453c-b155-58b3b23bd0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:36.393255 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd1d7a-f8c0-453c-b155-58b3b23bd0c3 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:36.393567 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd1d7a-f8c0-453c-b155-58b3b23bd0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:36.393845 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd1d7a-f8c0-453c-b155-58b3b23bd0c3 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:36.394560 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bd1d7a-f8c0-453c-b155-58b3b23bd0c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:36.394861 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bd1d7a-f8c0-453c-b155-58b3b23bd0c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:36.396224 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bd1d7a-f8c0-453c-b155-58b3b23bd0c3 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:36.408917 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 534/1049] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:39:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:36.410549 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63348ddc-5418-4e84-879d-9b1768d83416 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:36.429414 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:36.515725 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63348ddc-5418-4e84-879d-9b1768d83416 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:36.549341 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12501fe3-d4e7-4d3b-ba15-5032b12ba972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:36.550030 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12501fe3-d4e7-4d3b-ba15-5032b12ba972 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:36.550311 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12501fe3-d4e7-4d3b-ba15-5032b12ba972 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:36.550588 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12501fe3-d4e7-4d3b-ba15-5032b12ba972 None admin] PATH_INFO: `/v3/users/87ee2acb67a14c9e82f0bdfd6248bc0d` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:36.564537 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12501fe3-d4e7-4d3b-ba15-5032b12ba972 None admin] RBAC: Authorizing `identity:get_user(user_id=87ee2acb67a14c9e82f0bdfd6248bc0d)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:36.566016 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12501fe3-d4e7-4d3b-ba15-5032b12ba972 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:36.572386 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 516/1050] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:39:36 2022] GET /identity/v3/users/87ee2acb67a14c9e82f0bdfd6248bc0d => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:36.574565 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd1d7a-f8c0-453c-b155-58b3b23bd0c3 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:36.611373 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:36.679246 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd1d7a-f8c0-453c-b155-58b3b23bd0c3 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:36.713527 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab3419-4b5a-4277-80b6-95431d75f72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:36.714172 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab3419-4b5a-4277-80b6-95431d75f72e None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:36.714457 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab3419-4b5a-4277-80b6-95431d75f72e None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:36.714734 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab3419-4b5a-4277-80b6-95431d75f72e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:36.782789 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab3419-4b5a-4277-80b6-95431d75f72e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:36.784163 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab3419-4b5a-4277-80b6-95431d75f72e None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:36.817935 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:36.884949 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 535/1051] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:39:36 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:39:36.890738 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12501fe3-d4e7-4d3b-ba15-5032b12ba972 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:36.967531 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:36.997215 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12501fe3-d4e7-4d3b-ba15-5032b12ba972 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:37.031021 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676418c-4b02-4945-953d-32cdf9251208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:37.031666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676418c-4b02-4945-953d-32cdf9251208 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:37.031946 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676418c-4b02-4945-953d-32cdf9251208 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:37.032222 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676418c-4b02-4945-953d-32cdf9251208 None admin] PATH_INFO: `/v3/projects/a2e08d671112428c81142df5cbdfeb1c` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:37.033425 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676418c-4b02-4945-953d-32cdf9251208 None admin] RBAC: Authorizing `identity:get_project(project_id=a2e08d671112428c81142df5cbdfeb1c)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:37.034819 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676418c-4b02-4945-953d-32cdf9251208 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:37.041549 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 517/1052] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:39:36 2022] GET /identity/v3/projects/a2e08d671112428c81142df5cbdfeb1c => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:37.043457 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab3419-4b5a-4277-80b6-95431d75f72e None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:37.147882 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab3419-4b5a-4277-80b6-95431d75f72e None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:37.183371 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44c8a1-0a99-4f70-91eb-e6df07bf220d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:37.183982 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44c8a1-0a99-4f70-91eb-e6df07bf220d None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:37.184258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44c8a1-0a99-4f70-91eb-e6df07bf220d None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:37.184527 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44c8a1-0a99-4f70-91eb-e6df07bf220d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:37.185318 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44c8a1-0a99-4f70-91eb-e6df07bf220d None admin] RBAC: Adding query filter params (role.id=0e57d142f86c471883fc07a89fe66ec8, scope.project.id=a2e08d671112428c81142df5cbdfeb1c, user.id=87ee2acb67a14c9e82f0bdfd6248bc0d) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:37.185656 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44c8a1-0a99-4f70-91eb-e6df07bf220d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:37.187205 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44c8a1-0a99-4f70-91eb-e6df07bf220d None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:37.190094 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:37.201994 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 536/1053] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:39:37 2022] GET /identity/v3/role_assignments?user.id=87ee2acb67a14c9e82f0bdfd6248bc0d&scope.project.id=a2e08d671112428c81142df5cbdfeb1c&role.id=0e57d142f86c471883fc07a89fe66ec8 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:37.920995 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b721983-8dbb-455d-90a3-3e98224a48f7 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:37.921747 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b721983-8dbb-455d-90a3-3e98224a48f7 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:37.921747 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b721983-8dbb-455d-90a3-3e98224a48f7 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:37.923084 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 518/1054] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:37.928179 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dbf7e-af96-4091-95d8-9f37e5abce1f None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:37.928559 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dbf7e-af96-4091-95d8-9f37e5abce1f None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:37.928732 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dbf7e-af96-4091-95d8-9f37e5abce1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:37.947019 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-713dbf7e-af96-4091-95d8-9f37e5abce1f None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:37.948224 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-713dbf7e-af96-4091-95d8-9f37e5abce1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:38.009247 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fb347-e9b3-4ea8-8e83-7c73ea0a9dca None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:38.009591 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fb347-e9b3-4ea8-8e83-7c73ea0a9dca None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:38.009816 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fb347-e9b3-4ea8-8e83-7c73ea0a9dca None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:38.011583 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 519/1055] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:39:38.016470 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5f899-f274-4ff1-b4a7-d96e4d2a6917 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:38.016761 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5f899-f274-4ff1-b4a7-d96e4d2a6917 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:38.017041 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5f899-f274-4ff1-b4a7-d96e4d2a6917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:38.019034 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 537/1056] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:37 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:39:38.038287 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-bbb5f899-f274-4ff1-b4a7-d96e4d2a6917 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:38.039494 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-bbb5f899-f274-4ff1-b4a7-d96e4d2a6917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:38.041891 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713dbf7e-af96-4091-95d8-9f37e5abce1f None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:38.115754 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 520/1057] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:38 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:39:38.137349 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5f899-f274-4ff1-b4a7-d96e4d2a6917 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:38.149326 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713dbf7e-af96-4091-95d8-9f37e5abce1f None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:38.181751 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:38.189392 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18dfcb0-a028-40c0-8d42-d00ae708cf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:38.190347 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dfcb0-a028-40c0-8d42-d00ae708cf9a None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:38.190627 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dfcb0-a028-40c0-8d42-d00ae708cf9a None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:38.190901 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dfcb0-a028-40c0-8d42-d00ae708cf9a None admin] PATH_INFO: `/v3/services/image` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:38.191523 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18dfcb0-a028-40c0-8d42-d00ae708cf9a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:38.192879 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18dfcb0-a028-40c0-8d42-d00ae708cf9a None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:38.203425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-a18dfcb0-a028-40c0-8d42-d00ae708cf9a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 03 12:39:38.203425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:38.203425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:39:38.203425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:39:38.203425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:39:38.203425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:39:38.203425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:39:38.203425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:38.203425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 03 12:39:38.203425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:38.203425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:39:38.203425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:38.203425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:38.203425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:38.203425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:38.203425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:38.203425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:38.204445 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:38.204445 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:38.204445 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:38.204445 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:38.204445 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:38.204445 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:38.204445 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:39:38.204445 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:39:38.204445 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:39:38.204445 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:39:38.204445 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:38.204445 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:38.204445 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:38.204445 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:38.204445 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:38.204445 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:38.205277 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:38.205277 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:38.205277 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:38.205277 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:38.205277 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:38.205277 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:38.205277 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:38.205277 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:38.205277 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:38.205277 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:38.205277 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:39:38.205277 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:39:38.205277 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 03 12:39:38.205277 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:38.205277 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 538/1058] 10.222.0.46 () {56 vars in 1105 bytes} [Wed Aug 3 12:39:38 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:39:38.210448 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18dfcb0-a028-40c0-8d42-d00ae708cf9a None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:38.211676 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:38.245073 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5f899-f274-4ff1-b4a7-d96e4d2a6917 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:38.291969 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b1f07-5065-487c-90b7-04c8c777d537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:38.292661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b1f07-5065-487c-90b7-04c8c777d537 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:38.292948 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b1f07-5065-487c-90b7-04c8c777d537 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:38.293221 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b1f07-5065-487c-90b7-04c8c777d537 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:38.304172 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b1f07-5065-487c-90b7-04c8c777d537 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:39:38.309204 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-e92b1f07-5065-487c-90b7-04c8c777d537 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 12:39:38.309204 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:38.309204 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:38.309204 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:38.309204 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:38.309204 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:38.309204 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:38.309204 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:38.309204 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:38.309204 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:38.309204 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:38.309204 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:38.309204 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:39:38.309204 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:39:38.309204 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:39:38.309204 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:39:38.310292 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:39:38.310292 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:39:38.310292 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:39:38.310292 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:39:38.310292 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:38.310292 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:38.310292 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:38.310292 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:38.310292 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:38.310292 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:38.310292 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:38.310292 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:38.310292 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:38.310292 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:38.310292 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:38.310292 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:38.311131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:38.311131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:38.311131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:38.311131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:38.311131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:39:38.311131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:39:38.311131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:39:38.311131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:39:38.311131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:39:38.311131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:39:38.311131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 12:39:38.311131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:38.311131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 521/1059] 10.222.0.46 () {56 vars in 1120 bytes} [Wed Aug 3 12:39:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:39:38.316294 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b1f07-5065-487c-90b7-04c8c777d537 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:38.326596 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18dfcb0-a028-40c0-8d42-d00ae708cf9a None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:38.363189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866436b-f918-4363-bcb8-2351ca5e34fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:38.363810 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866436b-f918-4363-bcb8-2351ca5e34fd None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:38.364093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866436b-f918-4363-bcb8-2351ca5e34fd None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:38.364366 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866436b-f918-4363-bcb8-2351ca5e34fd None admin] PATH_INFO: `/v3/services` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:38.365077 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866436b-f918-4363-bcb8-2351ca5e34fd None admin] RBAC: Adding query filter params (name=image) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:38.365348 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866436b-f918-4363-bcb8-2351ca5e34fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:38.367007 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866436b-f918-4363-bcb8-2351ca5e34fd None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:38.376485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 539/1060] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:39:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:38.377524 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866436b-f918-4363-bcb8-2351ca5e34fd None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:38.427987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b1f07-5065-487c-90b7-04c8c777d537 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:38.438241 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:38.460311 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:38.466540 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35452832-756b-4020-aca8-467aeaefd4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:38.467225 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35452832-756b-4020-aca8-467aeaefd4bc None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:38.467505 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35452832-756b-4020-aca8-467aeaefd4bc None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:38.467800 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35452832-756b-4020-aca8-467aeaefd4bc None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:38.468519 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35452832-756b-4020-aca8-467aeaefd4bc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:38.468818 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35452832-756b-4020-aca8-467aeaefd4bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:38.470214 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35452832-756b-4020-aca8-467aeaefd4bc None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:38.478389 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 522/1061] 10.222.0.46 () {56 vars in 1115 bytes} [Wed Aug 3 12:39:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:38.483988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35452832-756b-4020-aca8-467aeaefd4bc None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:38.489389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866436b-f918-4363-bcb8-2351ca5e34fd None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:38.526033 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea599f04-5b35-4d90-a625-943fcd513f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:38.527307 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea599f04-5b35-4d90-a625-943fcd513f25 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:38.527600 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea599f04-5b35-4d90-a625-943fcd513f25 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:38.527874 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea599f04-5b35-4d90-a625-943fcd513f25 None admin] PATH_INFO: `/v3/services` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:38.528684 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea599f04-5b35-4d90-a625-943fcd513f25 None admin] RBAC: Adding query filter params (type=image) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:38.528989 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea599f04-5b35-4d90-a625-943fcd513f25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:38.530544 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea599f04-5b35-4d90-a625-943fcd513f25 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:38.535737 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 540/1062] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:39:38 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:38.541656 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea599f04-5b35-4d90-a625-943fcd513f25 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:38.597159 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35452832-756b-4020-aca8-467aeaefd4bc None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:38.634251 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd8188-902e-4174-902b-fd31cae4d19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:38.634906 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd8188-902e-4174-902b-fd31cae4d19f None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:38.635452 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd8188-902e-4174-902b-fd31cae4d19f None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:38.635785 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd8188-902e-4174-902b-fd31cae4d19f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:38.647621 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd8188-902e-4174-902b-fd31cae4d19f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:38.649046 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd8188-902e-4174-902b-fd31cae4d19f None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:38.655285 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea599f04-5b35-4d90-a625-943fcd513f25 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:38.663553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-c2bd8188-902e-4174-902b-fd31cae4d19f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:38.663553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:38.663553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:38.663553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:38.663553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:38.663553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:38.663553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:38.663553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:38.663553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:38.663553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:38.663553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:38.663553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:38.663553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:39:38.663553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:39:38.663553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:39:38.664457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:39:38.664457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:38.664457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:38.664457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:38.664457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:38.664457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:38.664457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:38.664457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:38.664457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:38.664457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:38.664457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:38.664457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:38.664457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:38.664457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:38.664457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:38.664457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:38.664457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:38.665362 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:39:38.665362 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:39:38.665362 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:38.665362 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:38.669511 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 523/1063] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:39:38.670408 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd8188-902e-4174-902b-fd31cae4d19f None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:38.684167 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:38.697294 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f59c9-8dc9-40d4-b8f8-2bf9be84b05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:38.697867 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f59c9-8dc9-40d4-b8f8-2bf9be84b05d None admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:38.698145 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f59c9-8dc9-40d4-b8f8-2bf9be84b05d None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:38.699068 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f59c9-8dc9-40d4-b8f8-2bf9be84b05d None admin] PATH_INFO: `/v3/endpoints` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:38.699916 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f59c9-8dc9-40d4-b8f8-2bf9be84b05d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:38.701401 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f59c9-8dc9-40d4-b8f8-2bf9be84b05d None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:38.720196 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:38.732509 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 541/1064] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:39:38 2022] POST /identity/v3/endpoints => generated 327 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:39:38.788320 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd8188-902e-4174-902b-fd31cae4d19f None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:38.832935 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f503db-7f9d-41ec-a7ba-682284321721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:38.833606 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f503db-7f9d-41ec-a7ba-682284321721 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:38.833894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f503db-7f9d-41ec-a7ba-682284321721 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:38.834171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f503db-7f9d-41ec-a7ba-682284321721 None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:38.834884 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f503db-7f9d-41ec-a7ba-682284321721 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:38.835193 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f503db-7f9d-41ec-a7ba-682284321721 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:38.836595 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f503db-7f9d-41ec-a7ba-682284321721 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:38.854674 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 524/1065] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:38.856217 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f59c9-8dc9-40d4-b8f8-2bf9be84b05d None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:38.969785 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f59c9-8dc9-40d4-b8f8-2bf9be84b05d None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:39.005193 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1edff-8fe8-4228-874e-e88a2f486dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:39.005863 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1edff-8fe8-4228-874e-e88a2f486dc0 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:39.006145 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1edff-8fe8-4228-874e-e88a2f486dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:39.006416 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1edff-8fe8-4228-874e-e88a2f486dc0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:39.014301 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1edff-8fe8-4228-874e-e88a2f486dc0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:39.015740 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1edff-8fe8-4228-874e-e88a2f486dc0 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:39.027143 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-baa1edff-8fe8-4228-874e-e88a2f486dc0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:39:39.027143 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:39.027143 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:39.027143 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:39.027143 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:39.027143 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:39.027143 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:39.027143 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:39.027143 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:39.027143 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:39.027143 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:39.027143 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:39.027143 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:39:39.027143 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:39:39.027143 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:39:39.027143 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:39:39.028076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:39.028076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:39.028076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:39:39.028076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:39:39.028076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:39:39.028076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:39:39.028076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:39.028076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:39.028076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:39.028076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:39.028076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:39.028076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:39.028076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:39.028076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:39.028076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:39.028076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:39.028076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:39.028076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:39.029013 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:39.029013 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:39.029013 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:39:39.029013 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:39:39.029013 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:39:39.029013 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:39:39.029013 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:39:39.029013 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:39:39.029013 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:39:39.029013 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:39.029013 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 542/1066] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Aug 3 12:39:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:39.033959 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f503db-7f9d-41ec-a7ba-682284321721 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:39.136348 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f503db-7f9d-41ec-a7ba-682284321721 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:39.138035 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:39.172997 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793ce8d-41ab-4ead-bc02-93d7a63cd653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:39.173653 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793ce8d-41ab-4ead-bc02-93d7a63cd653 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:39.173936 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793ce8d-41ab-4ead-bc02-93d7a63cd653 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:39.174211 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793ce8d-41ab-4ead-bc02-93d7a63cd653 None admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:39.175006 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793ce8d-41ab-4ead-bc02-93d7a63cd653 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:39.175313 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793ce8d-41ab-4ead-bc02-93d7a63cd653 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:39.176729 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793ce8d-41ab-4ead-bc02-93d7a63cd653 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:39.202554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 525/1067] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Aug 3 12:39:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:39.203738 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1edff-8fe8-4228-874e-e88a2f486dc0 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:39.204360 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0d062-9382-406f-8bfa-729064131ab7 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:39.204658 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0d062-9382-406f-8bfa-729064131ab7 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:39.204941 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0d062-9382-406f-8bfa-729064131ab7 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:39.206509 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 526/1068] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:39:39.211391 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488448b5-7606-4e4e-bec6-60599727b93c None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:39.211686 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488448b5-7606-4e4e-bec6-60599727b93c None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:39.211956 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488448b5-7606-4e4e-bec6-60599727b93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:39.231251 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-488448b5-7606-4e4e-bec6-60599727b93c None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:39.232363 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-488448b5-7606-4e4e-bec6-60599727b93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:39.252625 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:39.315254 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 527/1069] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:39:39.317632 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1edff-8fe8-4228-874e-e88a2f486dc0 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:39.338529 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488448b5-7606-4e4e-bec6-60599727b93c None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:39.354560 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a93e9c-5588-4b6c-aae8-d6fac6a56241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:39.355746 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a93e9c-5588-4b6c-aae8-d6fac6a56241 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:39.356033 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a93e9c-5588-4b6c-aae8-d6fac6a56241 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:39.356311 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a93e9c-5588-4b6c-aae8-d6fac6a56241 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:39.367682 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a93e9c-5588-4b6c-aae8-d6fac6a56241 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:39.369174 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a93e9c-5588-4b6c-aae8-d6fac6a56241 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:39.384729 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-05a93e9c-5588-4b6c-aae8-d6fac6a56241 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:39.384729 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:39.384729 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:39.384729 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:39.384729 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:39.384729 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:39.384729 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:39.384729 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:39.384729 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:39.384729 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:39.384729 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:39.384729 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:39.384729 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:39:39.384729 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:39:39.384729 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:39:39.385735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:39:39.385735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:39.385735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:39.385735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:39.385735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:39.385735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:39.385735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:39.385735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:39.385735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:39.385735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:39.385735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:39.385735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:39.385735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:39.385735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:39.385735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:39.385735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:39.385735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:39.386688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:39:39.386688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:39:39.386688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:39.386688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:39.386688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 543/1070] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:39:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:39.392237 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a93e9c-5588-4b6c-aae8-d6fac6a56241 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:39.450327 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:39.462118 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488448b5-7606-4e4e-bec6-60599727b93c None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:39.494186 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:39.499061 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4d3ae-3d48-4562-938e-3f677f1ca365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:39.499707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4d3ae-3d48-4562-938e-3f677f1ca365 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:39.499993 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4d3ae-3d48-4562-938e-3f677f1ca365 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:39.500275 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4d3ae-3d48-4562-938e-3f677f1ca365 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:39.506582 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a93e9c-5588-4b6c-aae8-d6fac6a56241 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:39.510824 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4d3ae-3d48-4562-938e-3f677f1ca365 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:39:39.515762 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-93a4d3ae-3d48-4562-938e-3f677f1ca365 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:39:39.515762 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:39.515762 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:39.515762 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:39.515762 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:39.515762 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:39.515762 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:39.515762 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:39.515762 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:39.515762 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:39.515762 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:39.515762 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:39.515762 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:39:39.515762 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:39:39.515762 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:39:39.515762 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:39:39.516691 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:39:39.516691 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:39:39.516691 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:39:39.516691 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:39:39.516691 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:39.516691 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:39.516691 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:39.516691 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:39.516691 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:39.516691 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:39.516691 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:39.516691 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:39.516691 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:39.516691 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:39.516691 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:39.516691 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:39.517666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:39.517666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:39.517666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:39.517666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:39.517666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:39:39.517666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:39:39.517666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:39:39.517666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:39:39.517666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:39:39.517666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:39:39.517666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:39:39.517666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:39.517666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 528/1071] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 3 12:39:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:39.522940 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4d3ae-3d48-4562-938e-3f677f1ca365 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:39.550090 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24c593-9091-4704-b842-238b06037906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:39.550711 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24c593-9091-4704-b842-238b06037906 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:39.550993 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24c593-9091-4704-b842-238b06037906 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:39.551268 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24c593-9091-4704-b842-238b06037906 None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:39.551972 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab24c593-9091-4704-b842-238b06037906 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:39.552280 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab24c593-9091-4704-b842-238b06037906 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:39.553714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab24c593-9091-4704-b842-238b06037906 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:39.571451 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 544/1072] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:39.572524 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24c593-9091-4704-b842-238b06037906 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:39.637689 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4d3ae-3d48-4562-938e-3f677f1ca365 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:39.675364 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b3ec4-4bd1-4d1a-83df-22d8cb665f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:39.676560 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b3ec4-4bd1-4d1a-83df-22d8cb665f62 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:39.677050 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b3ec4-4bd1-4d1a-83df-22d8cb665f62 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:39.678009 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b3ec4-4bd1-4d1a-83df-22d8cb665f62 None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:39.678967 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b3ec4-4bd1-4d1a-83df-22d8cb665f62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:39.679475 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b3ec4-4bd1-4d1a-83df-22d8cb665f62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:39.681105 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b3ec4-4bd1-4d1a-83df-22d8cb665f62 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:39.692034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 529/1073] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:39:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:39.696071 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24c593-9091-4704-b842-238b06037906 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:39.699131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b3ec4-4bd1-4d1a-83df-22d8cb665f62 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:39.716108 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:39.736460 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba7569-5ef5-4464-92ef-9875a0afdb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:39.737176 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba7569-5ef5-4464-92ef-9875a0afdb6d None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:39.737465 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba7569-5ef5-4464-92ef-9875a0afdb6d None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:39.737781 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba7569-5ef5-4464-92ef-9875a0afdb6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:39.746922 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba7569-5ef5-4464-92ef-9875a0afdb6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:39.748310 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba7569-5ef5-4464-92ef-9875a0afdb6d None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:39.761577 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-2bba7569-5ef5-4464-92ef-9875a0afdb6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:39:39.761577 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:39.761577 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:39.761577 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:39.761577 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:39.761577 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:39.761577 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:39.761577 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:39.761577 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:39.761577 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:39.761577 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:39.761577 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:39.761577 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:39:39.761577 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:39:39.761577 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:39:39.762858 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:39:39.762858 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:39.762858 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:39.762858 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:39.762858 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:39.762858 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:39.762858 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:39.762858 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:39.762858 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:39.762858 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:39.762858 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:39.762858 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:39.762858 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:39.762858 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:39.762858 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:39.762858 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:39.762858 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:39.763752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:39:39.763752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:39:39.763752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:39:39.763752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:39:39.763752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:39:39.763752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:39:39.763752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:39:39.763752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:39.767813 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 545/1074] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:39:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:39.768742 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba7569-5ef5-4464-92ef-9875a0afdb6d None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:39.783574 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:39.822164 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b3ec4-4bd1-4d1a-83df-22d8cb665f62 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:39.862787 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48aaee-5b17-45aa-aa4a-910e416ccde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:39.863671 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48aaee-5b17-45aa-aa4a-910e416ccde7 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:39.863902 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48aaee-5b17-45aa-aa4a-910e416ccde7 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:39.864186 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48aaee-5b17-45aa-aa4a-910e416ccde7 None admin] PATH_INFO: `/v3/users/87ee2acb67a14c9e82f0bdfd6248bc0d` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:39.865835 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48aaee-5b17-45aa-aa4a-910e416ccde7 None admin] RBAC: Authorizing `identity:get_user(user_id=87ee2acb67a14c9e82f0bdfd6248bc0d)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:39.867603 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48aaee-5b17-45aa-aa4a-910e416ccde7 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:39.869955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 530/1075] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:39:39 2022] GET /identity/v3/users/87ee2acb67a14c9e82f0bdfd6248bc0d => generated 285 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:39.876458 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48aaee-5b17-45aa-aa4a-910e416ccde7 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:39.884487 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba7569-5ef5-4464-92ef-9875a0afdb6d None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:39.925188 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b00184-ace5-4ae2-a795-2d3f54dd0a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:39.925865 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b00184-ace5-4ae2-a795-2d3f54dd0a8b None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:39.926131 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b00184-ace5-4ae2-a795-2d3f54dd0a8b None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:39.926410 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b00184-ace5-4ae2-a795-2d3f54dd0a8b None admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:39.927169 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b00184-ace5-4ae2-a795-2d3f54dd0a8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:39.927479 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b00184-ace5-4ae2-a795-2d3f54dd0a8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:39.928967 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b00184-ace5-4ae2-a795-2d3f54dd0a8b None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:39.945533 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 546/1076] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 3 12:39:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:39.948839 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b00184-ace5-4ae2-a795-2d3f54dd0a8b None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:39.983436 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:40.009472 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48aaee-5b17-45aa-aa4a-910e416ccde7 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:40.026328 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:40.056203 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e359d-46c0-48d9-8f98-b0b846d87e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:40.056876 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e359d-46c0-48d9-8f98-b0b846d87e0c None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:40.057127 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e359d-46c0-48d9-8f98-b0b846d87e0c None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:40.057408 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e359d-46c0-48d9-8f98-b0b846d87e0c None admin] PATH_INFO: `/v3/projects/a2e08d671112428c81142df5cbdfeb1c` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:40.059152 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e359d-46c0-48d9-8f98-b0b846d87e0c None admin] RBAC: Authorizing `identity:get_project(project_id=a2e08d671112428c81142df5cbdfeb1c)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:40.060622 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e359d-46c0-48d9-8f98-b0b846d87e0c None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:40.062477 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 531/1077] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:39:39 2022] GET /identity/v3/projects/a2e08d671112428c81142df5cbdfeb1c => generated 311 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:40.062590 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b00184-ace5-4ae2-a795-2d3f54dd0a8b None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:40.068289 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e359d-46c0-48d9-8f98-b0b846d87e0c None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:40.103281 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c2829-c488-4256-a630-b00cfda193eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:40.103960 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c2829-c488-4256-a630-b00cfda193eb None admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:40.104246 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c2829-c488-4256-a630-b00cfda193eb None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:40.104551 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c2829-c488-4256-a630-b00cfda193eb None admin] PATH_INFO: `/v3/projects/6ac833dfff634496816842c851545d21/users/dcf670ff4f62486dbf70cf6ea0f08bbb/roles/a7ac56aa0b134a9e925725f41c54d4b3` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:40.107089 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c2829-c488-4256-a630-b00cfda193eb None admin] RBAC: Authorizing `identity:create_grant(project_id=6ac833dfff634496816842c851545d21, user_id=dcf670ff4f62486dbf70cf6ea0f08bbb, role_id=a7ac56aa0b134a9e925725f41c54d4b3)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:40.108544 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c2829-c488-4256-a630-b00cfda193eb None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:40.133528 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 547/1078] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 3 12:39:39 2022] PUT /identity/v3/projects/6ac833dfff634496816842c851545d21/users/dcf670ff4f62486dbf70cf6ea0f08bbb/roles/a7ac56aa0b134a9e925725f41c54d4b3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:39:40.199865 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e359d-46c0-48d9-8f98-b0b846d87e0c None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:40.239858 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e568ab-ec3b-4b6c-885f-be1443cd9315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:40.240807 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e568ab-ec3b-4b6c-885f-be1443cd9315 None admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:40.241088 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e568ab-ec3b-4b6c-885f-be1443cd9315 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:40.241367 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e568ab-ec3b-4b6c-885f-be1443cd9315 None admin] PATH_INFO: `/v3/projects/a2e08d671112428c81142df5cbdfeb1c/users/87ee2acb67a14c9e82f0bdfd6248bc0d/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:40.243436 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e568ab-ec3b-4b6c-885f-be1443cd9315 None admin] RBAC: Authorizing `identity:create_grant(project_id=a2e08d671112428c81142df5cbdfeb1c, user_id=87ee2acb67a14c9e82f0bdfd6248bc0d, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:40.244895 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e568ab-ec3b-4b6c-885f-be1443cd9315 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:40.262097 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 532/1079] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 3 12:39:40 2022] PUT /identity/v3/projects/a2e08d671112428c81142df5cbdfeb1c/users/87ee2acb67a14c9e82f0bdfd6248bc0d/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:39:40.879899 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21e836-4e12-457f-89d8-c51699c473a2 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:40.880186 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21e836-4e12-457f-89d8-c51699c473a2 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:40.880468 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21e836-4e12-457f-89d8-c51699c473a2 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:40.882142 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 548/1080] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:40.887823 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb4656-0bfd-46ce-9294-027d51d53951 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:40.888109 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb4656-0bfd-46ce-9294-027d51d53951 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:40.888381 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb4656-0bfd-46ce-9294-027d51d53951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:40.913515 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-f8fb4656-0bfd-46ce-9294-027d51d53951 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:40.914708 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-f8fb4656-0bfd-46ce-9294-027d51d53951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:40.916689 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:40.989137 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 533/1081] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:39:41.012270 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21e836-4e12-457f-89d8-c51699c473a2 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:41.113925 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21e836-4e12-457f-89d8-c51699c473a2 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:41.148548 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:41.157085 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20b508-b096-479f-b021-de5169d13456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:41.158287 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20b508-b096-479f-b021-de5169d13456 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:41.158784 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20b508-b096-479f-b021-de5169d13456 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:41.159296 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20b508-b096-479f-b021-de5169d13456 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:41.230480 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20b508-b096-479f-b021-de5169d13456 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:41.232290 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20b508-b096-479f-b021-de5169d13456 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:41.357598 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 549/1082] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:39:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:39:41.365350 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb4656-0bfd-46ce-9294-027d51d53951 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:41.467211 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb4656-0bfd-46ce-9294-027d51d53951 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:41.501719 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f700f-639a-4d05-a0ae-64da5135928f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:41.502356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f700f-639a-4d05-a0ae-64da5135928f None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:41.502640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f700f-639a-4d05-a0ae-64da5135928f None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:41.502918 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f700f-639a-4d05-a0ae-64da5135928f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:41.509380 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:41.514407 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f700f-639a-4d05-a0ae-64da5135928f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:41.515843 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f700f-639a-4d05-a0ae-64da5135928f None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:41.530584 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-f77f700f-639a-4d05-a0ae-64da5135928f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:41.530584 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:41.530584 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:41.530584 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:41.530584 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:41.530584 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:41.530584 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:41.530584 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:41.530584 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:41.530584 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:41.530584 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:41.530584 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:41.530584 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:39:41.530584 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:39:41.530584 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:39:41.531469 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:39:41.531469 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:41.531469 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:41.531469 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:41.531469 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:41.531469 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:41.531469 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:41.531469 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:41.531469 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:41.531469 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:41.531469 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:41.531469 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:41.531469 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:41.531469 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:41.531469 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:41.531469 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:41.531469 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:41.532379 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:39:41.532379 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:39:41.532379 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:41.532379 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:41.532379 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 534/1083] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:39:41.538676 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20b508-b096-479f-b021-de5169d13456 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:41.569112 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:41.639108 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20b508-b096-479f-b021-de5169d13456 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:41.673638 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6645fe-67fc-47cb-a5b7-3daefe3933aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:41.674254 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6645fe-67fc-47cb-a5b7-3daefe3933aa None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:41.674537 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6645fe-67fc-47cb-a5b7-3daefe3933aa None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:41.674815 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6645fe-67fc-47cb-a5b7-3daefe3933aa None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:41.675512 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6645fe-67fc-47cb-a5b7-3daefe3933aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:41.675820 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6645fe-67fc-47cb-a5b7-3daefe3933aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:41.677188 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6645fe-67fc-47cb-a5b7-3daefe3933aa None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:41.688926 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 550/1084] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:42.223348 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023b11c-58e3-48dd-af99-1b1045b17a8d None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:42.223638 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023b11c-58e3-48dd-af99-1b1045b17a8d None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:42.223920 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023b11c-58e3-48dd-af99-1b1045b17a8d None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:42.225290 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 535/1085] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:42.230996 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4eb5b-2e3f-496d-8139-df8c246eb29a None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:42.231450 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4eb5b-2e3f-496d-8139-df8c246eb29a None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:42.231564 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4eb5b-2e3f-496d-8139-df8c246eb29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:42.250801 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-53c4eb5b-2e3f-496d-8139-df8c246eb29a None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:42.251973 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-53c4eb5b-2e3f-496d-8139-df8c246eb29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:42.300076 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c107b43-1e16-4b38-ba3b-da0f3014f984 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:42.300357 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c107b43-1e16-4b38-ba3b-da0f3014f984 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:42.300630 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c107b43-1e16-4b38-ba3b-da0f3014f984 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:42.302010 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 536/1086] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:42.306872 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d8041-e42c-426b-a078-3a4c918a36ee None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:42.307159 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d8041-e42c-426b-a078-3a4c918a36ee None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:42.307435 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d8041-e42c-426b-a078-3a4c918a36ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:42.322226 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 551/1087] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:39:42.325913 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-136d8041-e42c-426b-a078-3a4c918a36ee None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:42.327048 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-136d8041-e42c-426b-a078-3a4c918a36ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:42.345444 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4eb5b-2e3f-496d-8139-df8c246eb29a None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:42.367102 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:42.394738 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 537/1088] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:39:42.418223 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d8041-e42c-426b-a078-3a4c918a36ee None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:42.445008 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4eb5b-2e3f-496d-8139-df8c246eb29a None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:42.479468 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959fcae-7afd-49b8-9d49-7f8297ff319b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:42.480055 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959fcae-7afd-49b8-9d49-7f8297ff319b None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:42.480290 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959fcae-7afd-49b8-9d49-7f8297ff319b None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:42.480559 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959fcae-7afd-49b8-9d49-7f8297ff319b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:42.491764 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959fcae-7afd-49b8-9d49-7f8297ff319b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:39:42.497350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-6959fcae-7afd-49b8-9d49-7f8297ff319b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 12:39:42.497350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:42.497350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:42.497350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:42.497350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:42.497350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:42.497350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:42.497350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:42.497350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:42.497350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:42.497350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:42.497350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:42.497350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:39:42.497350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:39:42.497350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:39:42.497350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:39:42.498395 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:39:42.498395 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:39:42.498395 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:39:42.498395 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:39:42.498395 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:42.498395 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:42.498395 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:42.498395 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:42.498395 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:42.498395 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:42.498395 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:42.498395 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:42.498395 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:42.498395 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:42.498395 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:42.498395 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:42.499649 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:42.499649 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:42.499649 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:42.499649 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:42.499649 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:39:42.499649 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:39:42.499649 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:39:42.499649 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:39:42.499649 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:39:42.499649 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:39:42.499649 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 03 12:39:42.499649 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:42.499649 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 552/1089] 10.222.0.46 () {56 vars in 1120 bytes} [Wed Aug 3 12:39:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:39:42.504334 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959fcae-7afd-49b8-9d49-7f8297ff319b None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:42.519035 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d8041-e42c-426b-a078-3a4c918a36ee None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:42.538671 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:42.552840 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a19939-0ebe-46b0-a5ff-0b96ddfde375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:42.553476 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a19939-0ebe-46b0-a5ff-0b96ddfde375 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:42.553800 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a19939-0ebe-46b0-a5ff-0b96ddfde375 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:42.554073 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a19939-0ebe-46b0-a5ff-0b96ddfde375 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:42.564558 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a19939-0ebe-46b0-a5ff-0b96ddfde375 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:39:42.569433 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-08a19939-0ebe-46b0-a5ff-0b96ddfde375 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:39:42.569433 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:42.569433 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:42.569433 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:42.569433 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:42.569433 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:42.569433 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:42.569433 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:42.569433 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:42.569433 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:42.569433 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:42.569433 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:42.569433 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:39:42.569433 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:39:42.569433 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:39:42.569433 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:39:42.570370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:39:42.570370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:39:42.570370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:39:42.570370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:39:42.570370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:42.570370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:42.570370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:42.570370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:42.570370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:42.570370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:42.570370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:42.570370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:42.570370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:42.570370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:42.570370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:42.570370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:42.571218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:42.571218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:42.571218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:42.571218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:42.571218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:39:42.571218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:39:42.571218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:39:42.571218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:39:42.571218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:39:42.571218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:39:42.571218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:39:42.571218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:42.571218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 538/1090] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 3 12:39:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:39:42.577167 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a19939-0ebe-46b0-a5ff-0b96ddfde375 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:42.585382 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:42.609111 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959fcae-7afd-49b8-9d49-7f8297ff319b None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:42.646026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865f4db-8c85-43b9-a25f-89029b3f2642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:42.646638 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865f4db-8c85-43b9-a25f-89029b3f2642 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:42.646920 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865f4db-8c85-43b9-a25f-89029b3f2642 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:42.647197 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865f4db-8c85-43b9-a25f-89029b3f2642 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:42.647916 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865f4db-8c85-43b9-a25f-89029b3f2642 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:42.648223 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865f4db-8c85-43b9-a25f-89029b3f2642 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:42.649624 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865f4db-8c85-43b9-a25f-89029b3f2642 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:42.657646 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 553/1091] 10.222.0.46 () {56 vars in 1115 bytes} [Wed Aug 3 12:39:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:42.663198 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865f4db-8c85-43b9-a25f-89029b3f2642 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:42.681019 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a19939-0ebe-46b0-a5ff-0b96ddfde375 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:42.715286 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8c8fd-9869-46fa-b0df-9aeef10be745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:42.715891 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8c8fd-9869-46fa-b0df-9aeef10be745 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:42.716166 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8c8fd-9869-46fa-b0df-9aeef10be745 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:42.716436 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8c8fd-9869-46fa-b0df-9aeef10be745 None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:42.717142 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d8c8fd-9869-46fa-b0df-9aeef10be745 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:42.717439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d8c8fd-9869-46fa-b0df-9aeef10be745 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:42.718816 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d8c8fd-9869-46fa-b0df-9aeef10be745 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:42.726888 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 539/1092] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:39:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:42.733255 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8c8fd-9869-46fa-b0df-9aeef10be745 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:42.761303 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865f4db-8c85-43b9-a25f-89029b3f2642 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:42.774529 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:42.795234 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f608d-9ecc-47b4-8879-629a6ab7fdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:42.795866 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f608d-9ecc-47b4-8879-629a6ab7fdc1 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:42.796143 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f608d-9ecc-47b4-8879-629a6ab7fdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:42.796414 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f608d-9ecc-47b4-8879-629a6ab7fdc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:42.806977 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f608d-9ecc-47b4-8879-629a6ab7fdc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:42.809074 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f608d-9ecc-47b4-8879-629a6ab7fdc1 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:42.810959 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:42.824229 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-dc1f608d-9ecc-47b4-8879-629a6ab7fdc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:42.824229 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:42.824229 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:42.824229 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:42.824229 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:42.824229 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:42.824229 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:42.824229 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:42.824229 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:42.824229 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:42.824229 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:42.824229 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:42.824229 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:39:42.824229 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:39:42.824229 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:39:42.825161 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:39:42.825161 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:42.825161 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:42.825161 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:42.825161 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:42.825161 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:42.825161 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:42.825161 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:42.825161 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:42.825161 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:42.825161 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:42.825161 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:42.825161 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:42.825161 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:42.825161 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:42.825161 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:42.825161 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:42.826072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:39:42.826072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:39:42.826072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:42.826072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:42.826072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 554/1093] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:39:42.830953 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f608d-9ecc-47b4-8879-629a6ab7fdc1 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:42.832882 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8c8fd-9869-46fa-b0df-9aeef10be745 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:42.868278 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47e79c-bcb4-4b1a-a872-e6a13fee854f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:42.868946 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47e79c-bcb4-4b1a-a872-e6a13fee854f None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:42.869238 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47e79c-bcb4-4b1a-a872-e6a13fee854f None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:42.869535 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47e79c-bcb4-4b1a-a872-e6a13fee854f None admin] PATH_INFO: `/v3/users/87ee2acb67a14c9e82f0bdfd6248bc0d` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:42.871234 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d47e79c-bcb4-4b1a-a872-e6a13fee854f None admin] RBAC: Authorizing `identity:get_user(user_id=87ee2acb67a14c9e82f0bdfd6248bc0d)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:42.872668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d47e79c-bcb4-4b1a-a872-e6a13fee854f None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:42.874324 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 540/1094] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:39:42 2022] GET /identity/v3/users/87ee2acb67a14c9e82f0bdfd6248bc0d => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:42.880120 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47e79c-bcb4-4b1a-a872-e6a13fee854f None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:42.931283 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f608d-9ecc-47b4-8879-629a6ab7fdc1 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:42.964769 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157e044-47cf-409f-af3b-aef685e86a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:42.965489 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157e044-47cf-409f-af3b-aef685e86a91 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:42.965801 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157e044-47cf-409f-af3b-aef685e86a91 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:42.966077 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157e044-47cf-409f-af3b-aef685e86a91 None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:42.966766 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157e044-47cf-409f-af3b-aef685e86a91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:42.967070 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157e044-47cf-409f-af3b-aef685e86a91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:42.968428 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157e044-47cf-409f-af3b-aef685e86a91 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:42.977677 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47e79c-bcb4-4b1a-a872-e6a13fee854f None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:42.981281 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 555/1095] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:42.986851 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157e044-47cf-409f-af3b-aef685e86a91 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:42.988370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:43.014850 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00552747-836e-42f6-bfc3-7904984011e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:43.015464 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00552747-836e-42f6-bfc3-7904984011e8 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:43.015746 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00552747-836e-42f6-bfc3-7904984011e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:43.016023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00552747-836e-42f6-bfc3-7904984011e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:43.041015 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:43.082079 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00552747-836e-42f6-bfc3-7904984011e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:43.083522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00552747-836e-42f6-bfc3-7904984011e8 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:43.085020 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157e044-47cf-409f-af3b-aef685e86a91 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:43.119495 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7890798-4c51-43a8-b10f-84dad6b428c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:43.120267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7890798-4c51-43a8-b10f-84dad6b428c0 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:43.120554 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7890798-4c51-43a8-b10f-84dad6b428c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:43.120832 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7890798-4c51-43a8-b10f-84dad6b428c0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:43.127890 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7890798-4c51-43a8-b10f-84dad6b428c0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:43.129325 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7890798-4c51-43a8-b10f-84dad6b428c0 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:43.141353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-c7890798-4c51-43a8-b10f-84dad6b428c0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:39:43.141353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:43.141353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:43.141353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:43.141353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:43.141353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:43.141353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:43.141353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:43.141353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:43.141353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:43.141353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:43.141353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:43.141353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:39:43.141353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:39:43.141353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:39:43.141353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:39:43.142492 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:43.142492 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:43.142492 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:39:43.142492 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:39:43.142492 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:39:43.142492 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:39:43.142492 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:43.142492 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:43.142492 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:43.142492 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:43.142492 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:43.142492 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:43.142492 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:43.142492 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:43.142492 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:43.142492 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:43.142492 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:43.142492 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:43.143569 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:43.143569 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:43.143569 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:39:43.143569 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:39:43.143569 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:39:43.143569 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:39:43.143569 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:39:43.143569 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:39:43.143569 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 03 12:39:43.143569 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:39:43.143569 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 556/1096] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Aug 3 12:39:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:39:43.148349 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7890798-4c51-43a8-b10f-84dad6b428c0 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:43.181290 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 541/1097] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:39:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 03 12:39:43.187046 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00552747-836e-42f6-bfc3-7904984011e8 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:43.197750 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:43.251635 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7890798-4c51-43a8-b10f-84dad6b428c0 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:43.267877 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:43.285972 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f44985-4159-4c03-bfdb-d0e74e79015d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:43.286593 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f44985-4159-4c03-bfdb-d0e74e79015d None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:43.286876 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f44985-4159-4c03-bfdb-d0e74e79015d None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:43.287150 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f44985-4159-4c03-bfdb-d0e74e79015d None admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:43.287939 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f44985-4159-4c03-bfdb-d0e74e79015d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:43.288247 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f44985-4159-4c03-bfdb-d0e74e79015d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:43.289696 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f44985-4159-4c03-bfdb-d0e74e79015d None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:43.293600 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00552747-836e-42f6-bfc3-7904984011e8 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:43.307223 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 557/1098] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Aug 3 12:39:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:43.312873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f44985-4159-4c03-bfdb-d0e74e79015d None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:43.330098 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677fb31-af2e-41b9-a07d-5a29c5009edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:43.330737 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677fb31-af2e-41b9-a07d-5a29c5009edd None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:43.331023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677fb31-af2e-41b9-a07d-5a29c5009edd None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:43.331296 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677fb31-af2e-41b9-a07d-5a29c5009edd None admin] PATH_INFO: `/v3/projects/a2e08d671112428c81142df5cbdfeb1c` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:43.332476 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677fb31-af2e-41b9-a07d-5a29c5009edd None admin] RBAC: Authorizing `identity:get_project(project_id=a2e08d671112428c81142df5cbdfeb1c)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:43.333931 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677fb31-af2e-41b9-a07d-5a29c5009edd None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:43.341129 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 542/1099] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:39:43 2022] GET /identity/v3/projects/a2e08d671112428c81142df5cbdfeb1c => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:43.342078 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677fb31-af2e-41b9-a07d-5a29c5009edd None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:43.411430 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f44985-4159-4c03-bfdb-d0e74e79015d None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:43.426116 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:43.445911 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a4b02-6d45-4272-8024-e9bba685e1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:43.446506 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a4b02-6d45-4272-8024-e9bba685e1fe None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:43.446783 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a4b02-6d45-4272-8024-e9bba685e1fe None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:43.447054 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a4b02-6d45-4272-8024-e9bba685e1fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:43.448616 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677fb31-af2e-41b9-a07d-5a29c5009edd None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:43.482127 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0cbd5f-17fa-428b-bcea-e7588882a6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:43.482732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cbd5f-17fa-428b-bcea-e7588882a6be None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:43.483014 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cbd5f-17fa-428b-bcea-e7588882a6be None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:43.483287 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cbd5f-17fa-428b-bcea-e7588882a6be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:43.484078 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0cbd5f-17fa-428b-bcea-e7588882a6be None admin] RBAC: Adding query filter params (role.id=0e57d142f86c471883fc07a89fe66ec8, scope.project.id=a2e08d671112428c81142df5cbdfeb1c, user.id=87ee2acb67a14c9e82f0bdfd6248bc0d) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:43.484398 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0cbd5f-17fa-428b-bcea-e7588882a6be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:43.485892 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0cbd5f-17fa-428b-bcea-e7588882a6be None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:43.488150 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:43.492215 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 543/1100] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:39:43 2022] GET /identity/v3/role_assignments?user.id=87ee2acb67a14c9e82f0bdfd6248bc0d&scope.project.id=a2e08d671112428c81142df5cbdfeb1c&role.id=0e57d142f86c471883fc07a89fe66ec8 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:43.516247 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a4b02-6d45-4272-8024-e9bba685e1fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:43.517690 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a4b02-6d45-4272-8024-e9bba685e1fe None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:43.622353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 558/1101] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:39:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 03 12:39:43.628281 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0cbd5f-17fa-428b-bcea-e7588882a6be None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:43.731628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0cbd5f-17fa-428b-bcea-e7588882a6be None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:43.765780 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbf458-264e-4d16-9042-ab0bc7bbb310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:43.766474 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbf458-264e-4d16-9042-ab0bc7bbb310 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:43.766705 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbf458-264e-4d16-9042-ab0bc7bbb310 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:43.766977 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbf458-264e-4d16-9042-ab0bc7bbb310 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:43.779063 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fbf458-264e-4d16-9042-ab0bc7bbb310 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:43.780515 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fbf458-264e-4d16-9042-ab0bc7bbb310 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:43.782270 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:43.795774 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-a3fbf458-264e-4d16-9042-ab0bc7bbb310 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:43.795774 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:43.795774 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:43.795774 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:43.795774 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:43.795774 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:43.795774 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:43.795774 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:43.795774 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:43.795774 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:43.795774 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:43.795774 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:43.795774 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:39:43.795774 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:39:43.795774 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:39:43.796690 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:39:43.796690 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:43.796690 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:43.796690 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:43.796690 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:43.796690 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:43.796690 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:43.796690 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:43.796690 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:43.796690 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:43.796690 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:43.796690 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:43.796690 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:43.796690 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:43.796690 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:43.796690 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:43.796690 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:43.797628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:39:43.797628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:39:43.797628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:39:43.797628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:43.797628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 544/1102] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:39:43.802736 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a4b02-6d45-4272-8024-e9bba685e1fe None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:43.873550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:43.903342 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a4b02-6d45-4272-8024-e9bba685e1fe None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:43.937213 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50891c22-384b-4e78-8198-7b43e57bba21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:43.937856 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50891c22-384b-4e78-8198-7b43e57bba21 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:43.938136 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50891c22-384b-4e78-8198-7b43e57bba21 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:43.938409 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50891c22-384b-4e78-8198-7b43e57bba21 None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:43.939103 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50891c22-384b-4e78-8198-7b43e57bba21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:43.939406 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50891c22-384b-4e78-8198-7b43e57bba21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:43.940766 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50891c22-384b-4e78-8198-7b43e57bba21 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:43.952776 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 559/1103] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:43.958443 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbf458-264e-4d16-9042-ab0bc7bbb310 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:44.057253 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbf458-264e-4d16-9042-ab0bc7bbb310 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:44.090065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c18bb-9087-4771-b01c-1d1815e9ffe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:44.090694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c18bb-9087-4771-b01c-1d1815e9ffe2 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:44.090971 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c18bb-9087-4771-b01c-1d1815e9ffe2 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:44.091236 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c18bb-9087-4771-b01c-1d1815e9ffe2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:44.097724 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c18bb-9087-4771-b01c-1d1815e9ffe2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:44.099137 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c18bb-9087-4771-b01c-1d1815e9ffe2 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:44.111034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-237c18bb-9087-4771-b01c-1d1815e9ffe2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:39:44.111034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:39:44.111034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:39:44.111034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:39:44.111034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:39:44.111034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:39:44.111034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:39:44.111034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:39:44.111034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:39:44.111034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:39:44.111034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:39:44.111034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:39:44.111034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:39:44.111034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:39:44.111034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:39:44.112096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:39:44.112096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:39:44.112096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:39:44.112096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:39:44.112096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:39:44.112096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:39:44.112096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:39:44.112096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:39:44.112096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:39:44.112096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:39:44.112096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:39:44.112096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:39:44.112096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:39:44.112096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:39:44.112096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:39:44.112096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:39:44.112096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:39:44.113019 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:39:44.113019 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:39:44.113019 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:39:44.113019 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:39:44.113019 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:39:44.113019 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:39:44.113019 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:39:44.113019 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:39:44.113019 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 545/1104] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:39:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:39:44.118940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50891c22-384b-4e78-8198-7b43e57bba21 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:44.220614 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50891c22-384b-4e78-8198-7b43e57bba21 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:44.248807 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:44.254350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3f3f3-31da-4fc7-a1f5-d8131f1f5134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:44.254970 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3f3f3-31da-4fc7-a1f5-d8131f1f5134 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:44.255251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3f3f3-31da-4fc7-a1f5-d8131f1f5134 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:44.255526 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3f3f3-31da-4fc7-a1f5-d8131f1f5134 None admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:44.256275 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3f3f3-31da-4fc7-a1f5-d8131f1f5134 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:44.256581 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3f3f3-31da-4fc7-a1f5-d8131f1f5134 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:44.258053 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3f3f3-31da-4fc7-a1f5-d8131f1f5134 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:44.270858 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 560/1105] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 3 12:39:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:44.277772 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c18bb-9087-4771-b01c-1d1815e9ffe2 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:44.331503 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:44.375976 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c18bb-9087-4771-b01c-1d1815e9ffe2 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:44.409146 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291dff0b-4ba7-41f2-a8a4-87dcab6d11fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:44.409781 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291dff0b-4ba7-41f2-a8a4-87dcab6d11fe None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:44.410067 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291dff0b-4ba7-41f2-a8a4-87dcab6d11fe None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:44.410343 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291dff0b-4ba7-41f2-a8a4-87dcab6d11fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:44.411128 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291dff0b-4ba7-41f2-a8a4-87dcab6d11fe None admin] RBAC: Adding query filter params (role.id=a7ac56aa0b134a9e925725f41c54d4b3, scope.project.id=6ac833dfff634496816842c851545d21, user.id=dcf670ff4f62486dbf70cf6ea0f08bbb) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:44.411440 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291dff0b-4ba7-41f2-a8a4-87dcab6d11fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:44.412860 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291dff0b-4ba7-41f2-a8a4-87dcab6d11fe None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:44.418782 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 546/1106] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:39:44 2022] GET /identity/v3/role_assignments?user.id=dcf670ff4f62486dbf70cf6ea0f08bbb&scope.project.id=6ac833dfff634496816842c851545d21&role.id=a7ac56aa0b134a9e925725f41c54d4b3 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:39:45.495890 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147328d-d662-41a7-8877-6c4f05cf4f35 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:45.496409 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147328d-d662-41a7-8877-6c4f05cf4f35 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:45.496496 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147328d-d662-41a7-8877-6c4f05cf4f35 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:45.497829 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 561/1107] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:45.502796 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07dbb3-4a63-41d8-ae9f-d2fe60420aab None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:45.503231 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07dbb3-4a63-41d8-ae9f-d2fe60420aab None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:45.503356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07dbb3-4a63-41d8-ae9f-d2fe60420aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:45.521080 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-5e07dbb3-4a63-41d8-ae9f-d2fe60420aab None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:45.522256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-5e07dbb3-4a63-41d8-ae9f-d2fe60420aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:45.586700 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 547/1108] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:39:45.611930 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147328d-d662-41a7-8877-6c4f05cf4f35 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:45.708649 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147328d-d662-41a7-8877-6c4f05cf4f35 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:45.741207 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae0e48-baaa-4f56-8902-6945b9c85341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:45.741852 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae0e48-baaa-4f56-8902-6945b9c85341 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:45.742131 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae0e48-baaa-4f56-8902-6945b9c85341 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:45.742402 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae0e48-baaa-4f56-8902-6945b9c85341 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:45.743535 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae0e48-baaa-4f56-8902-6945b9c85341 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:45.744975 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae0e48-baaa-4f56-8902-6945b9c85341 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:45.746568 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 562/1109] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:39:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:45.752455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07dbb3-4a63-41d8-ae9f-d2fe60420aab None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:45.800760 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:45.850566 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07dbb3-4a63-41d8-ae9f-d2fe60420aab None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:45.883282 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55140ca1-c568-4b1f-b134-0fc227fd49f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:45.883886 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55140ca1-c568-4b1f-b134-0fc227fd49f0 None admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:45.884170 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55140ca1-c568-4b1f-b134-0fc227fd49f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:45.884445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55140ca1-c568-4b1f-b134-0fc227fd49f0 None admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:45.885117 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55140ca1-c568-4b1f-b134-0fc227fd49f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:45.887085 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55140ca1-c568-4b1f-b134-0fc227fd49f0 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:45.908201 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 548/1110] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Aug 3 12:39:45 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:39:47.945410 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f353ed-765f-4fdf-8909-c5e0c789de5a None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:47.946064 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f353ed-765f-4fdf-8909-c5e0c789de5a None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:47.946064 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f353ed-765f-4fdf-8909-c5e0c789de5a None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:47.947338 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 563/1111] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:47.953196 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d12c56-2bbc-4b84-94bf-ef0914892f40 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:47.953598 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d12c56-2bbc-4b84-94bf-ef0914892f40 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:47.953786 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d12c56-2bbc-4b84-94bf-ef0914892f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:47.971627 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-52d12c56-2bbc-4b84-94bf-ef0914892f40 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:47.972821 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-52d12c56-2bbc-4b84-94bf-ef0914892f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:48.037622 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 549/1112] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:39:48.061119 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f353ed-765f-4fdf-8909-c5e0c789de5a None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:48.121984 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:48.163729 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f353ed-765f-4fdf-8909-c5e0c789de5a None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:48.197605 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4d195-ca79-464c-88d0-aaaa8c87245d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:48.198271 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4d195-ca79-464c-88d0-aaaa8c87245d None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:48.198534 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4d195-ca79-464c-88d0-aaaa8c87245d None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:48.198812 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4d195-ca79-464c-88d0-aaaa8c87245d None admin] PATH_INFO: `/v3/roles/1f3ee786628740418d65c827bc64a9b5` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:48.200252 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4d195-ca79-464c-88d0-aaaa8c87245d None admin] RBAC: Authorizing `identity:get_role(role_id=1f3ee786628740418d65c827bc64a9b5)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:48.201661 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4d195-ca79-464c-88d0-aaaa8c87245d None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:48.203013 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 564/1113] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:39:48 2022] GET /identity/v3/roles/1f3ee786628740418d65c827bc64a9b5 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:48.208845 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d12c56-2bbc-4b84-94bf-ef0914892f40 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:48.241516 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:48.308309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d12c56-2bbc-4b84-94bf-ef0914892f40 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:48.340991 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476a668-760d-4e5d-a4a0-383ac6ef851a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:48.341660 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476a668-760d-4e5d-a4a0-383ac6ef851a None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:48.341944 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476a668-760d-4e5d-a4a0-383ac6ef851a None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:48.342219 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476a668-760d-4e5d-a4a0-383ac6ef851a None admin] PATH_INFO: `/v3/users/82d226865e454a45be5430ceb24aca51` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:48.355371 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a476a668-760d-4e5d-a4a0-383ac6ef851a None admin] RBAC: Authorizing `identity:get_user(user_id=82d226865e454a45be5430ceb24aca51)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:48.356791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a476a668-760d-4e5d-a4a0-383ac6ef851a None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:48.358487 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 550/1114] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:39:48 2022] GET /identity/v3/users/82d226865e454a45be5430ceb24aca51 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:48.364351 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4d195-ca79-464c-88d0-aaaa8c87245d None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:48.462076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4d195-ca79-464c-88d0-aaaa8c87245d None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:48.488030 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:48.496584 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ff453-0ec4-4acc-ac95-e5bae52af19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:48.497194 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ff453-0ec4-4acc-ac95-e5bae52af19c None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:48.497478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ff453-0ec4-4acc-ac95-e5bae52af19c None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:48.497788 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ff453-0ec4-4acc-ac95-e5bae52af19c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:48.562626 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ff453-0ec4-4acc-ac95-e5bae52af19c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:48.564072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ff453-0ec4-4acc-ac95-e5bae52af19c None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:48.658805 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 565/1115] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:39:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:39:48.664741 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476a668-760d-4e5d-a4a0-383ac6ef851a None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:48.751884 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:48.761669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476a668-760d-4e5d-a4a0-383ac6ef851a None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:48.794832 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab02b7-5a83-49fd-8753-9e1a1918af61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:48.795455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab02b7-5a83-49fd-8753-9e1a1918af61 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:48.795736 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab02b7-5a83-49fd-8753-9e1a1918af61 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:48.796013 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab02b7-5a83-49fd-8753-9e1a1918af61 None admin] PATH_INFO: `/v3/projects/a2e08d671112428c81142df5cbdfeb1c` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:48.797142 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab02b7-5a83-49fd-8753-9e1a1918af61 None admin] RBAC: Authorizing `identity:get_project(project_id=a2e08d671112428c81142df5cbdfeb1c)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:48.798593 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab02b7-5a83-49fd-8753-9e1a1918af61 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:48.800254 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 551/1116] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:39:48 2022] GET /identity/v3/projects/a2e08d671112428c81142df5cbdfeb1c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:48.806233 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ff453-0ec4-4acc-ac95-e5bae52af19c None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:48.833048 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:48.903559 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ff453-0ec4-4acc-ac95-e5bae52af19c None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:48.936227 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad36e9-4e16-49c2-af3b-0ed39513266c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:48.936831 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad36e9-4e16-49c2-af3b-0ed39513266c None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:48.937110 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad36e9-4e16-49c2-af3b-0ed39513266c None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:48.937385 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad36e9-4e16-49c2-af3b-0ed39513266c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:48.938207 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad36e9-4e16-49c2-af3b-0ed39513266c None admin] RBAC: Adding query filter params (role.id=1f3ee786628740418d65c827bc64a9b5, scope.project.id=a2e08d671112428c81142df5cbdfeb1c, user.id=82d226865e454a45be5430ceb24aca51) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:48.938516 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad36e9-4e16-49c2-af3b-0ed39513266c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:48.939941 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad36e9-4e16-49c2-af3b-0ed39513266c None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:48.945168 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 566/1117] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:39:48 2022] GET /identity/v3/role_assignments?user.id=82d226865e454a45be5430ceb24aca51&scope.project.id=a2e08d671112428c81142df5cbdfeb1c&role.id=1f3ee786628740418d65c827bc64a9b5 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:50.903214 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fbdda-df0a-4098-99ee-abedfea107b8 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:50.903744 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fbdda-df0a-4098-99ee-abedfea107b8 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:50.903744 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fbdda-df0a-4098-99ee-abedfea107b8 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:50.905115 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 552/1118] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:50.910332 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33145bdb-29fe-4bc6-b914-683963db8040 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:50.910749 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33145bdb-29fe-4bc6-b914-683963db8040 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:50.910882 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33145bdb-29fe-4bc6-b914-683963db8040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:50.929169 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-33145bdb-29fe-4bc6-b914-683963db8040 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:50.930391 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-33145bdb-29fe-4bc6-b914-683963db8040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:50.994698 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 567/1119] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:39:51.017968 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fbdda-df0a-4098-99ee-abedfea107b8 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:51.116280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fbdda-df0a-4098-99ee-abedfea107b8 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:51.148907 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd74ae6-1dd5-4985-865f-e917da3ed4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:51.149553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd74ae6-1dd5-4985-865f-e917da3ed4e3 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:51.149838 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd74ae6-1dd5-4985-865f-e917da3ed4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:51.150112 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd74ae6-1dd5-4985-865f-e917da3ed4e3 None admin] PATH_INFO: `/v3/roles/1f3ee786628740418d65c827bc64a9b5` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:51.152213 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd74ae6-1dd5-4985-865f-e917da3ed4e3 None admin] RBAC: Authorizing `identity:get_role(role_id=1f3ee786628740418d65c827bc64a9b5)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:51.153636 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd74ae6-1dd5-4985-865f-e917da3ed4e3 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:51.154921 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 553/1120] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:39:51 2022] GET /identity/v3/roles/1f3ee786628740418d65c827bc64a9b5 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:51.160626 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33145bdb-29fe-4bc6-b914-683963db8040 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:51.183579 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:51.256583 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33145bdb-29fe-4bc6-b914-683963db8040 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:51.290463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02d646-0fdd-4547-902a-92a60586f183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:51.291101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02d646-0fdd-4547-902a-92a60586f183 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:51.291382 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02d646-0fdd-4547-902a-92a60586f183 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:51.291657 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02d646-0fdd-4547-902a-92a60586f183 None admin] PATH_INFO: `/v3/users/82d226865e454a45be5430ceb24aca51` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:51.292957 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02d646-0fdd-4547-902a-92a60586f183 None admin] RBAC: Authorizing `identity:get_user(user_id=82d226865e454a45be5430ceb24aca51)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:51.294420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02d646-0fdd-4547-902a-92a60586f183 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:51.296034 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 568/1121] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:39:51 2022] GET /identity/v3/users/82d226865e454a45be5430ceb24aca51 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:51.301770 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd74ae6-1dd5-4985-865f-e917da3ed4e3 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:51.330417 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:51.399608 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd74ae6-1dd5-4985-865f-e917da3ed4e3 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:51.431143 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b61ab6-fba5-44d3-985d-aa15f6e95c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:51.431704 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b61ab6-fba5-44d3-985d-aa15f6e95c82 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:51.431979 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b61ab6-fba5-44d3-985d-aa15f6e95c82 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:51.432247 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b61ab6-fba5-44d3-985d-aa15f6e95c82 None admin] PATH_INFO: `/v3/projects/a2e08d671112428c81142df5cbdfeb1c` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:51.433979 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b61ab6-fba5-44d3-985d-aa15f6e95c82 None admin] RBAC: Authorizing `identity:get_project(project_id=a2e08d671112428c81142df5cbdfeb1c)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:51.435391 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b61ab6-fba5-44d3-985d-aa15f6e95c82 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:51.437058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 554/1122] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:39:51 2022] GET /identity/v3/projects/a2e08d671112428c81142df5cbdfeb1c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:51.443322 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02d646-0fdd-4547-902a-92a60586f183 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:51.535572 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:51.545401 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02d646-0fdd-4547-902a-92a60586f183 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:51.578715 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9a4de-51a9-48d3-93b6-575a047e97ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:51.579367 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9a4de-51a9-48d3-93b6-575a047e97ef None admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:51.579649 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9a4de-51a9-48d3-93b6-575a047e97ef None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:51.579921 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9a4de-51a9-48d3-93b6-575a047e97ef None admin] PATH_INFO: `/v3/projects/a2e08d671112428c81142df5cbdfeb1c/users/82d226865e454a45be5430ceb24aca51/roles/1f3ee786628740418d65c827bc64a9b5` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:51.582090 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9a4de-51a9-48d3-93b6-575a047e97ef None admin] RBAC: Authorizing `identity:create_grant(project_id=a2e08d671112428c81142df5cbdfeb1c, user_id=82d226865e454a45be5430ceb24aca51, role_id=1f3ee786628740418d65c827bc64a9b5)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:51.583521 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9a4de-51a9-48d3-93b6-575a047e97ef None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:51.595510 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 569/1123] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 3 12:39:51 2022] PUT /identity/v3/projects/a2e08d671112428c81142df5cbdfeb1c/users/82d226865e454a45be5430ceb24aca51/roles/1f3ee786628740418d65c827bc64a9b5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:39:53.543943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a29d3-c81e-498c-af1e-e1bf0a781c3e None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:53.544496 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a29d3-c81e-498c-af1e-e1bf0a781c3e None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:53.544496 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a29d3-c81e-498c-af1e-e1bf0a781c3e None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:53.545785 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 555/1124] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:53.550935 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491835f1-e516-4fa5-8cde-9cb658a9c6ff None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:53.551360 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491835f1-e516-4fa5-8cde-9cb658a9c6ff None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:53.551543 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491835f1-e516-4fa5-8cde-9cb658a9c6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:53.570107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-491835f1-e516-4fa5-8cde-9cb658a9c6ff None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:53.571295 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-491835f1-e516-4fa5-8cde-9cb658a9c6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:53.636275 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 570/1125] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:39:53.658980 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a29d3-c81e-498c-af1e-e1bf0a781c3e None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:53.750769 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:53.757466 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a29d3-c81e-498c-af1e-e1bf0a781c3e None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:53.790044 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb632d7-bf88-4aa3-8760-afbe6c0b63fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:53.790657 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb632d7-bf88-4aa3-8760-afbe6c0b63fe None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:53.790932 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb632d7-bf88-4aa3-8760-afbe6c0b63fe None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:53.791202 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb632d7-bf88-4aa3-8760-afbe6c0b63fe None admin] PATH_INFO: `/v3/roles/1f3ee786628740418d65c827bc64a9b5` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:53.793525 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb632d7-bf88-4aa3-8760-afbe6c0b63fe None admin] RBAC: Authorizing `identity:get_role(role_id=1f3ee786628740418d65c827bc64a9b5)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:53.794912 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb632d7-bf88-4aa3-8760-afbe6c0b63fe None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:53.796187 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 556/1126] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:39:53 2022] GET /identity/v3/roles/1f3ee786628740418d65c827bc64a9b5 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:53.801967 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491835f1-e516-4fa5-8cde-9cb658a9c6ff None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:53.879716 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:53.899483 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491835f1-e516-4fa5-8cde-9cb658a9c6ff None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:53.937039 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563d549-18d3-42a3-af6b-f7391b459641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:53.937703 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563d549-18d3-42a3-af6b-f7391b459641 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:53.937985 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563d549-18d3-42a3-af6b-f7391b459641 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:53.938262 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563d549-18d3-42a3-af6b-f7391b459641 None admin] PATH_INFO: `/v3/users/82d226865e454a45be5430ceb24aca51` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:53.939419 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563d549-18d3-42a3-af6b-f7391b459641 None admin] RBAC: Authorizing `identity:get_user(user_id=82d226865e454a45be5430ceb24aca51)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:53.940856 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563d549-18d3-42a3-af6b-f7391b459641 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:53.942514 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 571/1127] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:39:53 2022] GET /identity/v3/users/82d226865e454a45be5430ceb24aca51 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:53.948840 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb632d7-bf88-4aa3-8760-afbe6c0b63fe None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:54.044094 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb632d7-bf88-4aa3-8760-afbe6c0b63fe None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:54.075929 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57ddb7-3068-4247-8d29-492975799493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:54.076471 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57ddb7-3068-4247-8d29-492975799493 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:54.076747 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57ddb7-3068-4247-8d29-492975799493 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:54.077016 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57ddb7-3068-4247-8d29-492975799493 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:54.106131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:54.142685 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57ddb7-3068-4247-8d29-492975799493 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:54.144144 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57ddb7-3068-4247-8d29-492975799493 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:54.240188 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 557/1128] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:39:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:39:54.246426 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563d549-18d3-42a3-af6b-f7391b459641 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:54.344555 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563d549-18d3-42a3-af6b-f7391b459641 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:54.377789 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2a591-a2c2-426e-8668-544b29d6352a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:54.378409 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2a591-a2c2-426e-8668-544b29d6352a None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:54.378688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2a591-a2c2-426e-8668-544b29d6352a None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:54.378959 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2a591-a2c2-426e-8668-544b29d6352a None admin] PATH_INFO: `/v3/projects/a2e08d671112428c81142df5cbdfeb1c` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:54.380088 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab2a591-a2c2-426e-8668-544b29d6352a None admin] RBAC: Authorizing `identity:get_project(project_id=a2e08d671112428c81142df5cbdfeb1c)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:54.381523 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab2a591-a2c2-426e-8668-544b29d6352a None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:54.383168 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 572/1129] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:39:54 2022] GET /identity/v3/projects/a2e08d671112428c81142df5cbdfeb1c => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:54.389852 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57ddb7-3068-4247-8d29-492975799493 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:54.449834 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:54.485840 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57ddb7-3068-4247-8d29-492975799493 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:54.519487 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9305913-6c25-4033-8aec-30b2fe2b55bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:54.520086 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9305913-6c25-4033-8aec-30b2fe2b55bc None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:54.520363 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9305913-6c25-4033-8aec-30b2fe2b55bc None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:54.520632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9305913-6c25-4033-8aec-30b2fe2b55bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:54.521407 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9305913-6c25-4033-8aec-30b2fe2b55bc None admin] RBAC: Adding query filter params (role.id=1f3ee786628740418d65c827bc64a9b5, scope.project.id=a2e08d671112428c81142df5cbdfeb1c, user.id=82d226865e454a45be5430ceb24aca51) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:39:54.521753 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9305913-6c25-4033-8aec-30b2fe2b55bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:54.523149 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9305913-6c25-4033-8aec-30b2fe2b55bc None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:54.529443 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 558/1130] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:39:54 2022] GET /identity/v3/role_assignments?user.id=82d226865e454a45be5430ceb24aca51&scope.project.id=a2e08d671112428c81142df5cbdfeb1c&role.id=1f3ee786628740418d65c827bc64a9b5 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:56.534988 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a4feb-3d62-4133-8065-c13a30c78ed8 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:56.535509 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a4feb-3d62-4133-8065-c13a30c78ed8 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:56.535509 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a4feb-3d62-4133-8065-c13a30c78ed8 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:56.536832 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 573/1131] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:56.542048 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1151fe6-976e-4c64-9cba-ec97856cfaf9 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:56.542594 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1151fe6-976e-4c64-9cba-ec97856cfaf9 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:56.542770 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1151fe6-976e-4c64-9cba-ec97856cfaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:56.561076 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-a1151fe6-976e-4c64-9cba-ec97856cfaf9 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:56.562302 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-a1151fe6-976e-4c64-9cba-ec97856cfaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:56.627272 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 559/1132] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:39:56.649900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a4feb-3d62-4133-8065-c13a30c78ed8 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:56.667553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:56.750209 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a4feb-3d62-4133-8065-c13a30c78ed8 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:56.783508 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f422d7c-7d9b-4e2a-8f72-ad001dcbbfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:56.784133 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f422d7c-7d9b-4e2a-8f72-ad001dcbbfb8 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:56.784415 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f422d7c-7d9b-4e2a-8f72-ad001dcbbfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:56.784690 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f422d7c-7d9b-4e2a-8f72-ad001dcbbfb8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:56.785912 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f422d7c-7d9b-4e2a-8f72-ad001dcbbfb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:56.787284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f422d7c-7d9b-4e2a-8f72-ad001dcbbfb8 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:56.788860 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 574/1133] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:39:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:56.794816 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1151fe6-976e-4c64-9cba-ec97856cfaf9 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:56.852827 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:56.893979 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1151fe6-976e-4c64-9cba-ec97856cfaf9 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:56.925894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97132402-c3e6-49fd-a3c6-4b96d153820a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:56.926499 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97132402-c3e6-49fd-a3c6-4b96d153820a None admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:56.926775 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97132402-c3e6-49fd-a3c6-4b96d153820a None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:56.927044 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97132402-c3e6-49fd-a3c6-4b96d153820a None admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:56.927708 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97132402-c3e6-49fd-a3c6-4b96d153820a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:56.929127 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97132402-c3e6-49fd-a3c6-4b96d153820a None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:56.955554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 560/1134] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Aug 3 12:39:56 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:39:58.978319 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d258eb-335f-47c7-9258-d35d7bbb7b7d None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:58.978871 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d258eb-335f-47c7-9258-d35d7bbb7b7d None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:58.978871 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d258eb-335f-47c7-9258-d35d7bbb7b7d None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:58.980796 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 575/1135] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:39:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:39:58.985878 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb08b12-7f45-4d60-a14e-0490e361047c None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:58.986304 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb08b12-7f45-4d60-a14e-0490e361047c None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:58.986431 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb08b12-7f45-4d60-a14e-0490e361047c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:59.004416 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-5eb08b12-7f45-4d60-a14e-0490e361047c None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:39:59.005634 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-5eb08b12-7f45-4d60-a14e-0490e361047c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:39:59.070978 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 561/1136] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:39:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:39:59.095232 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d258eb-335f-47c7-9258-d35d7bbb7b7d None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:59.177828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:59.193844 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d258eb-335f-47c7-9258-d35d7bbb7b7d None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:59.226824 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bda780-4a44-4b39-854e-7c544869f0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:59.227444 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bda780-4a44-4b39-854e-7c544869f0ca None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:59.227722 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bda780-4a44-4b39-854e-7c544869f0ca None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:59.227993 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bda780-4a44-4b39-854e-7c544869f0ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:59.229203 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bda780-4a44-4b39-854e-7c544869f0ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:59.230728 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bda780-4a44-4b39-854e-7c544869f0ca None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:59.232291 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 576/1137] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:39:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:39:59.238045 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb08b12-7f45-4d60-a14e-0490e361047c None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:39:59.278733 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:39:59.335999 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb08b12-7f45-4d60-a14e-0490e361047c None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:39:59.369021 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fda37e-7db9-4de1-95aa-a3d0e3fd3c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:39:59.369686 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fda37e-7db9-4de1-95aa-a3d0e3fd3c11 None admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:39:59.370581 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fda37e-7db9-4de1-95aa-a3d0e3fd3c11 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:39:59.370856 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fda37e-7db9-4de1-95aa-a3d0e3fd3c11 None admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:39:59.371520 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fda37e-7db9-4de1-95aa-a3d0e3fd3c11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:39:59.372941 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fda37e-7db9-4de1-95aa-a3d0e3fd3c11 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:39:59.393202 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 562/1138] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Aug 3 12:39:59 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:40:01.455190 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456f60f-2ed1-447a-9e6a-d794114688ec None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:01.455727 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456f60f-2ed1-447a-9e6a-d794114688ec None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:01.455727 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456f60f-2ed1-447a-9e6a-d794114688ec None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:01.457261 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 577/1139] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:40:01.464384 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31cf30-5025-4fe6-84b5-bd79d707fb43 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:01.464788 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31cf30-5025-4fe6-84b5-bd79d707fb43 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:01.464933 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31cf30-5025-4fe6-84b5-bd79d707fb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:01.483340 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-ef31cf30-5025-4fe6-84b5-bd79d707fb43 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:01.484533 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-ef31cf30-5025-4fe6-84b5-bd79d707fb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:01.558518 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 563/1140] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:40:01.581460 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456f60f-2ed1-447a-9e6a-d794114688ec None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:01.679950 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456f60f-2ed1-447a-9e6a-d794114688ec None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:01.712825 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf3746-cb66-45eb-82d7-f3bf5834c78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:01.713476 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf3746-cb66-45eb-82d7-f3bf5834c78f None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:01.713788 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf3746-cb66-45eb-82d7-f3bf5834c78f None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:01.714065 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf3746-cb66-45eb-82d7-f3bf5834c78f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:01.728045 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf3746-cb66-45eb-82d7-f3bf5834c78f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:40:01.733509 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-49cf3746-cb66-45eb-82d7-f3bf5834c78f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:40:01.733509 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:40:01.733509 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:40:01.733509 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:40:01.733509 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:40:01.733509 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:40:01.733509 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:40:01.733509 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:40:01.733509 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:40:01.733509 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:40:01.733509 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:40:01.733509 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:40:01.733509 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:40:01.733509 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:40:01.733509 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:40:01.733509 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:40:01.734683 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:40:01.734683 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:40:01.734683 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:40:01.734683 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:40:01.734683 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:40:01.734683 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:40:01.734683 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:40:01.734683 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:40:01.734683 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:40:01.734683 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:40:01.734683 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:40:01.734683 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:40:01.734683 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:40:01.734683 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:40:01.734683 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:40:01.734683 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:40:01.735772 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:40:01.735772 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:40:01.735772 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:40:01.735772 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:40:01.735772 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:40:01.735772 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:40:01.735772 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:40:01.735772 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:40:01.735772 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:40:01.735772 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:40:01.735772 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:40:01.735772 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:40:01.735772 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 578/1141] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 3 12:40:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:40:01.740752 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31cf30-5025-4fe6-84b5-bd79d707fb43 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:01.767362 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:01.839031 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31cf30-5025-4fe6-84b5-bd79d707fb43 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:01.872366 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2d137-56bc-432f-8d21-b807d107f5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:01.872978 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2d137-56bc-432f-8d21-b807d107f5a0 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:01.873260 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2d137-56bc-432f-8d21-b807d107f5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:01.873558 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2d137-56bc-432f-8d21-b807d107f5a0 None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:01.874271 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2d137-56bc-432f-8d21-b807d107f5a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:01.874579 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2d137-56bc-432f-8d21-b807d107f5a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:01.875932 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2d137-56bc-432f-8d21-b807d107f5a0 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:01.883766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 564/1142] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:40:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:01.889461 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf3746-cb66-45eb-82d7-f3bf5834c78f None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:01.904871 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:01.990113 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf3746-cb66-45eb-82d7-f3bf5834c78f None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:02.025734 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b68f3-a5ea-48d2-b64a-eec91146b8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:02.027161 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b68f3-a5ea-48d2-b64a-eec91146b8fd None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:02.027445 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b68f3-a5ea-48d2-b64a-eec91146b8fd None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:02.027719 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b68f3-a5ea-48d2-b64a-eec91146b8fd None admin] PATH_INFO: `/v3/users/7c66ff245f964f369459916b5f64d288` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:02.040331 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b68f3-a5ea-48d2-b64a-eec91146b8fd None admin] RBAC: Authorizing `identity:get_user(user_id=7c66ff245f964f369459916b5f64d288)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:02.042471 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b68f3-a5ea-48d2-b64a-eec91146b8fd None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:02.044086 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 579/1143] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:40:01 2022] GET /identity/v3/users/7c66ff245f964f369459916b5f64d288 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:02.050007 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2d137-56bc-432f-8d21-b807d107f5a0 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:02.134507 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:02.146652 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2d137-56bc-432f-8d21-b807d107f5a0 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:02.179591 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad88bf-6ddd-44ca-a227-f59ed2164a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:02.180197 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad88bf-6ddd-44ca-a227-f59ed2164a60 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:02.180479 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad88bf-6ddd-44ca-a227-f59ed2164a60 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:02.180752 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad88bf-6ddd-44ca-a227-f59ed2164a60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:02.246203 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad88bf-6ddd-44ca-a227-f59ed2164a60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:02.247640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad88bf-6ddd-44ca-a227-f59ed2164a60 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:02.332434 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:02.346320 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 565/1144] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:40:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:40:02.352258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b68f3-a5ea-48d2-b64a-eec91146b8fd None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:02.419020 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:02.449653 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b68f3-a5ea-48d2-b64a-eec91146b8fd None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:02.482708 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06869195-2347-4786-a254-932c05242fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:02.483342 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06869195-2347-4786-a254-932c05242fda None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:02.483626 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06869195-2347-4786-a254-932c05242fda None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:02.483905 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06869195-2347-4786-a254-932c05242fda None admin] PATH_INFO: `/v3/projects/84233d5525dd4b14844631e01fc23225` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:02.485079 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06869195-2347-4786-a254-932c05242fda None admin] RBAC: Authorizing `identity:get_project(project_id=84233d5525dd4b14844631e01fc23225)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:02.486537 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06869195-2347-4786-a254-932c05242fda None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:02.488203 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 580/1145] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:40:02 2022] GET /identity/v3/projects/84233d5525dd4b14844631e01fc23225 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:02.494510 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad88bf-6ddd-44ca-a227-f59ed2164a60 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:02.591776 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad88bf-6ddd-44ca-a227-f59ed2164a60 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:02.625223 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6d0d5-dc7f-4390-a38f-12d2d2119145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:02.625995 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6d0d5-dc7f-4390-a38f-12d2d2119145 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:02.626278 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6d0d5-dc7f-4390-a38f-12d2d2119145 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:02.626555 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6d0d5-dc7f-4390-a38f-12d2d2119145 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:02.627339 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6d0d5-dc7f-4390-a38f-12d2d2119145 None admin] RBAC: Adding query filter params (role.id=0e57d142f86c471883fc07a89fe66ec8, scope.project.id=84233d5525dd4b14844631e01fc23225, user.id=7c66ff245f964f369459916b5f64d288) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:02.627649 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6d0d5-dc7f-4390-a38f-12d2d2119145 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:02.629057 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6d0d5-dc7f-4390-a38f-12d2d2119145 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:02.634385 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 566/1146] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:40:02 2022] GET /identity/v3/role_assignments?user.id=7c66ff245f964f369459916b5f64d288&scope.project.id=84233d5525dd4b14844631e01fc23225&role.id=0e57d142f86c471883fc07a89fe66ec8 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:04.592199 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2574a1-17e0-4c45-822a-e60db4eae084 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:04.592716 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2574a1-17e0-4c45-822a-e60db4eae084 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:04.592716 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2574a1-17e0-4c45-822a-e60db4eae084 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:04.594037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 581/1147] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:40:04.599081 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a26e8-52a6-46a1-bddf-26931bccbbbc None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:04.599459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a26e8-52a6-46a1-bddf-26931bccbbbc None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:04.599642 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a26e8-52a6-46a1-bddf-26931bccbbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:04.618068 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-e29a26e8-52a6-46a1-bddf-26931bccbbbc None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:04.619268 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-e29a26e8-52a6-46a1-bddf-26931bccbbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:04.664760 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:04.685119 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 567/1148] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:40:04.707226 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2574a1-17e0-4c45-822a-e60db4eae084 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:04.806177 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2574a1-17e0-4c45-822a-e60db4eae084 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:04.839895 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce714a7b-e292-4da4-8d9b-f2347ea1f1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:04.840520 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce714a7b-e292-4da4-8d9b-f2347ea1f1c9 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:04.840802 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce714a7b-e292-4da4-8d9b-f2347ea1f1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:04.841078 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce714a7b-e292-4da4-8d9b-f2347ea1f1c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:04.847742 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:04.851881 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce714a7b-e292-4da4-8d9b-f2347ea1f1c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:40:04.857735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-ce714a7b-e292-4da4-8d9b-f2347ea1f1c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:40:04.857735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:40:04.857735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:40:04.857735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:40:04.857735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:40:04.857735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:40:04.857735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:40:04.857735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:40:04.857735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:40:04.857735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:40:04.857735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:40:04.857735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:40:04.857735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:40:04.857735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:40:04.857735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:40:04.857735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:40:04.858848 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:40:04.858848 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:40:04.858848 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:40:04.858848 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:40:04.858848 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:40:04.858848 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:40:04.858848 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:40:04.858848 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:40:04.858848 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:40:04.858848 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:40:04.858848 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:40:04.858848 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:40:04.858848 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:40:04.858848 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:40:04.858848 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:40:04.858848 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:40:04.859840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:40:04.859840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:40:04.859840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:40:04.859840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:40:04.859840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:40:04.859840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:40:04.859840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:40:04.859840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:40:04.859840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:40:04.859840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:40:04.859840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:40:04.859840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:40:04.859840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 582/1149] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 3 12:40:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:40:04.865025 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a26e8-52a6-46a1-bddf-26931bccbbbc None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:04.958862 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a26e8-52a6-46a1-bddf-26931bccbbbc None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:04.992003 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d222433-8c54-4dbf-8e26-29afd7d9ad5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:04.992606 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d222433-8c54-4dbf-8e26-29afd7d9ad5a None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:04.992884 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d222433-8c54-4dbf-8e26-29afd7d9ad5a None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:04.993157 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d222433-8c54-4dbf-8e26-29afd7d9ad5a None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:04.993890 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d222433-8c54-4dbf-8e26-29afd7d9ad5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:04.994190 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d222433-8c54-4dbf-8e26-29afd7d9ad5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:04.995697 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d222433-8c54-4dbf-8e26-29afd7d9ad5a None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:05.003633 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 568/1150] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:40:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:05.009420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce714a7b-e292-4da4-8d9b-f2347ea1f1c9 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:05.108234 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce714a7b-e292-4da4-8d9b-f2347ea1f1c9 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:05.140657 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ac9d9-965e-449c-8538-09b06fa9b461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:05.141291 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ac9d9-965e-449c-8538-09b06fa9b461 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:05.141601 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ac9d9-965e-449c-8538-09b06fa9b461 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:05.141877 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ac9d9-965e-449c-8538-09b06fa9b461 None admin] PATH_INFO: `/v3/users/7c66ff245f964f369459916b5f64d288` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:05.143023 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940ac9d9-965e-449c-8538-09b06fa9b461 None admin] RBAC: Authorizing `identity:get_user(user_id=7c66ff245f964f369459916b5f64d288)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:05.144453 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940ac9d9-965e-449c-8538-09b06fa9b461 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:05.146069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 583/1151] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:40:05 2022] GET /identity/v3/users/7c66ff245f964f369459916b5f64d288 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:05.152541 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d222433-8c54-4dbf-8e26-29afd7d9ad5a None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:05.196348 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:05.249664 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d222433-8c54-4dbf-8e26-29afd7d9ad5a None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:05.283355 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a90aa8-eecd-44fb-8719-29572f0b9e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:05.283995 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a90aa8-eecd-44fb-8719-29572f0b9e99 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:05.284282 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a90aa8-eecd-44fb-8719-29572f0b9e99 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:05.284561 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a90aa8-eecd-44fb-8719-29572f0b9e99 None admin] PATH_INFO: `/v3/projects/84233d5525dd4b14844631e01fc23225` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:05.285730 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a90aa8-eecd-44fb-8719-29572f0b9e99 None admin] RBAC: Authorizing `identity:get_project(project_id=84233d5525dd4b14844631e01fc23225)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:05.287166 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a90aa8-eecd-44fb-8719-29572f0b9e99 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:05.288849 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 569/1152] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:40:05 2022] GET /identity/v3/projects/84233d5525dd4b14844631e01fc23225 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:05.295190 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ac9d9-965e-449c-8538-09b06fa9b461 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:05.357575 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:05.390823 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ac9d9-965e-449c-8538-09b06fa9b461 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:05.423110 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5838cb8-0d9f-46e1-9361-18651b4e9722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:05.423752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5838cb8-0d9f-46e1-9361-18651b4e9722 None admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:05.424028 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5838cb8-0d9f-46e1-9361-18651b4e9722 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:05.424297 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5838cb8-0d9f-46e1-9361-18651b4e9722 None admin] PATH_INFO: `/v3/projects/84233d5525dd4b14844631e01fc23225/users/7c66ff245f964f369459916b5f64d288/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:05.426206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5838cb8-0d9f-46e1-9361-18651b4e9722 None admin] RBAC: Authorizing `identity:create_grant(project_id=84233d5525dd4b14844631e01fc23225, user_id=7c66ff245f964f369459916b5f64d288, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:05.427624 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5838cb8-0d9f-46e1-9361-18651b4e9722 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:05.440540 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 584/1153] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 3 12:40:05 2022] PUT /identity/v3/projects/84233d5525dd4b14844631e01fc23225/users/7c66ff245f964f369459916b5f64d288/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:40:07.412363 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5268b-a1d0-4f05-87af-51a8dd857488 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:07.412903 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5268b-a1d0-4f05-87af-51a8dd857488 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:07.412903 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5268b-a1d0-4f05-87af-51a8dd857488 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:07.414310 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 570/1154] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:40:07.419501 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb66bc9-dcdd-410e-bdc5-652b37bbac7d None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:07.419873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb66bc9-dcdd-410e-bdc5-652b37bbac7d None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:07.420055 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb66bc9-dcdd-410e-bdc5-652b37bbac7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:07.438329 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-5cb66bc9-dcdd-410e-bdc5-652b37bbac7d None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:07.439530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-5cb66bc9-dcdd-410e-bdc5-652b37bbac7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:07.506162 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 585/1155] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:40:07.530661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5268b-a1d0-4f05-87af-51a8dd857488 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:07.638248 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5268b-a1d0-4f05-87af-51a8dd857488 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:07.651132 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:07.672491 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297b8eb-a450-4da5-bb4e-7a7cb26985ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:07.673124 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297b8eb-a450-4da5-bb4e-7a7cb26985ec None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:07.673408 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297b8eb-a450-4da5-bb4e-7a7cb26985ec None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:07.673717 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297b8eb-a450-4da5-bb4e-7a7cb26985ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:07.684323 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297b8eb-a450-4da5-bb4e-7a7cb26985ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:40:07.689262 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-f297b8eb-a450-4da5-bb4e-7a7cb26985ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:40:07.689262 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:40:07.689262 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:40:07.689262 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:40:07.689262 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:40:07.689262 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:40:07.689262 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:40:07.689262 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:40:07.689262 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:40:07.689262 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:40:07.689262 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:40:07.689262 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:40:07.689262 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:40:07.689262 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:40:07.689262 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:40:07.689262 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:40:07.690383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:40:07.690383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:40:07.690383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:40:07.690383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:40:07.690383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:40:07.690383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:40:07.690383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:40:07.690383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:40:07.690383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:40:07.690383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:40:07.690383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:40:07.690383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:40:07.690383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:40:07.690383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:40:07.690383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:40:07.690383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:40:07.691628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:40:07.691628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:40:07.691628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:40:07.691628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:40:07.691628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:40:07.691628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:40:07.691628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:40:07.691628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:40:07.691628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:40:07.691628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:40:07.691628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:40:07.691628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:40:07.691628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 571/1156] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 3 12:40:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:40:07.696443 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb66bc9-dcdd-410e-bdc5-652b37bbac7d None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:07.750976 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:07.794363 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb66bc9-dcdd-410e-bdc5-652b37bbac7d None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:07.826922 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479928ba-2707-4085-8c4c-e0c65277c184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:07.827522 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479928ba-2707-4085-8c4c-e0c65277c184 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:07.827806 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479928ba-2707-4085-8c4c-e0c65277c184 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:07.828082 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479928ba-2707-4085-8c4c-e0c65277c184 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:07.828795 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479928ba-2707-4085-8c4c-e0c65277c184 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:07.829098 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479928ba-2707-4085-8c4c-e0c65277c184 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:07.830488 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479928ba-2707-4085-8c4c-e0c65277c184 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:07.838880 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 586/1157] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:40:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:07.844474 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297b8eb-a450-4da5-bb4e-7a7cb26985ec None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:07.941909 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297b8eb-a450-4da5-bb4e-7a7cb26985ec None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:07.974723 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a020e-3d09-4bfe-a0c1-937c8bab2759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:07.975347 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a020e-3d09-4bfe-a0c1-937c8bab2759 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:07.975623 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a020e-3d09-4bfe-a0c1-937c8bab2759 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:07.975891 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a020e-3d09-4bfe-a0c1-937c8bab2759 None admin] PATH_INFO: `/v3/users/7c66ff245f964f369459916b5f64d288` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:07.977014 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a020e-3d09-4bfe-a0c1-937c8bab2759 None admin] RBAC: Authorizing `identity:get_user(user_id=7c66ff245f964f369459916b5f64d288)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:07.978464 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a020e-3d09-4bfe-a0c1-937c8bab2759 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:07.980748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 572/1158] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:40:07 2022] GET /identity/v3/users/7c66ff245f964f369459916b5f64d288 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:07.986508 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479928ba-2707-4085-8c4c-e0c65277c184 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:08.081578 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479928ba-2707-4085-8c4c-e0c65277c184 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:08.097964 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:08.114688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383c041-3b0f-4c4b-a828-516c15226625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:08.115292 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383c041-3b0f-4c4b-a828-516c15226625 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:08.115572 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383c041-3b0f-4c4b-a828-516c15226625 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:08.115846 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383c041-3b0f-4c4b-a828-516c15226625 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:08.180217 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383c041-3b0f-4c4b-a828-516c15226625 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:08.181709 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383c041-3b0f-4c4b-a828-516c15226625 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:08.277974 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 587/1159] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:40:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:40:08.283768 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a020e-3d09-4bfe-a0c1-937c8bab2759 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:08.324456 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:08.380147 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a020e-3d09-4bfe-a0c1-937c8bab2759 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:08.412511 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b096082-0d3b-4a7e-8995-a934a707ede9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:08.413130 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b096082-0d3b-4a7e-8995-a934a707ede9 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:08.413409 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b096082-0d3b-4a7e-8995-a934a707ede9 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:08.413713 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b096082-0d3b-4a7e-8995-a934a707ede9 None admin] PATH_INFO: `/v3/projects/84233d5525dd4b14844631e01fc23225` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:08.414836 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b096082-0d3b-4a7e-8995-a934a707ede9 None admin] RBAC: Authorizing `identity:get_project(project_id=84233d5525dd4b14844631e01fc23225)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:08.416239 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b096082-0d3b-4a7e-8995-a934a707ede9 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:08.417934 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 573/1160] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:40:08 2022] GET /identity/v3/projects/84233d5525dd4b14844631e01fc23225 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:08.424004 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383c041-3b0f-4c4b-a828-516c15226625 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:08.441698 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:08.520207 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383c041-3b0f-4c4b-a828-516c15226625 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:08.552866 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f9dc5-5fb8-4c95-8e17-70646469d6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:08.553465 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f9dc5-5fb8-4c95-8e17-70646469d6fc None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:08.553778 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f9dc5-5fb8-4c95-8e17-70646469d6fc None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:08.554052 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f9dc5-5fb8-4c95-8e17-70646469d6fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:08.554833 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f9dc5-5fb8-4c95-8e17-70646469d6fc None admin] RBAC: Adding query filter params (role.id=0e57d142f86c471883fc07a89fe66ec8, scope.project.id=84233d5525dd4b14844631e01fc23225, user.id=7c66ff245f964f369459916b5f64d288) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:08.555139 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f9dc5-5fb8-4c95-8e17-70646469d6fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:08.556557 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f9dc5-5fb8-4c95-8e17-70646469d6fc None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:08.562754 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 588/1161] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:40:08 2022] GET /identity/v3/role_assignments?user.id=7c66ff245f964f369459916b5f64d288&scope.project.id=84233d5525dd4b14844631e01fc23225&role.id=0e57d142f86c471883fc07a89fe66ec8 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:10.585017 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8385534-995e-4648-8f84-2001ab182d0f None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:10.585560 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8385534-995e-4648-8f84-2001ab182d0f None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:10.585560 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8385534-995e-4648-8f84-2001ab182d0f None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:10.586878 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 574/1162] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:40:10.592137 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ac2fa-3a07-4c39-a69d-f49713311163 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:10.592515 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ac2fa-3a07-4c39-a69d-f49713311163 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:10.592688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ac2fa-3a07-4c39-a69d-f49713311163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:10.611140 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-762ac2fa-3a07-4c39-a69d-f49713311163 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:10.612337 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-762ac2fa-3a07-4c39-a69d-f49713311163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:10.677649 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 589/1163] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:40:10.699705 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8385534-995e-4648-8f84-2001ab182d0f None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:10.798563 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8385534-995e-4648-8f84-2001ab182d0f None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:10.807922 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:10.831630 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b869f7-f769-4c65-8768-b0a07977294f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:10.832229 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b869f7-f769-4c65-8768-b0a07977294f None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:10.832516 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b869f7-f769-4c65-8768-b0a07977294f None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:10.832789 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b869f7-f769-4c65-8768-b0a07977294f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:10.897891 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b869f7-f769-4c65-8768-b0a07977294f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:10.899261 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b869f7-f769-4c65-8768-b0a07977294f None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:10.993517 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 575/1164] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:40:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:40:10.999684 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ac2fa-3a07-4c39-a69d-f49713311163 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:11.013322 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:11.095751 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ac2fa-3a07-4c39-a69d-f49713311163 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:11.128657 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10bb57c-a54a-424f-8f86-15bee500f85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:11.129294 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bb57c-a54a-424f-8f86-15bee500f85c None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:11.129628 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bb57c-a54a-424f-8f86-15bee500f85c None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:11.129905 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bb57c-a54a-424f-8f86-15bee500f85c None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:11.136741 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10bb57c-a54a-424f-8f86-15bee500f85c None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:11.138231 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10bb57c-a54a-424f-8f86-15bee500f85c None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:11.149659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-a10bb57c-a54a-424f-8f86-15bee500f85c None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 03 12:40:11.149659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:40:11.149659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 03 12:40:11.149659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 03 12:40:11.149659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:40:11.149659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:40:11.149659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:40:11.149659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:40:11.149659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 03 12:40:11.149659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:40:11.149659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:40:11.149659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:40:11.149659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:40:11.149659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:40:11.149659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:40:11.149659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:40:11.149659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:40:11.151394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:40:11.151394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:40:11.151394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:40:11.151394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:40:11.151394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:40:11.151394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:40:11.151394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:40:11.151394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:40:11.151394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:40:11.151394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:40:11.151394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:40:11.151394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:40:11.151394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:40:11.151394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:40:11.151394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:40:11.151394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:40:11.152420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:40:11.152420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:40:11.152420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:40:11.152420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:40:11.152420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:40:11.152420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:40:11.152420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:40:11.152420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:40:11.152420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:40:11.152420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:40:11.152420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 03 12:40:11.152420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:40:11.152420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 03 12:40:11.152420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:40:11.152420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 590/1165] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Aug 3 12:40:10 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:40:11.157389 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b869f7-f769-4c65-8768-b0a07977294f None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:11.167995 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:11.253181 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b869f7-f769-4c65-8768-b0a07977294f None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:11.286920 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cfb21-ee81-4f26-baa1-9fa54b3ca4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:11.287520 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cfb21-ee81-4f26-baa1-9fa54b3ca4b8 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:11.287800 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cfb21-ee81-4f26-baa1-9fa54b3ca4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:11.288068 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cfb21-ee81-4f26-baa1-9fa54b3ca4b8 None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:11.288748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cfb21-ee81-4f26-baa1-9fa54b3ca4b8 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:11.289048 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cfb21-ee81-4f26-baa1-9fa54b3ca4b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:11.290431 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cfb21-ee81-4f26-baa1-9fa54b3ca4b8 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:11.297503 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 576/1166] 10.222.0.46 () {56 vars in 1115 bytes} [Wed Aug 3 12:40:11 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:13.267567 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6f3dc-6e78-4fd3-ae1c-da388d46a1b4 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:13.268106 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6f3dc-6e78-4fd3-ae1c-da388d46a1b4 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:13.268106 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6f3dc-6e78-4fd3-ae1c-da388d46a1b4 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:13.269478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 591/1167] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:40:13.274631 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb0bb3-5412-48bd-9587-e7900d12b8ab None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:13.275031 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb0bb3-5412-48bd-9587-e7900d12b8ab None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:13.275185 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb0bb3-5412-48bd-9587-e7900d12b8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:13.293725 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-ffdb0bb3-5412-48bd-9587-e7900d12b8ab None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:13.294930 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-ffdb0bb3-5412-48bd-9587-e7900d12b8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:13.359047 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 577/1168] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:40:13.381845 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6f3dc-6e78-4fd3-ae1c-da388d46a1b4 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:13.451223 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:13.480878 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6f3dc-6e78-4fd3-ae1c-da388d46a1b4 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:13.513281 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39282c-4e3d-4f8a-9ed7-35033c1bc0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:13.513917 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39282c-4e3d-4f8a-9ed7-35033c1bc0a2 None admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:13.514200 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39282c-4e3d-4f8a-9ed7-35033c1bc0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:13.514475 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39282c-4e3d-4f8a-9ed7-35033c1bc0a2 None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:13.515522 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39282c-4e3d-4f8a-9ed7-35033c1bc0a2 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:13.516880 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39282c-4e3d-4f8a-9ed7-35033c1bc0a2 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:13.532252 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 592/1169] 10.222.0.46 () {60 vars in 1138 bytes} [Wed Aug 3 12:40:13 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:40:15.550337 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea8365-0f07-447d-b253-25c725ca957f None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:15.550838 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea8365-0f07-447d-b253-25c725ca957f None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:15.550838 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea8365-0f07-447d-b253-25c725ca957f None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:15.552178 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 578/1170] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:40:15.557867 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77236f-93f4-455d-8d95-54792edc9282 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:15.558281 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77236f-93f4-455d-8d95-54792edc9282 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:15.558405 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77236f-93f4-455d-8d95-54792edc9282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:15.576511 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-4e77236f-93f4-455d-8d95-54792edc9282 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:15.577711 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-4e77236f-93f4-455d-8d95-54792edc9282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:15.641109 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 593/1171] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:40:15.663340 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea8365-0f07-447d-b253-25c725ca957f None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:15.666299 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:15.763193 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea8365-0f07-447d-b253-25c725ca957f None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:15.795747 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3c65b-b384-49db-a53e-381f07e340ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:15.796368 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3c65b-b384-49db-a53e-381f07e340ca None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:15.796645 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3c65b-b384-49db-a53e-381f07e340ca None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:15.796914 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3c65b-b384-49db-a53e-381f07e340ca None admin] PATH_INFO: `/v3/domains/09d2c1af56b54421b476606fedc65580` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:15.807037 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3c65b-b384-49db-a53e-381f07e340ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=09d2c1af56b54421b476606fedc65580)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:15.808426 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3c65b-b384-49db-a53e-381f07e340ca None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:15.810047 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 579/1172] 10.222.0.46 () {56 vars in 1183 bytes} [Wed Aug 3 12:40:15 2022] GET /identity/v3/domains/09d2c1af56b54421b476606fedc65580 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:15.815826 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77236f-93f4-455d-8d95-54792edc9282 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:15.874325 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:15.913430 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77236f-93f4-455d-8d95-54792edc9282 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:15.948505 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d98e6f-5e8e-4313-bee2-100d55579c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:15.949181 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d98e6f-5e8e-4313-bee2-100d55579c22 None admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:15.949461 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d98e6f-5e8e-4313-bee2-100d55579c22 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:15.949761 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d98e6f-5e8e-4313-bee2-100d55579c22 None admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:15.950434 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d98e6f-5e8e-4313-bee2-100d55579c22 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:15.951851 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d98e6f-5e8e-4313-bee2-100d55579c22 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:15.977558 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 594/1173] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Aug 3 12:40:15 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:40:17.955139 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500a3fc-917a-47c1-8e35-b1b17df81ba9 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:17.955668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500a3fc-917a-47c1-8e35-b1b17df81ba9 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:17.955668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500a3fc-917a-47c1-8e35-b1b17df81ba9 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:17.957055 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 580/1174] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:40:17.962061 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec72953-81a1-4a45-bb32-1d157cd4f634 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:17.962433 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec72953-81a1-4a45-bb32-1d157cd4f634 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:17.962618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec72953-81a1-4a45-bb32-1d157cd4f634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:17.980802 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-dec72953-81a1-4a45-bb32-1d157cd4f634 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:17.982016 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-dec72953-81a1-4a45-bb32-1d157cd4f634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:18.046260 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 595/1175] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:40:18.070164 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500a3fc-917a-47c1-8e35-b1b17df81ba9 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:18.132560 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:18.171988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500a3fc-917a-47c1-8e35-b1b17df81ba9 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:18.205227 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b2d95-f295-45eb-ae62-35742a2b77c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:18.205819 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b2d95-f295-45eb-ae62-35742a2b77c4 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:18.206103 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b2d95-f295-45eb-ae62-35742a2b77c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:18.206379 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b2d95-f295-45eb-ae62-35742a2b77c4 None admin] PATH_INFO: `/v3/domains/09d2c1af56b54421b476606fedc65580` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:18.207520 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b2d95-f295-45eb-ae62-35742a2b77c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=09d2c1af56b54421b476606fedc65580)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:18.208944 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b2d95-f295-45eb-ae62-35742a2b77c4 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:18.210566 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 581/1176] 10.222.0.46 () {56 vars in 1183 bytes} [Wed Aug 3 12:40:18 2022] GET /identity/v3/domains/09d2c1af56b54421b476606fedc65580 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:18.216577 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec72953-81a1-4a45-bb32-1d157cd4f634 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:18.261230 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:18.315314 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec72953-81a1-4a45-bb32-1d157cd4f634 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:18.348660 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ac70a-861d-4f8b-81e0-5eeb77995401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:18.349263 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ac70a-861d-4f8b-81e0-5eeb77995401 None admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:18.349574 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ac70a-861d-4f8b-81e0-5eeb77995401 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:18.349848 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ac70a-861d-4f8b-81e0-5eeb77995401 None admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:18.350528 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ac70a-861d-4f8b-81e0-5eeb77995401 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:18.351947 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ac70a-861d-4f8b-81e0-5eeb77995401 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:18.373023 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 596/1177] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Aug 3 12:40:18 2022] POST /identity/v3/users => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:40:20.423390 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ded01-96cd-41c9-a90b-a54432ac01ce None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:20.423912 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ded01-96cd-41c9-a90b-a54432ac01ce None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:20.423912 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ded01-96cd-41c9-a90b-a54432ac01ce None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:20.425275 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 582/1178] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:40:20.430532 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106a094-9c43-447e-b13b-7546c3796e02 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:20.430931 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106a094-9c43-447e-b13b-7546c3796e02 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:20.431082 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106a094-9c43-447e-b13b-7546c3796e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:20.449692 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-6106a094-9c43-447e-b13b-7546c3796e02 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:20.450876 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-6106a094-9c43-447e-b13b-7546c3796e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:20.515118 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 597/1179] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:40:20.537995 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ded01-96cd-41c9-a90b-a54432ac01ce None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:20.637132 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ded01-96cd-41c9-a90b-a54432ac01ce None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:20.664702 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:20.671327 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401698ec-c4e9-4c17-abef-8525828c1bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:20.671950 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401698ec-c4e9-4c17-abef-8525828c1bf7 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:20.672234 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401698ec-c4e9-4c17-abef-8525828c1bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:20.672508 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401698ec-c4e9-4c17-abef-8525828c1bf7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:20.682411 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401698ec-c4e9-4c17-abef-8525828c1bf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:40:20.687283 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-401698ec-c4e9-4c17-abef-8525828c1bf7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:40:20.687283 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:40:20.687283 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:40:20.687283 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:40:20.687283 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:40:20.687283 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:40:20.687283 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:40:20.687283 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:40:20.687283 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:40:20.687283 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:40:20.687283 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:40:20.687283 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:40:20.687283 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:40:20.687283 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:40:20.687283 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:40:20.687283 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:40:20.688371 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:40:20.688371 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:40:20.688371 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:40:20.688371 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:40:20.688371 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:40:20.688371 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:40:20.688371 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:40:20.688371 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:40:20.688371 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:40:20.688371 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:40:20.688371 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:40:20.688371 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:40:20.688371 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:40:20.688371 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:40:20.688371 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:40:20.688371 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:40:20.689428 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:40:20.689428 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:40:20.689428 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:40:20.689428 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:40:20.689428 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:40:20.689428 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:40:20.689428 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:40:20.689428 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:40:20.689428 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:40:20.689428 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:40:20.689428 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:40:20.689428 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:40:20.689428 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 583/1180] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 3 12:40:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:40:20.694669 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106a094-9c43-447e-b13b-7546c3796e02 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:20.724149 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:20.793575 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106a094-9c43-447e-b13b-7546c3796e02 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:20.826178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8cca8-58dd-416a-9474-8c1498dbb1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:20.826795 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8cca8-58dd-416a-9474-8c1498dbb1c3 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:20.827078 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8cca8-58dd-416a-9474-8c1498dbb1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:20.827351 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8cca8-58dd-416a-9474-8c1498dbb1c3 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:20.828076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8cca8-58dd-416a-9474-8c1498dbb1c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:20.828411 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8cca8-58dd-416a-9474-8c1498dbb1c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:20.829806 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8cca8-58dd-416a-9474-8c1498dbb1c3 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:20.837749 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 598/1181] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:40:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:20.844182 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401698ec-c4e9-4c17-abef-8525828c1bf7 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:20.940427 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401698ec-c4e9-4c17-abef-8525828c1bf7 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:20.973441 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127787f-b68e-443c-acb8-d54305d927fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:20.974088 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127787f-b68e-443c-acb8-d54305d927fe None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:20.974365 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127787f-b68e-443c-acb8-d54305d927fe None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:20.974633 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127787f-b68e-443c-acb8-d54305d927fe None admin] PATH_INFO: `/v3/users/5072bf95e6e04e8c8553849719d7342a` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:20.987769 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127787f-b68e-443c-acb8-d54305d927fe None admin] RBAC: Authorizing `identity:get_user(user_id=5072bf95e6e04e8c8553849719d7342a)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:20.989180 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127787f-b68e-443c-acb8-d54305d927fe None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:20.990803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 584/1182] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:40:20 2022] GET /identity/v3/users/5072bf95e6e04e8c8553849719d7342a => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:20.996998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8cca8-58dd-416a-9474-8c1498dbb1c3 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:21.085202 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:21.094814 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8cca8-58dd-416a-9474-8c1498dbb1c3 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:21.127174 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f78ce-b85d-46ad-8646-05e13e36f832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:21.127777 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f78ce-b85d-46ad-8646-05e13e36f832 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:21.128058 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f78ce-b85d-46ad-8646-05e13e36f832 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:21.128332 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f78ce-b85d-46ad-8646-05e13e36f832 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:21.192529 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f78ce-b85d-46ad-8646-05e13e36f832 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:21.194007 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f78ce-b85d-46ad-8646-05e13e36f832 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:21.281667 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:21.291458 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 599/1183] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:40:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:40:21.297282 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127787f-b68e-443c-acb8-d54305d927fe None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:21.352680 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:21.403289 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127787f-b68e-443c-acb8-d54305d927fe None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:21.436053 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38205d-8d34-446f-a202-0e359ff79cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:21.436691 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38205d-8d34-446f-a202-0e359ff79cd3 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:21.436972 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38205d-8d34-446f-a202-0e359ff79cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:21.437248 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38205d-8d34-446f-a202-0e359ff79cd3 None admin] PATH_INFO: `/v3/projects/227de015269743eea8a82df14e400a65` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:21.438422 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38205d-8d34-446f-a202-0e359ff79cd3 None admin] RBAC: Authorizing `identity:get_project(project_id=227de015269743eea8a82df14e400a65)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:21.439844 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38205d-8d34-446f-a202-0e359ff79cd3 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:21.441535 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 585/1184] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:40:21 2022] GET /identity/v3/projects/227de015269743eea8a82df14e400a65 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:21.448305 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f78ce-b85d-46ad-8646-05e13e36f832 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:21.544196 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f78ce-b85d-46ad-8646-05e13e36f832 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:21.577596 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba12fc-757b-40ab-a1c3-4eadfa9f5cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:21.578200 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba12fc-757b-40ab-a1c3-4eadfa9f5cf3 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:21.578484 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba12fc-757b-40ab-a1c3-4eadfa9f5cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:21.578760 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba12fc-757b-40ab-a1c3-4eadfa9f5cf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:21.579550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba12fc-757b-40ab-a1c3-4eadfa9f5cf3 None admin] RBAC: Adding query filter params (role.id=0e57d142f86c471883fc07a89fe66ec8, scope.project.id=227de015269743eea8a82df14e400a65, user.id=5072bf95e6e04e8c8553849719d7342a) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:21.579863 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba12fc-757b-40ab-a1c3-4eadfa9f5cf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:21.581293 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba12fc-757b-40ab-a1c3-4eadfa9f5cf3 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:21.586535 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 600/1185] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:40:21 2022] GET /identity/v3/role_assignments?user.id=5072bf95e6e04e8c8553849719d7342a&scope.project.id=227de015269743eea8a82df14e400a65&role.id=0e57d142f86c471883fc07a89fe66ec8 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:23.568963 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577b88c-dd21-4a41-bab5-0f028540e7d1 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:23.569531 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577b88c-dd21-4a41-bab5-0f028540e7d1 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:23.569531 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577b88c-dd21-4a41-bab5-0f028540e7d1 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:23.570823 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 586/1186] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:40:23.576602 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda274ee-9857-4efd-a418-4f036084d3eb None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:23.577003 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda274ee-9857-4efd-a418-4f036084d3eb None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:23.577158 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda274ee-9857-4efd-a418-4f036084d3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:23.595708 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-eda274ee-9857-4efd-a418-4f036084d3eb None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:23.596905 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-eda274ee-9857-4efd-a418-4f036084d3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:23.647250 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:23.663632 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 601/1187] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:40:23.686614 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577b88c-dd21-4a41-bab5-0f028540e7d1 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:23.792105 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577b88c-dd21-4a41-bab5-0f028540e7d1 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:23.808407 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:23.826520 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81fd66-6088-4c39-89d9-c32aba247456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:23.827089 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81fd66-6088-4c39-89d9-c32aba247456 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:23.827372 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81fd66-6088-4c39-89d9-c32aba247456 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:23.827648 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81fd66-6088-4c39-89d9-c32aba247456 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:23.837431 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81fd66-6088-4c39-89d9-c32aba247456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:40:23.842803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-4f81fd66-6088-4c39-89d9-c32aba247456 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:40:23.842803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:40:23.842803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:40:23.842803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:40:23.842803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:40:23.842803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:40:23.842803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:40:23.842803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:40:23.842803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:40:23.842803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:40:23.842803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:40:23.842803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:40:23.842803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:40:23.842803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:40:23.842803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:40:23.842803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:40:23.843966 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:40:23.843966 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:40:23.843966 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:40:23.843966 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:40:23.843966 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:40:23.843966 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:40:23.843966 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:40:23.843966 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:40:23.843966 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:40:23.843966 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:40:23.843966 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:40:23.843966 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:40:23.843966 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:40:23.843966 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:40:23.843966 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:40:23.843966 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:40:23.845051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:40:23.845051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:40:23.845051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:40:23.845051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:40:23.845051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:40:23.845051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:40:23.845051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:40:23.845051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:40:23.845051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:40:23.845051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:40:23.845051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:40:23.845051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:40:23.845051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 587/1188] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 3 12:40:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:40:23.850145 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda274ee-9857-4efd-a418-4f036084d3eb None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:23.945143 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda274ee-9857-4efd-a418-4f036084d3eb None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:23.977759 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04900877-5d63-478d-a056-000ad54855d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:23.978362 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04900877-5d63-478d-a056-000ad54855d3 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:23.979183 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04900877-5d63-478d-a056-000ad54855d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:23.979455 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04900877-5d63-478d-a056-000ad54855d3 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:23.980258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04900877-5d63-478d-a056-000ad54855d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:23.980564 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04900877-5d63-478d-a056-000ad54855d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:23.981969 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04900877-5d63-478d-a056-000ad54855d3 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:23.989770 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 602/1189] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:40:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:23.996408 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81fd66-6088-4c39-89d9-c32aba247456 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:24.092817 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81fd66-6088-4c39-89d9-c32aba247456 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:24.126293 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f02ad-c88e-42a4-9dae-dc3bda07f2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:24.126914 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f02ad-c88e-42a4-9dae-dc3bda07f2e8 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:24.127198 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f02ad-c88e-42a4-9dae-dc3bda07f2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:24.127474 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f02ad-c88e-42a4-9dae-dc3bda07f2e8 None admin] PATH_INFO: `/v3/users/5072bf95e6e04e8c8553849719d7342a` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:24.128621 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f02ad-c88e-42a4-9dae-dc3bda07f2e8 None admin] RBAC: Authorizing `identity:get_user(user_id=5072bf95e6e04e8c8553849719d7342a)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:24.130067 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f02ad-c88e-42a4-9dae-dc3bda07f2e8 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:24.131644 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 588/1190] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:40:23 2022] GET /identity/v3/users/5072bf95e6e04e8c8553849719d7342a => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:24.137334 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04900877-5d63-478d-a056-000ad54855d3 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:24.184589 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:24.232944 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04900877-5d63-478d-a056-000ad54855d3 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:24.265139 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d220db2-a5bb-41d1-b889-4993e74ab137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:24.265793 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d220db2-a5bb-41d1-b889-4993e74ab137 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:24.266075 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d220db2-a5bb-41d1-b889-4993e74ab137 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:24.266346 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d220db2-a5bb-41d1-b889-4993e74ab137 None admin] PATH_INFO: `/v3/projects/227de015269743eea8a82df14e400a65` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:24.267491 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d220db2-a5bb-41d1-b889-4993e74ab137 None admin] RBAC: Authorizing `identity:get_project(project_id=227de015269743eea8a82df14e400a65)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:24.268914 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d220db2-a5bb-41d1-b889-4993e74ab137 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:24.270607 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 603/1191] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:40:24 2022] GET /identity/v3/projects/227de015269743eea8a82df14e400a65 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:24.276629 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f02ad-c88e-42a4-9dae-dc3bda07f2e8 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:24.321879 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:24.375923 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f02ad-c88e-42a4-9dae-dc3bda07f2e8 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:24.409189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26bfb5e-b626-4ede-846d-b72506ff16ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:24.409875 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26bfb5e-b626-4ede-846d-b72506ff16ea None admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:24.410166 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26bfb5e-b626-4ede-846d-b72506ff16ea None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:24.410443 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26bfb5e-b626-4ede-846d-b72506ff16ea None admin] PATH_INFO: `/v3/projects/227de015269743eea8a82df14e400a65/users/5072bf95e6e04e8c8553849719d7342a/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:24.412354 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26bfb5e-b626-4ede-846d-b72506ff16ea None admin] RBAC: Authorizing `identity:create_grant(project_id=227de015269743eea8a82df14e400a65, user_id=5072bf95e6e04e8c8553849719d7342a, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:24.413802 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26bfb5e-b626-4ede-846d-b72506ff16ea None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:24.426887 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 589/1192] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 3 12:40:24 2022] PUT /identity/v3/projects/227de015269743eea8a82df14e400a65/users/5072bf95e6e04e8c8553849719d7342a/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:40:26.395554 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2b8ca-5033-4ff5-b5c9-d0e8cdd6856a None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:26.396084 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2b8ca-5033-4ff5-b5c9-d0e8cdd6856a None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:26.396084 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2b8ca-5033-4ff5-b5c9-d0e8cdd6856a None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:26.397465 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 604/1193] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:40:26.402571 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27270f8d-086c-4305-99c7-bdfbb1c8fbc5 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:26.402994 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27270f8d-086c-4305-99c7-bdfbb1c8fbc5 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:26.403123 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27270f8d-086c-4305-99c7-bdfbb1c8fbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:26.421334 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-27270f8d-086c-4305-99c7-bdfbb1c8fbc5 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:40:26.422572 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-27270f8d-086c-4305-99c7-bdfbb1c8fbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:40:26.487546 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 590/1194] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:40:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:40:26.511265 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2b8ca-5033-4ff5-b5c9-d0e8cdd6856a None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:26.610694 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2b8ca-5033-4ff5-b5c9-d0e8cdd6856a None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:26.626196 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:26.643580 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4622634-e127-4c15-a9eb-96b0b72e3578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:26.644207 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4622634-e127-4c15-a9eb-96b0b72e3578 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:26.644488 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4622634-e127-4c15-a9eb-96b0b72e3578 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:26.644762 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4622634-e127-4c15-a9eb-96b0b72e3578 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:26.655468 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4622634-e127-4c15-a9eb-96b0b72e3578 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:40:26.660337 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-a4622634-e127-4c15-a9eb-96b0b72e3578 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:40:26.660337 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:40:26.660337 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:40:26.660337 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:40:26.660337 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:40:26.660337 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:40:26.660337 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:40:26.660337 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:40:26.660337 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:40:26.660337 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:40:26.660337 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:40:26.660337 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:40:26.660337 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:40:26.660337 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:40:26.660337 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:40:26.660337 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:40:26.661425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:40:26.661425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:40:26.661425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:40:26.661425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:40:26.661425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:40:26.661425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:40:26.661425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:40:26.661425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:40:26.661425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:40:26.661425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:40:26.661425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:40:26.661425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:40:26.661425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:40:26.661425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:40:26.661425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:40:26.661425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:40:26.662345 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:40:26.662345 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:40:26.662345 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:40:26.662345 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:40:26.662345 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:40:26.662345 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:40:26.662345 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:40:26.662345 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:40:26.662345 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:40:26.662345 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:40:26.662345 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:40:26.662345 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:40:26.662345 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 605/1195] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 3 12:40:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:40:26.668285 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27270f8d-086c-4305-99c7-bdfbb1c8fbc5 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:26.699851 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:26.765248 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27270f8d-086c-4305-99c7-bdfbb1c8fbc5 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:26.798531 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d20778-0ac2-46af-b50c-2356cd35048e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:26.799137 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d20778-0ac2-46af-b50c-2356cd35048e None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:26.799419 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d20778-0ac2-46af-b50c-2356cd35048e None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:26.799695 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d20778-0ac2-46af-b50c-2356cd35048e None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:26.800406 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d20778-0ac2-46af-b50c-2356cd35048e None admin] RBAC: Adding query filter params (name=admin) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:26.800716 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d20778-0ac2-46af-b50c-2356cd35048e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:26.802097 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d20778-0ac2-46af-b50c-2356cd35048e None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:26.810002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 591/1196] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:40:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:26.815668 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4622634-e127-4c15-a9eb-96b0b72e3578 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:26.913557 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4622634-e127-4c15-a9eb-96b0b72e3578 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:26.946236 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ba520-f07d-4834-8423-d552d80c86ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:26.946860 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ba520-f07d-4834-8423-d552d80c86ee None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:26.947141 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ba520-f07d-4834-8423-d552d80c86ee None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:26.947905 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ba520-f07d-4834-8423-d552d80c86ee None admin] PATH_INFO: `/v3/users/5072bf95e6e04e8c8553849719d7342a` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:26.949058 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ba520-f07d-4834-8423-d552d80c86ee None admin] RBAC: Authorizing `identity:get_user(user_id=5072bf95e6e04e8c8553849719d7342a)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:26.950491 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ba520-f07d-4834-8423-d552d80c86ee None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:26.952070 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 606/1197] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Aug 3 12:40:26 2022] GET /identity/v3/users/5072bf95e6e04e8c8553849719d7342a => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:26.957766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d20778-0ac2-46af-b50c-2356cd35048e None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:27.049198 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:27.055089 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d20778-0ac2-46af-b50c-2356cd35048e None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:27.087342 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bd497-3d30-463e-b7ab-2aaa40969ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:27.088520 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bd497-3d30-463e-b7ab-2aaa40969ac6 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:27.088822 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bd497-3d30-463e-b7ab-2aaa40969ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:27.089077 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bd497-3d30-463e-b7ab-2aaa40969ac6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:27.154327 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0bd497-3d30-463e-b7ab-2aaa40969ac6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:27.155765 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0bd497-3d30-463e-b7ab-2aaa40969ac6 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:27.243354 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:27.250259 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 592/1198] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:40:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:40:27.256053 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ba520-f07d-4834-8423-d552d80c86ee None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:27.301544 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:27.355492 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ba520-f07d-4834-8423-d552d80c86ee None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:27.388585 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1313d-2c76-475a-9983-21b34ab6874b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:27.389213 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1313d-2c76-475a-9983-21b34ab6874b None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:27.389513 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1313d-2c76-475a-9983-21b34ab6874b None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:27.389800 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1313d-2c76-475a-9983-21b34ab6874b None admin] PATH_INFO: `/v3/projects/227de015269743eea8a82df14e400a65` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:27.390942 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1313d-2c76-475a-9983-21b34ab6874b None admin] RBAC: Authorizing `identity:get_project(project_id=227de015269743eea8a82df14e400a65)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:27.392376 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1313d-2c76-475a-9983-21b34ab6874b None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:27.394078 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 607/1199] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Aug 3 12:40:27 2022] GET /identity/v3/projects/227de015269743eea8a82df14e400a65 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:27.400126 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bd497-3d30-463e-b7ab-2aaa40969ac6 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:40:27.496366 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bd497-3d30-463e-b7ab-2aaa40969ac6 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:40:27.529293 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e95728-450f-4197-bb5e-e8d6bc1b8c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:40:27.529933 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e95728-450f-4197-bb5e-e8d6bc1b8c31 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:40:27.530217 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e95728-450f-4197-bb5e-e8d6bc1b8c31 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:40:27.530491 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e95728-450f-4197-bb5e-e8d6bc1b8c31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:40:27.531275 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e95728-450f-4197-bb5e-e8d6bc1b8c31 None admin] RBAC: Adding query filter params (role.id=0e57d142f86c471883fc07a89fe66ec8, scope.project.id=227de015269743eea8a82df14e400a65, user.id=5072bf95e6e04e8c8553849719d7342a) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:40:27.531585 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e95728-450f-4197-bb5e-e8d6bc1b8c31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:40:27.532997 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e95728-450f-4197-bb5e-e8d6bc1b8c31 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:40:27.538690 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 593/1200] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:40:27 2022] GET /identity/v3/role_assignments?user.id=5072bf95e6e04e8c8553849719d7342a&scope.project.id=227de015269743eea8a82df14e400a65&role.id=0e57d142f86c471883fc07a89fe66ec8 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:40:37.383916 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=44 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:40:37.536164 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=70 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:22.569517 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f49598-8108-4a58-bf2c-48a533fc98ae None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:22.570136 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f49598-8108-4a58-bf2c-48a533fc98ae None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:22.570136 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f49598-8108-4a58-bf2c-48a533fc98ae None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:22.571531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 608/1201] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:41:22.579397 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f802a93-1bb5-47ad-827c-4e401644b327 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:22.579928 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f802a93-1bb5-47ad-827c-4e401644b327 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:22.580119 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f802a93-1bb5-47ad-827c-4e401644b327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:22.599176 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-4f802a93-1bb5-47ad-827c-4e401644b327 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:22.600472 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-4f802a93-1bb5-47ad-827c-4e401644b327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:22.688991 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 594/1202] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:41:22.715413 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f49598-8108-4a58-bf2c-48a533fc98ae None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:22.851065 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f49598-8108-4a58-bf2c-48a533fc98ae None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:22.891147 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840448a-f946-407f-906b-fa2b610c7109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:22.891804 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840448a-f946-407f-906b-fa2b610c7109 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:22.892080 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840448a-f946-407f-906b-fa2b610c7109 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:22.892357 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840448a-f946-407f-906b-fa2b610c7109 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:22.905397 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2840448a-f946-407f-906b-fa2b610c7109 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:22.906902 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2840448a-f946-407f-906b-fa2b610c7109 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:22.923665 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-2840448a-f946-407f-906b-fa2b610c7109 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:22.923665 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:22.923665 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:22.923665 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:22.923665 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:22.923665 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:22.923665 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:22.923665 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:22.923665 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:22.923665 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:22.923665 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:22.923665 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:22.923665 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:22.923665 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:22.923665 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:22.924752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:22.924752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:22.924752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:22.924752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:22.924752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:22.924752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:22.924752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:22.924752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:22.924752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:22.924752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:22.924752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:22.924752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:22.924752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:22.924752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:22.924752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:22.924752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:22.924752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:22.925767 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:22.925767 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:22.925767 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:22.925767 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:41:22.925767 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 609/1203] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:41:22.934323 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f802a93-1bb5-47ad-827c-4e401644b327 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:23.069240 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f802a93-1bb5-47ad-827c-4e401644b327 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:23.105477 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:23.113084 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2e3d1-b556-4b8f-8025-f2bf9add467e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:23.113826 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2e3d1-b556-4b8f-8025-f2bf9add467e None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:23.114128 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2e3d1-b556-4b8f-8025-f2bf9add467e None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:23.114469 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2e3d1-b556-4b8f-8025-f2bf9add467e None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:23.115257 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2e3d1-b556-4b8f-8025-f2bf9add467e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:23.117716 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2e3d1-b556-4b8f-8025-f2bf9add467e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:23.119486 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2e3d1-b556-4b8f-8025-f2bf9add467e None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:23.143146 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 595/1204] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:23.148931 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840448a-f946-407f-906b-fa2b610c7109 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:23.227795 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:23.296998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840448a-f946-407f-906b-fa2b610c7109 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:23.340348 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b89cb-81fb-4e7a-855e-5d78d9a18530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:23.340348 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b89cb-81fb-4e7a-855e-5d78d9a18530 None admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:23.340348 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b89cb-81fb-4e7a-855e-5d78d9a18530 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:23.340348 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b89cb-81fb-4e7a-855e-5d78d9a18530 None admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:23.341056 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b89cb-81fb-4e7a-855e-5d78d9a18530 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:23.342451 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b89cb-81fb-4e7a-855e-5d78d9a18530 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:23.369789 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 610/1205] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Aug 3 12:41:23 2022] POST /identity/v3/users => generated 251 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:41:25.538520 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e19480-5eee-4426-b76f-b494697a054c None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:25.539104 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e19480-5eee-4426-b76f-b494697a054c None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:25.539104 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e19480-5eee-4426-b76f-b494697a054c None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:25.540884 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 596/1206] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:41:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:25.546381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af5eed-6127-4184-b495-fc39c06a2d5f None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:25.546891 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af5eed-6127-4184-b495-fc39c06a2d5f None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:25.546976 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af5eed-6127-4184-b495-fc39c06a2d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:25.566268 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-a8af5eed-6127-4184-b495-fc39c06a2d5f None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:25.567478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-a8af5eed-6127-4184-b495-fc39c06a2d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:25.642403 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 611/1207] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:41:25.666451 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e19480-5eee-4426-b76f-b494697a054c None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:25.793170 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e19480-5eee-4426-b76f-b494697a054c None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:25.832136 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104feeb-9cf5-4683-a723-f6569e34f992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:25.832783 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104feeb-9cf5-4683-a723-f6569e34f992 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:25.833065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104feeb-9cf5-4683-a723-f6569e34f992 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:25.833335 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104feeb-9cf5-4683-a723-f6569e34f992 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:25.845582 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3104feeb-9cf5-4683-a723-f6569e34f992 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:25.850514 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-3104feeb-9cf5-4683-a723-f6569e34f992 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:41:25.850514 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:25.850514 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:25.850514 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:25.850514 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:25.850514 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:25.850514 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:25.850514 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:25.850514 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:25.850514 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:25.850514 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:25.850514 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:25.850514 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:25.850514 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:25.850514 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:25.850514 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:25.851589 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:25.851589 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:25.851589 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:25.851589 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:25.851589 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:25.851589 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:25.851589 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:25.851589 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:25.851589 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:25.851589 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:25.851589 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:25.851589 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:25.851589 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:25.851589 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:25.851589 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:25.851589 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:25.853668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:25.853668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:25.853668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:25.853668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:25.853668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:25.853668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:25.853668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:25.853668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:25.853668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:25.853668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:25.853668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:41:25.853668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:41:25.857396 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 597/1208] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 3 12:41:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:25.858487 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af5eed-6127-4184-b495-fc39c06a2d5f None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:25.900249 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:25.980672 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af5eed-6127-4184-b495-fc39c06a2d5f None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:26.020357 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb51800-05cf-4661-b7c4-840f3a72b3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:26.021008 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb51800-05cf-4661-b7c4-840f3a72b3b6 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:26.021298 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb51800-05cf-4661-b7c4-840f3a72b3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:26.021679 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb51800-05cf-4661-b7c4-840f3a72b3b6 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:26.022431 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb51800-05cf-4661-b7c4-840f3a72b3b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:26.022742 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb51800-05cf-4661-b7c4-840f3a72b3b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:26.024673 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb51800-05cf-4661-b7c4-840f3a72b3b6 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:26.034676 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 612/1209] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 3 12:41:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:41:26.040604 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104feeb-9cf5-4683-a723-f6569e34f992 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:26.106661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:26.167262 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104feeb-9cf5-4683-a723-f6569e34f992 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:26.210859 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1fd4be-0e52-4a68-942f-96e9aa7d606d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:26.211576 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fd4be-0e52-4a68-942f-96e9aa7d606d None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:26.212483 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fd4be-0e52-4a68-942f-96e9aa7d606d None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:26.212838 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fd4be-0e52-4a68-942f-96e9aa7d606d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:26.226361 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1fd4be-0e52-4a68-942f-96e9aa7d606d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:26.228107 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1fd4be-0e52-4a68-942f-96e9aa7d606d None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:26.245526 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-bf1fd4be-0e52-4a68-942f-96e9aa7d606d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:26.245526 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:26.245526 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:26.245526 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:26.245526 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:26.245526 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:26.245526 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:26.245526 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:26.245526 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:26.245526 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:26.245526 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:26.245526 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:26.245526 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:26.245526 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:26.245526 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:26.246641 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:26.246641 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:26.246641 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:26.246641 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:26.246641 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:26.246641 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:26.246641 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:26.246641 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:26.246641 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:26.246641 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:26.246641 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:26.246641 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:26.246641 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:26.246641 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:26.246641 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:26.246641 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:26.246641 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:26.247564 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:26.247564 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:26.247564 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:26.247564 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:41:26.247564 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 598/1210] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:41:26.252811 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb51800-05cf-4661-b7c4-840f3a72b3b6 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:26.376120 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:26.379999 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb51800-05cf-4661-b7c4-840f3a72b3b6 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:26.420847 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb512a81-4add-4340-a43c-2b94f323e0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:26.421845 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb512a81-4add-4340-a43c-2b94f323e0d8 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:26.422130 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb512a81-4add-4340-a43c-2b94f323e0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:26.422410 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb512a81-4add-4340-a43c-2b94f323e0d8 None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:26.423142 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb512a81-4add-4340-a43c-2b94f323e0d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:26.423469 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb512a81-4add-4340-a43c-2b94f323e0d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:26.424843 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb512a81-4add-4340-a43c-2b94f323e0d8 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:26.438834 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 613/1211] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:26.444881 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1fd4be-0e52-4a68-942f-96e9aa7d606d None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:26.563006 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1fd4be-0e52-4a68-942f-96e9aa7d606d None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:26.564558 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:26.604281 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0cb73-822e-47fa-b66b-6d17e79332f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:26.604909 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0cb73-822e-47fa-b66b-6d17e79332f4 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:26.605246 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0cb73-822e-47fa-b66b-6d17e79332f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:26.605577 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0cb73-822e-47fa-b66b-6d17e79332f4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:26.613942 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d0cb73-822e-47fa-b66b-6d17e79332f4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:26.615542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d0cb73-822e-47fa-b66b-6d17e79332f4 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:26.629072 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-f0d0cb73-822e-47fa-b66b-6d17e79332f4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:41:26.629072 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:26.629072 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:26.629072 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:26.629072 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:26.629072 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:26.629072 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:26.629072 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:26.629072 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:26.629072 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:26.629072 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:26.629072 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:26.629072 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:41:26.629072 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:41:26.629072 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:41:26.629072 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:41:26.630308 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:26.630308 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:26.630308 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:41:26.630308 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:26.630308 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:41:26.630308 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:26.630308 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:26.630308 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:26.630308 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:26.630308 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:26.630308 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:26.630308 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:26.630308 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:26.630308 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:26.630308 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:26.630308 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:26.630308 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:26.630308 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:26.631468 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:26.631468 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:26.631468 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:41:26.631468 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:41:26.631468 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:41:26.631468 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:41:26.631468 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:41:26.631468 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:41:26.631468 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:41:26.631468 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:41:26.636045 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 599/1212] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:26.637022 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb512a81-4add-4340-a43c-2b94f323e0d8 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:26.786337 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb512a81-4add-4340-a43c-2b94f323e0d8 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:26.827727 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bea93-ea22-44ca-afaf-b6d001cc883f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:26.828528 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bea93-ea22-44ca-afaf-b6d001cc883f None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:26.828733 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bea93-ea22-44ca-afaf-b6d001cc883f None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:26.829011 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bea93-ea22-44ca-afaf-b6d001cc883f None admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:26.829881 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895bea93-ea22-44ca-afaf-b6d001cc883f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:26.830183 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895bea93-ea22-44ca-afaf-b6d001cc883f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:26.831609 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895bea93-ea22-44ca-afaf-b6d001cc883f None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:26.854845 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 614/1213] 10.222.0.46 () {56 vars in 1143 bytes} [Wed Aug 3 12:41:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:26.860808 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0cb73-822e-47fa-b66b-6d17e79332f4 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:26.989076 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0cb73-822e-47fa-b66b-6d17e79332f4 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:27.028253 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078936f-6e68-4894-8175-763696b0d85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:27.028879 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078936f-6e68-4894-8175-763696b0d85f None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:27.029159 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078936f-6e68-4894-8175-763696b0d85f None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:27.029431 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078936f-6e68-4894-8175-763696b0d85f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:27.068052 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:27.113013 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e078936f-6e68-4894-8175-763696b0d85f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:27.114619 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e078936f-6e68-4894-8175-763696b0d85f None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:27.237208 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 600/1214] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:41:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:41:27.244515 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bea93-ea22-44ca-afaf-b6d001cc883f None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:27.269473 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:27.368580 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bea93-ea22-44ca-afaf-b6d001cc883f None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:27.413650 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de672e1-5e34-40df-aab6-c6c227dd94d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:27.414389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de672e1-5e34-40df-aab6-c6c227dd94d4 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:27.414669 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de672e1-5e34-40df-aab6-c6c227dd94d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:27.415493 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de672e1-5e34-40df-aab6-c6c227dd94d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:27.428899 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de672e1-5e34-40df-aab6-c6c227dd94d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:27.430753 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de672e1-5e34-40df-aab6-c6c227dd94d4 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:27.446250 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-4de672e1-5e34-40df-aab6-c6c227dd94d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:27.446250 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:27.446250 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:27.446250 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:27.446250 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:27.446250 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:27.446250 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:27.446250 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:27.446250 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:27.446250 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:27.446250 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:27.446250 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:27.446250 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:27.446250 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:27.446250 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:27.447706 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:27.447706 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:27.447706 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:27.447706 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:27.447706 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:27.447706 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:27.447706 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:27.447706 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:27.447706 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:27.447706 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:27.447706 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:27.447706 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:27.447706 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:27.447706 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:27.447706 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:27.447706 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:27.447706 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:27.449422 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:27.449422 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:27.449422 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:27.449422 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:41:27.449422 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 615/1215] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:41:27.453666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078936f-6e68-4894-8175-763696b0d85f None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:27.521298 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:27.574398 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078936f-6e68-4894-8175-763696b0d85f None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:27.615482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcca9c8-158f-4f15-83b9-954cb3a135e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:27.616128 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcca9c8-158f-4f15-83b9-954cb3a135e1 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:27.616415 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcca9c8-158f-4f15-83b9-954cb3a135e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:27.616693 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcca9c8-158f-4f15-83b9-954cb3a135e1 None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:27.617399 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcca9c8-158f-4f15-83b9-954cb3a135e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:27.618075 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcca9c8-158f-4f15-83b9-954cb3a135e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:27.619650 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcca9c8-158f-4f15-83b9-954cb3a135e1 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:27.633108 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 601/1216] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:27.642663 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de672e1-5e34-40df-aab6-c6c227dd94d4 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:27.728465 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:27.768136 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de672e1-5e34-40df-aab6-c6c227dd94d4 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:27.811104 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e341cd9-0ad0-460c-be3c-4a8b6f7e35df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:27.811643 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e341cd9-0ad0-460c-be3c-4a8b6f7e35df None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:27.812025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e341cd9-0ad0-460c-be3c-4a8b6f7e35df None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:27.812294 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e341cd9-0ad0-460c-be3c-4a8b6f7e35df None admin] PATH_INFO: `/v3/projects/service` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:27.819430 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e341cd9-0ad0-460c-be3c-4a8b6f7e35df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:27.820875 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e341cd9-0ad0-460c-be3c-4a8b6f7e35df None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:27.834190 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-2e341cd9-0ad0-460c-be3c-4a8b6f7e35df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:27.834190 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:27.834190 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:27.834190 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:27.834190 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:27.834190 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:27.834190 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:27.834190 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:27.834190 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:27.834190 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:27.834190 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:27.834190 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:27.834190 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:41:27.834190 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:41:27.834190 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:41:27.835189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:41:27.835189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:27.835189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:27.835189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:27.835189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:27.835189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:27.835189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:27.835189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:27.835189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:27.835189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:27.835189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:27.835189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:27.835189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:27.835189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:27.835189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:27.835189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:27.835189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:27.836128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:41:27.836128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:41:27.836128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:41:27.836128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:41:27.836128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:41:27.836128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:41:27.836128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:27.836128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:41:27.836128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 616/1217] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:41:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:27.842008 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcca9c8-158f-4f15-83b9-954cb3a135e1 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:27.965236 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcca9c8-158f-4f15-83b9-954cb3a135e1 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:27.997539 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:28.014125 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8164f5e-e2e7-4161-9848-36355ab0e38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:28.014894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8164f5e-e2e7-4161-9848-36355ab0e38c None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:28.015308 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8164f5e-e2e7-4161-9848-36355ab0e38c None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:28.015577 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8164f5e-e2e7-4161-9848-36355ab0e38c None admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:28.016560 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8164f5e-e2e7-4161-9848-36355ab0e38c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:28.016956 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8164f5e-e2e7-4161-9848-36355ab0e38c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:28.018572 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8164f5e-e2e7-4161-9848-36355ab0e38c None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:28.040220 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 602/1218] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 3 12:41:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:28.041582 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e341cd9-0ad0-460c-be3c-4a8b6f7e35df None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:28.161845 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e341cd9-0ad0-460c-be3c-4a8b6f7e35df None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:28.192127 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:28.200089 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3d58d-de65-4900-9a64-e25b9ffa1c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:28.200711 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3d58d-de65-4900-9a64-e25b9ffa1c1e None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:28.200993 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3d58d-de65-4900-9a64-e25b9ffa1c1e None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:28.201270 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3d58d-de65-4900-9a64-e25b9ffa1c1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:28.202134 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3d58d-de65-4900-9a64-e25b9ffa1c1e None admin] RBAC: Adding query filter params (role.id=39d74def259b415ca634ad9c715e1332, scope.project.id=6ac833dfff634496816842c851545d21, user.id=a56847173abb48d39c0ee6fb9cdbbbaa) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:28.202445 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3d58d-de65-4900-9a64-e25b9ffa1c1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:28.203882 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3d58d-de65-4900-9a64-e25b9ffa1c1e None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:28.210307 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 617/1219] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:41:28 2022] GET /identity/v3/role_assignments?user.id=a56847173abb48d39c0ee6fb9cdbbbaa&scope.project.id=6ac833dfff634496816842c851545d21&role.id=39d74def259b415ca634ad9c715e1332 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:30.317395 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c15a6d-131b-4eda-9949-986cfa99e3c2 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:30.318055 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c15a6d-131b-4eda-9949-986cfa99e3c2 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:30.318055 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c15a6d-131b-4eda-9949-986cfa99e3c2 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:30.319421 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 603/1220] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:30.329129 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdce87e-c878-48ae-996f-be352b4e99f4 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:30.329129 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdce87e-c878-48ae-996f-be352b4e99f4 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:30.329129 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdce87e-c878-48ae-996f-be352b4e99f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:30.346840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-bfdce87e-c878-48ae-996f-be352b4e99f4 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:30.348156 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-bfdce87e-c878-48ae-996f-be352b4e99f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:30.426726 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 618/1221] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:41:30.452790 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c15a6d-131b-4eda-9949-986cfa99e3c2 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:30.568335 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c15a6d-131b-4eda-9949-986cfa99e3c2 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:30.603309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7f324-9df2-4a67-a2de-064c34fe5d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:30.603951 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7f324-9df2-4a67-a2de-064c34fe5d32 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:30.604387 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7f324-9df2-4a67-a2de-064c34fe5d32 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:30.604738 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7f324-9df2-4a67-a2de-064c34fe5d32 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:30.616608 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac7f324-9df2-4a67-a2de-064c34fe5d32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:30.622522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-1ac7f324-9df2-4a67-a2de-064c34fe5d32 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:41:30.622522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:30.622522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:30.622522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:30.622522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:30.622522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:30.622522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:30.622522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:30.622522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:30.622522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:30.622522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:30.622522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:30.622522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:30.622522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:30.622522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:30.622522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:30.623925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:30.623925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:30.623925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:30.623925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:30.623925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:30.623925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:30.623925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:30.623925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:30.623925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:30.623925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:30.623925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:30.623925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:30.623925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:30.623925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:30.623925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:30.623925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:30.624748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:30.624748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:30.624748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:30.624748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:30.624748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:30.624748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:30.624748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:30.624748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:30.624748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:30.624748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:30.624748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:41:30.624748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:41:30.624748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 604/1222] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 3 12:41:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:30.630235 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdce87e-c878-48ae-996f-be352b4e99f4 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:30.741294 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdce87e-c878-48ae-996f-be352b4e99f4 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:30.765776 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:30.776561 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0227b860-f50f-45dc-b365-65315496d523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:30.777182 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227b860-f50f-45dc-b365-65315496d523 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:30.777482 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227b860-f50f-45dc-b365-65315496d523 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:30.777782 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227b860-f50f-45dc-b365-65315496d523 None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:30.778502 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0227b860-f50f-45dc-b365-65315496d523 None admin] RBAC: Adding query filter params (name=service) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:30.778806 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0227b860-f50f-45dc-b365-65315496d523 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:30.780164 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0227b860-f50f-45dc-b365-65315496d523 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:30.788898 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 619/1223] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 3 12:41:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:30.796129 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7f324-9df2-4a67-a2de-064c34fe5d32 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:30.848298 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:30.911864 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7f324-9df2-4a67-a2de-064c34fe5d32 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:30.951357 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22bea5-91aa-4fbe-b221-cbf8ee61f4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:30.952097 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22bea5-91aa-4fbe-b221-cbf8ee61f4b1 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:30.952391 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22bea5-91aa-4fbe-b221-cbf8ee61f4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:30.952690 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22bea5-91aa-4fbe-b221-cbf8ee61f4b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:30.965628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22bea5-91aa-4fbe-b221-cbf8ee61f4b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:30.967455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22bea5-91aa-4fbe-b221-cbf8ee61f4b1 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:30.983518 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-0d22bea5-91aa-4fbe-b221-cbf8ee61f4b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:30.983518 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:30.983518 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:30.983518 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:30.983518 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:30.983518 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:30.983518 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:30.983518 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:30.983518 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:30.983518 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:30.983518 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:30.983518 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:30.983518 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:30.983518 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:30.983518 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:30.984572 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:30.984572 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:30.984572 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:30.984572 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:30.984572 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:30.984572 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:30.984572 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:30.984572 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:30.984572 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:30.984572 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:30.984572 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:30.984572 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:30.984572 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:30.984572 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:30.984572 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:30.984572 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:30.984572 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:30.985541 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:30.985541 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:30.985541 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:30.985541 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:41:30.989532 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 605/1224] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:41:30.990847 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0227b860-f50f-45dc-b365-65315496d523 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:31.093118 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0227b860-f50f-45dc-b365-65315496d523 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:31.129328 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156dec0-3525-49f2-b296-8db6f6c4d4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:31.130001 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156dec0-3525-49f2-b296-8db6f6c4d4bf None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:31.130282 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156dec0-3525-49f2-b296-8db6f6c4d4bf None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:31.130589 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156dec0-3525-49f2-b296-8db6f6c4d4bf None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:31.131273 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8156dec0-3525-49f2-b296-8db6f6c4d4bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:31.131571 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8156dec0-3525-49f2-b296-8db6f6c4d4bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:31.132940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8156dec0-3525-49f2-b296-8db6f6c4d4bf None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:31.145904 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 620/1225] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:31.151818 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22bea5-91aa-4fbe-b221-cbf8ee61f4b1 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:31.254631 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:31.263067 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22bea5-91aa-4fbe-b221-cbf8ee61f4b1 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:31.298620 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8c526-0229-44fa-9538-35cb1e6fe017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:31.299256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8c526-0229-44fa-9538-35cb1e6fe017 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:31.299531 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8c526-0229-44fa-9538-35cb1e6fe017 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:31.299799 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8c526-0229-44fa-9538-35cb1e6fe017 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:31.308648 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8c526-0229-44fa-9538-35cb1e6fe017 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:31.310119 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8c526-0229-44fa-9538-35cb1e6fe017 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:31.321799 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-c4c8c526-0229-44fa-9538-35cb1e6fe017 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:41:31.321799 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:31.321799 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:31.321799 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:31.321799 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:31.321799 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:31.321799 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:31.321799 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:31.321799 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:31.321799 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:31.321799 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:31.321799 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:31.321799 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:41:31.321799 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:41:31.321799 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:41:31.321799 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:41:31.323594 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:31.323594 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:31.323594 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:41:31.323594 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:31.323594 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:41:31.323594 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:31.323594 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:31.323594 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:31.323594 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:31.323594 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:31.323594 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:31.323594 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:31.323594 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:31.323594 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:31.323594 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:31.323594 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:31.323594 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:31.323594 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:31.324847 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:31.324847 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:31.324847 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:41:31.324847 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:41:31.324847 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:41:31.324847 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:41:31.324847 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:41:31.324847 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:41:31.324847 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:41:31.324847 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:41:31.324847 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 606/1226] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:31.329259 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156dec0-3525-49f2-b296-8db6f6c4d4bf None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:31.380148 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:31.436526 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156dec0-3525-49f2-b296-8db6f6c4d4bf None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:31.474101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11397570-291f-4057-bea2-64a61f0c9cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:31.474976 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11397570-291f-4057-bea2-64a61f0c9cf6 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:31.475303 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11397570-291f-4057-bea2-64a61f0c9cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:31.475668 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11397570-291f-4057-bea2-64a61f0c9cf6 None admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:31.476915 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11397570-291f-4057-bea2-64a61f0c9cf6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:31.478136 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11397570-291f-4057-bea2-64a61f0c9cf6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:31.479573 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11397570-291f-4057-bea2-64a61f0c9cf6 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:31.502549 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 621/1227] 10.222.0.46 () {56 vars in 1143 bytes} [Wed Aug 3 12:41:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:31.504206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8c526-0229-44fa-9538-35cb1e6fe017 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:31.615997 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8c526-0229-44fa-9538-35cb1e6fe017 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:31.652974 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5078b-6f5a-4b4a-8846-42e4bee19395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:31.653551 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5078b-6f5a-4b4a-8846-42e4bee19395 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:31.653860 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5078b-6f5a-4b4a-8846-42e4bee19395 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:31.654182 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5078b-6f5a-4b4a-8846-42e4bee19395 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:31.666331 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5078b-6f5a-4b4a-8846-42e4bee19395 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:31.667817 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5078b-6f5a-4b4a-8846-42e4bee19395 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:31.684069 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-54f5078b-6f5a-4b4a-8846-42e4bee19395 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:31.684069 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:31.684069 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:31.684069 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:31.684069 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:31.684069 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:31.684069 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:31.684069 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:31.684069 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:31.684069 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:31.684069 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:31.684069 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:31.684069 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:31.684069 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:31.684069 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:31.685189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:31.685189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:31.685189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:31.685189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:31.685189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:31.685189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:31.685189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:31.685189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:31.685189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:31.685189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:31.685189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:31.685189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:31.685189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:31.685189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:31.685189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:31.685189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:31.685189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:31.686138 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:31.686138 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:31.686138 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:31.686138 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:41:31.686138 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 607/1228] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:31.691163 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11397570-291f-4057-bea2-64a61f0c9cf6 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:31.809033 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11397570-291f-4057-bea2-64a61f0c9cf6 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:31.812290 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:31.849451 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170f67d-7464-4b49-beb9-ad51cd7b4280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:31.850105 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170f67d-7464-4b49-beb9-ad51cd7b4280 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:31.850386 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170f67d-7464-4b49-beb9-ad51cd7b4280 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:31.850686 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170f67d-7464-4b49-beb9-ad51cd7b4280 None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:31.851386 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a170f67d-7464-4b49-beb9-ad51cd7b4280 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:31.851691 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a170f67d-7464-4b49-beb9-ad51cd7b4280 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:31.853797 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a170f67d-7464-4b49-beb9-ad51cd7b4280 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:31.865525 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 622/1229] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:31.871507 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5078b-6f5a-4b4a-8846-42e4bee19395 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:31.882470 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:31.989770 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5078b-6f5a-4b4a-8846-42e4bee19395 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:32.027855 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a437565-29ac-4f88-b0f8-4fe64be57cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:32.028955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a437565-29ac-4f88-b0f8-4fe64be57cb9 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:32.029440 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a437565-29ac-4f88-b0f8-4fe64be57cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:32.029836 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a437565-29ac-4f88-b0f8-4fe64be57cb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:32.038568 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a437565-29ac-4f88-b0f8-4fe64be57cb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:32.040954 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a437565-29ac-4f88-b0f8-4fe64be57cb9 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:32.053110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-1a437565-29ac-4f88-b0f8-4fe64be57cb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:32.053110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:32.053110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:32.053110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:32.053110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:32.053110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:32.053110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:32.053110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:32.053110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:32.053110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:32.053110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:32.053110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:32.053110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:41:32.053110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:41:32.053110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:41:32.054174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:41:32.054174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:32.054174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:32.054174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:32.054174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:32.054174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:32.054174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:32.054174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:32.054174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:32.054174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:32.054174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:32.054174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:32.054174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:32.054174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:32.054174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:32.054174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:32.054174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:32.055714 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:41:32.055714 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:41:32.055714 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:41:32.055714 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:41:32.055714 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:41:32.055714 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:41:32.055714 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:32.055714 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:41:32.055714 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 608/1230] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:41:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:41:32.060324 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170f67d-7464-4b49-beb9-ad51cd7b4280 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:32.180877 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170f67d-7464-4b49-beb9-ad51cd7b4280 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:32.217179 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67fab2-51fa-4cbc-9a4b-1e9ed3389a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:32.217857 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67fab2-51fa-4cbc-9a4b-1e9ed3389a43 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:32.218108 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67fab2-51fa-4cbc-9a4b-1e9ed3389a43 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:32.218381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67fab2-51fa-4cbc-9a4b-1e9ed3389a43 None admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:32.219129 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67fab2-51fa-4cbc-9a4b-1e9ed3389a43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:32.219437 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67fab2-51fa-4cbc-9a4b-1e9ed3389a43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:32.220877 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67fab2-51fa-4cbc-9a4b-1e9ed3389a43 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:32.234744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 623/1231] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 3 12:41:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:32.240835 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a437565-29ac-4f88-b0f8-4fe64be57cb9 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:32.314683 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:32.354175 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a437565-29ac-4f88-b0f8-4fe64be57cb9 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:32.389746 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069aaa76-ba15-4310-8888-c6a0551ff511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:32.390412 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069aaa76-ba15-4310-8888-c6a0551ff511 None admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:32.390695 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069aaa76-ba15-4310-8888-c6a0551ff511 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:32.391011 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069aaa76-ba15-4310-8888-c6a0551ff511 None admin] PATH_INFO: `/v3/projects/6ac833dfff634496816842c851545d21/users/a56847173abb48d39c0ee6fb9cdbbbaa/roles/39d74def259b415ca634ad9c715e1332` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:32.408034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069aaa76-ba15-4310-8888-c6a0551ff511 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ac833dfff634496816842c851545d21, user_id=a56847173abb48d39c0ee6fb9cdbbbaa, role_id=39d74def259b415ca634ad9c715e1332)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:32.409637 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069aaa76-ba15-4310-8888-c6a0551ff511 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:32.423190 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 609/1232] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 3 12:41:32 2022] PUT /identity/v3/projects/6ac833dfff634496816842c851545d21/users/a56847173abb48d39c0ee6fb9cdbbbaa/roles/39d74def259b415ca634ad9c715e1332 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:41:34.566890 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27029db-988b-40a6-b821-76c3c1c30ac9 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:34.567407 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27029db-988b-40a6-b821-76c3c1c30ac9 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:34.567407 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27029db-988b-40a6-b821-76c3c1c30ac9 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:34.568789 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 624/1233] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:34.575033 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d61b69-99df-4bf2-a81c-e76dd9a09f40 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:34.575492 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d61b69-99df-4bf2-a81c-e76dd9a09f40 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:34.575830 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d61b69-99df-4bf2-a81c-e76dd9a09f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:34.596484 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-15d61b69-99df-4bf2-a81c-e76dd9a09f40 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:34.597887 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-15d61b69-99df-4bf2-a81c-e76dd9a09f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:34.670857 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 610/1234] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:41:34.695388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27029db-988b-40a6-b821-76c3c1c30ac9 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:34.723118 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:34.803344 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27029db-988b-40a6-b821-76c3c1c30ac9 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:34.840285 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d1e2a-bbc5-4ede-a7bc-61e6bf6f895a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:34.840857 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d1e2a-bbc5-4ede-a7bc-61e6bf6f895a None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:34.841139 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d1e2a-bbc5-4ede-a7bc-61e6bf6f895a None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:34.841415 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d1e2a-bbc5-4ede-a7bc-61e6bf6f895a None admin] PATH_INFO: `/v3/roles/service` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:34.853598 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d1e2a-bbc5-4ede-a7bc-61e6bf6f895a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:34.858549 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-e27d1e2a-bbc5-4ede-a7bc-61e6bf6f895a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:41:34.858549 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:34.858549 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:34.858549 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:34.858549 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:34.858549 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:34.858549 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:34.858549 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:34.858549 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:34.858549 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:34.858549 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:34.858549 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:34.858549 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:34.858549 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:34.858549 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:34.858549 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:34.859626 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:34.859626 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:34.859626 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:34.859626 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:34.859626 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:34.859626 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:34.859626 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:34.859626 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:34.859626 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:34.859626 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:34.859626 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:34.859626 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:34.859626 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:34.859626 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:34.859626 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:34.859626 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:34.860688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:34.860688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:34.860688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:34.860688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:34.860688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:34.860688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:34.860688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:34.860688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:34.860688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:34.860688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:34.860688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 03 12:41:34.860688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:41:34.860688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 625/1235] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Aug 3 12:41:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:41:34.866119 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d61b69-99df-4bf2-a81c-e76dd9a09f40 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:34.912912 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:34.972719 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d61b69-99df-4bf2-a81c-e76dd9a09f40 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:35.012629 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826cacb-c7e2-4901-a082-a5a6ed96335f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:35.013238 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826cacb-c7e2-4901-a082-a5a6ed96335f None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:35.013552 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826cacb-c7e2-4901-a082-a5a6ed96335f None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:35.013825 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826cacb-c7e2-4901-a082-a5a6ed96335f None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:35.014542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9826cacb-c7e2-4901-a082-a5a6ed96335f None admin] RBAC: Adding query filter params (name=service) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:35.014848 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9826cacb-c7e2-4901-a082-a5a6ed96335f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:35.016210 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9826cacb-c7e2-4901-a082-a5a6ed96335f None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:35.024992 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 611/1236] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Aug 3 12:41:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:35.031010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d1e2a-bbc5-4ede-a7bc-61e6bf6f895a None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:35.121318 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:35.139920 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d1e2a-bbc5-4ede-a7bc-61e6bf6f895a None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:35.178880 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cafe0-131a-4031-9274-8f8a243358ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:35.179666 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cafe0-131a-4031-9274-8f8a243358ec None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:35.180023 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cafe0-131a-4031-9274-8f8a243358ec None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:35.180921 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cafe0-131a-4031-9274-8f8a243358ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:35.192339 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52cafe0-131a-4031-9274-8f8a243358ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:35.193844 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52cafe0-131a-4031-9274-8f8a243358ec None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:35.212388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-d52cafe0-131a-4031-9274-8f8a243358ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:35.212388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:35.212388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:35.212388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:35.212388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:35.212388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:35.212388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:35.212388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:35.212388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:35.212388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:35.212388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:35.212388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:35.212388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:35.212388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:35.212388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:35.213514 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:35.213514 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:35.213514 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:35.213514 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:35.213514 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:35.213514 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:35.213514 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:35.213514 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:35.213514 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:35.213514 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:35.213514 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:35.213514 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:35.213514 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:35.213514 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:35.213514 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:35.213514 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:35.213514 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:35.214586 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:35.214586 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:35.214586 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:35.214586 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:41:35.214586 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 626/1237] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:35.219649 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826cacb-c7e2-4901-a082-a5a6ed96335f None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:35.336604 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826cacb-c7e2-4901-a082-a5a6ed96335f None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:35.346450 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:35.376098 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f3b44-e008-4ffd-ba9b-04321b2acb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:35.376741 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f3b44-e008-4ffd-ba9b-04321b2acb12 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:35.377041 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f3b44-e008-4ffd-ba9b-04321b2acb12 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:35.377398 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f3b44-e008-4ffd-ba9b-04321b2acb12 None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:35.378228 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f3b44-e008-4ffd-ba9b-04321b2acb12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:35.378588 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f3b44-e008-4ffd-ba9b-04321b2acb12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:35.380227 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f3b44-e008-4ffd-ba9b-04321b2acb12 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:35.394194 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 612/1238] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:35.401777 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cafe0-131a-4031-9274-8f8a243358ec None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:35.511183 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cafe0-131a-4031-9274-8f8a243358ec None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:35.556707 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17ebbd-8e21-4c77-972e-72bb1b3dea4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:35.557466 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17ebbd-8e21-4c77-972e-72bb1b3dea4c None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:35.557783 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17ebbd-8e21-4c77-972e-72bb1b3dea4c None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:35.558067 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17ebbd-8e21-4c77-972e-72bb1b3dea4c None admin] PATH_INFO: `/v3/users/placement` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:35.561349 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:35.567478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb17ebbd-8e21-4c77-972e-72bb1b3dea4c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:35.569036 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb17ebbd-8e21-4c77-972e-72bb1b3dea4c None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:35.581904 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-eb17ebbd-8e21-4c77-972e-72bb1b3dea4c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:41:35.581904 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:35.581904 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:35.581904 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:35.581904 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:35.581904 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:35.581904 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:35.581904 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:35.581904 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:35.581904 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:35.581904 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:35.581904 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:35.581904 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:41:35.581904 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:41:35.581904 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:41:35.581904 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:41:35.583037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:35.583037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:35.583037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:41:35.583037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:35.583037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:41:35.583037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:35.583037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:35.583037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:35.583037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:35.583037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:35.583037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:35.583037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:35.583037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:35.583037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:35.583037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:35.583037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:35.583037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:35.583037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:35.584176 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:35.584176 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:35.584176 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:41:35.584176 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:41:35.584176 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:41:35.584176 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:41:35.584176 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:41:35.584176 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:41:35.584176 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:41:35.584176 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:41:35.589645 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 627/1239] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:35.590672 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f3b44-e008-4ffd-ba9b-04321b2acb12 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:35.703459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f3b44-e008-4ffd-ba9b-04321b2acb12 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:35.738945 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19f195-c020-4e63-8f92-72bcd37cd9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:35.739569 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19f195-c020-4e63-8f92-72bcd37cd9bf None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:35.739849 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19f195-c020-4e63-8f92-72bcd37cd9bf None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:35.740120 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19f195-c020-4e63-8f92-72bcd37cd9bf None admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:35.740916 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b19f195-c020-4e63-8f92-72bcd37cd9bf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:35.741222 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b19f195-c020-4e63-8f92-72bcd37cd9bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:35.743488 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b19f195-c020-4e63-8f92-72bcd37cd9bf None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:35.765568 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 613/1240] 10.222.0.46 () {56 vars in 1143 bytes} [Wed Aug 3 12:41:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:35.771670 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17ebbd-8e21-4c77-972e-72bb1b3dea4c None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:35.880019 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17ebbd-8e21-4c77-972e-72bb1b3dea4c None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:35.918739 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c1b88-d4da-41e7-a7b7-c343853da06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:35.919416 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c1b88-d4da-41e7-a7b7-c343853da06e None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:35.919699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c1b88-d4da-41e7-a7b7-c343853da06e None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:35.919978 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c1b88-d4da-41e7-a7b7-c343853da06e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:35.989569 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:35.997920 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162c1b88-d4da-41e7-a7b7-c343853da06e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:35.999391 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162c1b88-d4da-41e7-a7b7-c343853da06e None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:36.114404 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 628/1241] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:41:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 03 12:41:36.122102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19f195-c020-4e63-8f92-72bcd37cd9bf None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:36.154237 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:36.236289 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19f195-c020-4e63-8f92-72bcd37cd9bf None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:36.276728 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6366b8-0c1d-4720-bab0-6d7c08b10a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:36.277375 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6366b8-0c1d-4720-bab0-6d7c08b10a1e None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:36.277715 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6366b8-0c1d-4720-bab0-6d7c08b10a1e None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:36.277985 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6366b8-0c1d-4720-bab0-6d7c08b10a1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:36.289294 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6366b8-0c1d-4720-bab0-6d7c08b10a1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:36.291315 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6366b8-0c1d-4720-bab0-6d7c08b10a1e None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:36.309329 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-bb6366b8-0c1d-4720-bab0-6d7c08b10a1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:36.309329 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:36.309329 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:36.309329 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:36.309329 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:36.309329 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:36.309329 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:36.309329 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:36.309329 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:36.309329 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:36.309329 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:36.309329 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:36.309329 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:36.309329 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:36.309329 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:36.311118 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:36.311118 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:36.311118 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:36.311118 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:36.311118 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:36.311118 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:36.311118 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:36.311118 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:36.311118 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:36.311118 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:36.311118 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:36.311118 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:36.311118 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:36.311118 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:36.311118 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:36.311118 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:36.311118 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:36.312339 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:36.312339 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:36.312339 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:36.312339 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:41:36.312339 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 614/1242] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:41:36.316751 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c1b88-d4da-41e7-a7b7-c343853da06e None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:36.419562 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:36.426576 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c1b88-d4da-41e7-a7b7-c343853da06e None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:36.468149 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6aaf42-e4b1-421f-9252-1b66933cbbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:36.468844 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6aaf42-e4b1-421f-9252-1b66933cbbbe None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:36.469167 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6aaf42-e4b1-421f-9252-1b66933cbbbe None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:36.469535 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6aaf42-e4b1-421f-9252-1b66933cbbbe None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:36.470316 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6aaf42-e4b1-421f-9252-1b66933cbbbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:36.470703 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6aaf42-e4b1-421f-9252-1b66933cbbbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:36.472135 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6aaf42-e4b1-421f-9252-1b66933cbbbe None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:36.483504 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 629/1243] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:41:36.489328 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6366b8-0c1d-4720-bab0-6d7c08b10a1e None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:36.579105 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:36.603588 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6366b8-0c1d-4720-bab0-6d7c08b10a1e None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:36.643249 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d84041-7a11-4864-a324-1d6b7af753c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:36.644013 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d84041-7a11-4864-a324-1d6b7af753c2 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:36.644336 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d84041-7a11-4864-a324-1d6b7af753c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:36.645528 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d84041-7a11-4864-a324-1d6b7af753c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:36.652772 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d84041-7a11-4864-a324-1d6b7af753c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:36.654265 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d84041-7a11-4864-a324-1d6b7af753c2 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:36.666148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-f0d84041-7a11-4864-a324-1d6b7af753c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:36.666148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:36.666148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:36.666148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:36.666148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:36.666148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:36.666148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:36.666148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:36.666148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:36.666148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:36.666148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:36.666148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:36.666148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:41:36.666148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:41:36.666148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:41:36.667100 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:41:36.667100 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:36.667100 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:36.667100 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:36.667100 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:36.667100 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:36.667100 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:36.667100 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:36.667100 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:36.667100 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:36.667100 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:36.667100 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:36.667100 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:36.667100 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:36.667100 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:36.667100 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:36.667100 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:36.672750 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:41:36.672750 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:41:36.672750 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:41:36.672750 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:41:36.672750 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:41:36.672750 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:41:36.672750 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:36.672750 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:41:36.672750 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 615/1244] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:41:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:36.673418 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6aaf42-e4b1-421f-9252-1b66933cbbbe None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:36.791883 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6aaf42-e4b1-421f-9252-1b66933cbbbe None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:36.827843 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2187ed-54e3-4325-b8b3-3bf07c6b1d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:36.828454 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2187ed-54e3-4325-b8b3-3bf07c6b1d5f None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:36.828739 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2187ed-54e3-4325-b8b3-3bf07c6b1d5f None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:36.829038 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2187ed-54e3-4325-b8b3-3bf07c6b1d5f None admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:36.829934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2187ed-54e3-4325-b8b3-3bf07c6b1d5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:36.830227 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2187ed-54e3-4325-b8b3-3bf07c6b1d5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:36.831739 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2187ed-54e3-4325-b8b3-3bf07c6b1d5f None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:36.844658 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 630/1245] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 3 12:41:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:36.850913 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d84041-7a11-4864-a324-1d6b7af753c2 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:36.967391 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d84041-7a11-4864-a324-1d6b7af753c2 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:37.004320 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9463d-c186-4a7b-92f7-4d0fbfbb9c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:37.004969 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9463d-c186-4a7b-92f7-4d0fbfbb9c60 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:37.005249 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9463d-c186-4a7b-92f7-4d0fbfbb9c60 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:37.005545 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9463d-c186-4a7b-92f7-4d0fbfbb9c60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:37.006350 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef9463d-c186-4a7b-92f7-4d0fbfbb9c60 None admin] RBAC: Adding query filter params (role.id=39d74def259b415ca634ad9c715e1332, scope.project.id=6ac833dfff634496816842c851545d21, user.id=a56847173abb48d39c0ee6fb9cdbbbaa) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:37.006655 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef9463d-c186-4a7b-92f7-4d0fbfbb9c60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:37.008207 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef9463d-c186-4a7b-92f7-4d0fbfbb9c60 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:37.014743 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 616/1246] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:41:36 2022] GET /identity/v3/role_assignments?user.id=a56847173abb48d39c0ee6fb9cdbbbaa&scope.project.id=6ac833dfff634496816842c851545d21&role.id=39d74def259b415ca634ad9c715e1332 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:39.240274 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5f130-402c-4030-b209-cfe6d95359a8 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:39.240889 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5f130-402c-4030-b209-cfe6d95359a8 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:39.241008 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5f130-402c-4030-b209-cfe6d95359a8 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:39.242590 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 631/1247] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:39.249258 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7725805-d739-43c7-8f66-e2dc246977cb None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:39.249716 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7725805-d739-43c7-8f66-e2dc246977cb None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:39.249849 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7725805-d739-43c7-8f66-e2dc246977cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:39.257023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:39.275955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-c7725805-d739-43c7-8f66-e2dc246977cb None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:39.278266 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-c7725805-d739-43c7-8f66-e2dc246977cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:39.370868 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 617/1248] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:41:39.394502 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5f130-402c-4030-b209-cfe6d95359a8 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:39.416885 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:39.513700 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5f130-402c-4030-b209-cfe6d95359a8 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:39.553167 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8ce12-66c5-474d-9e47-9422e7bda3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:39.553886 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8ce12-66c5-474d-9e47-9422e7bda3da None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:39.554165 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8ce12-66c5-474d-9e47-9422e7bda3da None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:39.554514 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8ce12-66c5-474d-9e47-9422e7bda3da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:39.566231 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a8ce12-66c5-474d-9e47-9422e7bda3da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:39.572458 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-d7a8ce12-66c5-474d-9e47-9422e7bda3da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:41:39.572458 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:39.572458 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:39.572458 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:39.572458 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:39.572458 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:39.572458 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:39.572458 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:39.572458 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:39.572458 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:39.572458 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:39.572458 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:39.572458 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:39.572458 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:39.572458 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:39.572458 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:39.573574 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:39.573574 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:39.573574 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:39.573574 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:39.573574 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:39.573574 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:39.573574 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:39.573574 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:39.573574 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:39.573574 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:39.573574 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:39.573574 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:39.573574 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:39.573574 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:39.573574 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:39.573574 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:39.574671 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:39.574671 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:39.574671 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:39.574671 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:39.574671 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:39.574671 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:39.574671 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:39.574671 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:39.574671 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:39.574671 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:39.574671 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:41:39.574671 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:41:39.574671 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 632/1249] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 3 12:41:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:39.580678 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7725805-d739-43c7-8f66-e2dc246977cb None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:39.703256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7725805-d739-43c7-8f66-e2dc246977cb None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:39.741331 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:39.749517 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06a9cc-794a-4b9c-b8f7-65b0a32a3087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:39.750168 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06a9cc-794a-4b9c-b8f7-65b0a32a3087 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:39.750447 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06a9cc-794a-4b9c-b8f7-65b0a32a3087 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:39.750722 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06a9cc-794a-4b9c-b8f7-65b0a32a3087 None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:39.751635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e06a9cc-794a-4b9c-b8f7-65b0a32a3087 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:39.751943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e06a9cc-794a-4b9c-b8f7-65b0a32a3087 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:39.753463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e06a9cc-794a-4b9c-b8f7-65b0a32a3087 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:39.763623 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 618/1250] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:41:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:39.769832 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8ce12-66c5-474d-9e47-9422e7bda3da None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:39.855466 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:39.879661 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8ce12-66c5-474d-9e47-9422e7bda3da None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:39.917519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325903c-b9ef-43ca-94a0-1678cfa6f4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:39.918176 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325903c-b9ef-43ca-94a0-1678cfa6f4db None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:39.918460 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325903c-b9ef-43ca-94a0-1678cfa6f4db None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:39.918732 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325903c-b9ef-43ca-94a0-1678cfa6f4db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:39.930899 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325903c-b9ef-43ca-94a0-1678cfa6f4db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:39.932626 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325903c-b9ef-43ca-94a0-1678cfa6f4db None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:39.950210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-b325903c-b9ef-43ca-94a0-1678cfa6f4db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:39.950210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:39.950210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:39.950210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:39.950210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:39.950210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:39.950210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:39.950210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:39.950210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:39.950210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:39.950210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:39.950210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:39.950210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:39.950210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:39.950210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:39.951353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:39.951353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:39.951353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:39.951353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:39.951353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:39.951353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:39.951353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:39.951353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:39.951353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:39.951353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:39.951353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:39.951353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:39.951353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:39.951353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:39.951353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:39.951353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:39.951353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:39.952581 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:39.952581 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:39.952581 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:39.952581 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:41:39.956305 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 633/1251] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:39.957446 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06a9cc-794a-4b9c-b8f7-65b0a32a3087 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:40.075255 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06a9cc-794a-4b9c-b8f7-65b0a32a3087 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:40.112795 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f58c0a-5797-42c9-b9fa-6b647d39d59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:40.113637 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f58c0a-5797-42c9-b9fa-6b647d39d59a None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:40.114007 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f58c0a-5797-42c9-b9fa-6b647d39d59a None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:40.114337 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f58c0a-5797-42c9-b9fa-6b647d39d59a None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:40.115317 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f58c0a-5797-42c9-b9fa-6b647d39d59a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:40.115657 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f58c0a-5797-42c9-b9fa-6b647d39d59a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:40.117019 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f58c0a-5797-42c9-b9fa-6b647d39d59a None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:40.132728 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 619/1252] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:41:40.139261 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325903c-b9ef-43ca-94a0-1678cfa6f4db None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:40.253072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325903c-b9ef-43ca-94a0-1678cfa6f4db None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:40.282581 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:40.291257 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f7150-71b2-48c4-9194-dc9faccd65dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:40.291909 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f7150-71b2-48c4-9194-dc9faccd65dd None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:40.292193 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f7150-71b2-48c4-9194-dc9faccd65dd None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:40.292464 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f7150-71b2-48c4-9194-dc9faccd65dd None admin] PATH_INFO: `/v3/users/placement` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:40.300638 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f7150-71b2-48c4-9194-dc9faccd65dd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:40.302132 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f7150-71b2-48c4-9194-dc9faccd65dd None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:40.314873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-c42f7150-71b2-48c4-9194-dc9faccd65dd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:41:40.314873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:40.314873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:40.314873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:40.314873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:40.314873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:40.314873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:40.314873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:40.314873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:40.314873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:40.314873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:40.314873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:40.314873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:41:40.314873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:41:40.314873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:41:40.314873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:41:40.316044 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:40.316044 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:40.316044 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:41:40.316044 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:40.316044 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:41:40.316044 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:40.316044 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:40.316044 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:40.316044 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:40.316044 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:40.316044 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:40.316044 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:40.316044 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:40.316044 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:40.316044 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:40.316044 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:40.316044 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:40.316044 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:40.317007 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:40.317007 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:40.317007 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:41:40.317007 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:41:40.317007 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:41:40.317007 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:41:40.317007 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:41:40.317007 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:41:40.317007 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:41:40.317007 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:41:40.317007 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 634/1253] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:40.326647 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f58c0a-5797-42c9-b9fa-6b647d39d59a None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:40.390472 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:40.448563 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f58c0a-5797-42c9-b9fa-6b647d39d59a None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:40.494788 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e191e57-b57b-4b25-8cf3-9998e8c464bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:40.495514 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e191e57-b57b-4b25-8cf3-9998e8c464bb None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:40.495800 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e191e57-b57b-4b25-8cf3-9998e8c464bb None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:40.496083 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e191e57-b57b-4b25-8cf3-9998e8c464bb None admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:40.497250 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e191e57-b57b-4b25-8cf3-9998e8c464bb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:40.497632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e191e57-b57b-4b25-8cf3-9998e8c464bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:40.499279 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e191e57-b57b-4b25-8cf3-9998e8c464bb None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:40.519252 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 620/1254] 10.222.0.46 () {56 vars in 1143 bytes} [Wed Aug 3 12:41:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:41:40.525270 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f7150-71b2-48c4-9194-dc9faccd65dd None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:40.639855 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f7150-71b2-48c4-9194-dc9faccd65dd None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:40.679456 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085dc50f-741b-470c-a7ea-69dfc8fd252b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:40.680878 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085dc50f-741b-470c-a7ea-69dfc8fd252b None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:40.681218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085dc50f-741b-470c-a7ea-69dfc8fd252b None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:40.681505 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085dc50f-741b-470c-a7ea-69dfc8fd252b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:40.744231 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:40.761616 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085dc50f-741b-470c-a7ea-69dfc8fd252b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:40.763707 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085dc50f-741b-470c-a7ea-69dfc8fd252b None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:40.891803 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 635/1255] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:41:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:41:40.898414 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e191e57-b57b-4b25-8cf3-9998e8c464bb None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:41.021368 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e191e57-b57b-4b25-8cf3-9998e8c464bb None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:41.037181 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:41.064132 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceed761-8dac-4e84-a070-94302af530a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:41.064842 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceed761-8dac-4e84-a070-94302af530a4 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:41.065119 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceed761-8dac-4e84-a070-94302af530a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:41.065392 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceed761-8dac-4e84-a070-94302af530a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:41.075981 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceed761-8dac-4e84-a070-94302af530a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:41.077527 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceed761-8dac-4e84-a070-94302af530a4 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:41.096259 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-cceed761-8dac-4e84-a070-94302af530a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:41.096259 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:41.096259 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:41.096259 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:41.096259 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:41.096259 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:41.096259 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:41.096259 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:41.096259 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:41.096259 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:41.096259 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:41.096259 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:41.096259 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:41.096259 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:41.096259 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:41.097356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:41.097356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:41.097356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:41.097356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:41.097356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:41.097356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:41.097356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:41.097356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:41.097356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:41.097356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:41.097356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:41.097356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:41.097356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:41.097356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:41.097356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:41.097356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:41.097356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:41.098821 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:41.098821 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:41.098821 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:41.098821 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:41:41.098821 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 621/1256] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 03 12:41:41.103986 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085dc50f-741b-470c-a7ea-69dfc8fd252b None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:41.216019 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:41.228577 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085dc50f-741b-470c-a7ea-69dfc8fd252b None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:41.269330 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdebfca-7789-40e7-ba8e-1cdac0b757ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:41.269846 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdebfca-7789-40e7-ba8e-1cdac0b757ba None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:41.269988 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdebfca-7789-40e7-ba8e-1cdac0b757ba None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:41.270299 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdebfca-7789-40e7-ba8e-1cdac0b757ba None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:41.270997 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdebfca-7789-40e7-ba8e-1cdac0b757ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:41.271359 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdebfca-7789-40e7-ba8e-1cdac0b757ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:41.272827 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdebfca-7789-40e7-ba8e-1cdac0b757ba None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:41.286332 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 636/1257] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:41.292001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceed761-8dac-4e84-a070-94302af530a4 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:41.404912 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceed761-8dac-4e84-a070-94302af530a4 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:41.442485 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bb773-a55a-40fa-a437-56c4f36e0b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:41.443143 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bb773-a55a-40fa-a437-56c4f36e0b89 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:41.443423 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bb773-a55a-40fa-a437-56c4f36e0b89 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:41.443700 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bb773-a55a-40fa-a437-56c4f36e0b89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:41.450766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6bb773-a55a-40fa-a437-56c4f36e0b89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:41.452249 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6bb773-a55a-40fa-a437-56c4f36e0b89 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:41.465099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-3c6bb773-a55a-40fa-a437-56c4f36e0b89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:41.465099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:41.465099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:41.465099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:41.465099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:41.465099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:41.465099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:41.465099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:41.465099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:41.465099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:41.465099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:41.465099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:41.465099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:41:41.465099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:41:41.465099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:41:41.466276 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:41:41.466276 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:41.466276 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:41.466276 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:41.466276 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:41.466276 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:41.466276 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:41.466276 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:41.466276 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:41.466276 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:41.466276 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:41.466276 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:41.466276 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:41.466276 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:41.466276 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:41.466276 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:41.466276 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:41.467241 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:41:41.467241 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:41:41.467241 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:41:41.467241 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:41:41.467241 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:41:41.467241 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:41:41.467241 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:41.467241 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:41:41.469677 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 622/1258] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:41:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:41.472467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdebfca-7789-40e7-ba8e-1cdac0b757ba None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:41.585327 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdebfca-7789-40e7-ba8e-1cdac0b757ba None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:41.634834 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4616f8-cb97-45eb-a0b3-e5b4424ea8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:41.635559 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4616f8-cb97-45eb-a0b3-e5b4424ea8f3 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:41.635911 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4616f8-cb97-45eb-a0b3-e5b4424ea8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:41.636290 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4616f8-cb97-45eb-a0b3-e5b4424ea8f3 None admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:41.637235 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4616f8-cb97-45eb-a0b3-e5b4424ea8f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:41.637613 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4616f8-cb97-45eb-a0b3-e5b4424ea8f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:41.639213 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4616f8-cb97-45eb-a0b3-e5b4424ea8f3 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:41.655586 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 637/1259] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 3 12:41:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:41:41.661530 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bb773-a55a-40fa-a437-56c4f36e0b89 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:41.690800 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:41.784578 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bb773-a55a-40fa-a437-56c4f36e0b89 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:41.821408 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d80d9-d52e-4a30-aba7-708655dd83ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:41.822303 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d80d9-d52e-4a30-aba7-708655dd83ed None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:41.822702 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d80d9-d52e-4a30-aba7-708655dd83ed None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:41.822998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d80d9-d52e-4a30-aba7-708655dd83ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:41.823970 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d80d9-d52e-4a30-aba7-708655dd83ed None admin] RBAC: Adding query filter params (role.id=0e57d142f86c471883fc07a89fe66ec8, scope.project.id=6ac833dfff634496816842c851545d21, user.id=a56847173abb48d39c0ee6fb9cdbbbaa) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:41.824285 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d80d9-d52e-4a30-aba7-708655dd83ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:41.826019 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d80d9-d52e-4a30-aba7-708655dd83ed None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:41.832833 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 623/1260] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:41:41 2022] GET /identity/v3/role_assignments?user.id=a56847173abb48d39c0ee6fb9cdbbbaa&scope.project.id=6ac833dfff634496816842c851545d21&role.id=0e57d142f86c471883fc07a89fe66ec8 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:41:43.980823 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb1208-0719-4a80-9ebf-43fc966edff5 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:43.981350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb1208-0719-4a80-9ebf-43fc966edff5 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:43.981350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb1208-0719-4a80-9ebf-43fc966edff5 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:43.982772 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 638/1261] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:43.987926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc4d81-5b36-4009-bbcd-64a368dff5db None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:43.988319 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc4d81-5b36-4009-bbcd-64a368dff5db None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:43.988481 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc4d81-5b36-4009-bbcd-64a368dff5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:44.006692 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-3bdc4d81-5b36-4009-bbcd-64a368dff5db None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:44.007939 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-3bdc4d81-5b36-4009-bbcd-64a368dff5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:44.073469 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 624/1262] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:41:44.094950 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb1208-0719-4a80-9ebf-43fc966edff5 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:44.105729 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:44.192923 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb1208-0719-4a80-9ebf-43fc966edff5 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:44.225353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9d130-6439-43fd-a6ec-65f008077109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:44.226008 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9d130-6439-43fd-a6ec-65f008077109 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:44.226291 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9d130-6439-43fd-a6ec-65f008077109 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:44.226567 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9d130-6439-43fd-a6ec-65f008077109 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:44.236955 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b9d130-6439-43fd-a6ec-65f008077109 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:44.241991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-b0b9d130-6439-43fd-a6ec-65f008077109 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:41:44.241991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:44.241991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:44.241991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:44.241991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:44.241991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:44.241991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:44.241991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:44.241991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:44.241991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:44.241991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:44.241991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:44.241991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:44.241991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:44.241991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:44.241991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:44.243652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:44.243652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:44.243652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:44.243652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:44.243652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:44.243652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:44.243652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:44.243652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:44.243652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:44.243652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:44.243652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:44.243652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:44.243652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:44.243652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:44.243652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:44.243652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:44.244714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:44.244714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:44.244714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:44.244714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:44.244714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:44.244714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:44.244714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:44.244714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:44.244714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:44.244714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:44.244714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:41:44.244714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:41:44.244714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 639/1263] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 3 12:41:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:44.249771 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc4d81-5b36-4009-bbcd-64a368dff5db None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:44.267698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:44.347624 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc4d81-5b36-4009-bbcd-64a368dff5db None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:44.380656 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b318bf-172b-450b-8c9c-3a0f48f7d37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:44.381259 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b318bf-172b-450b-8c9c-3a0f48f7d37a None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:44.381563 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b318bf-172b-450b-8c9c-3a0f48f7d37a None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:44.381841 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b318bf-172b-450b-8c9c-3a0f48f7d37a None admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:44.382556 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b318bf-172b-450b-8c9c-3a0f48f7d37a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:44.382860 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b318bf-172b-450b-8c9c-3a0f48f7d37a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:44.385080 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b318bf-172b-450b-8c9c-3a0f48f7d37a None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:44.392881 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 625/1264] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:41:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:44.398811 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9d130-6439-43fd-a6ec-65f008077109 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:44.464499 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:44.496171 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9d130-6439-43fd-a6ec-65f008077109 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:44.529435 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5120e3-36b0-4a85-baa6-a231c590358f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:44.530091 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5120e3-36b0-4a85-baa6-a231c590358f None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:44.530371 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5120e3-36b0-4a85-baa6-a231c590358f None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:44.530642 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5120e3-36b0-4a85-baa6-a231c590358f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:44.540764 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5120e3-36b0-4a85-baa6-a231c590358f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:44.542236 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5120e3-36b0-4a85-baa6-a231c590358f None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:44.556907 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-de5120e3-36b0-4a85-baa6-a231c590358f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:44.556907 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:44.556907 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:44.556907 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:44.556907 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:44.556907 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:44.556907 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:44.556907 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:44.556907 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:44.556907 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:44.556907 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:44.556907 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:44.556907 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:44.556907 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:44.556907 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:44.557976 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:44.557976 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:44.557976 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:44.557976 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:44.557976 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:44.557976 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:44.557976 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:44.557976 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:44.557976 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:44.557976 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:44.557976 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:44.557976 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:44.557976 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:44.557976 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:44.557976 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:44.557976 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:44.557976 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:44.559198 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:44.559198 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:44.559198 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:44.559198 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:41:44.559198 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 640/1265] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:44.563755 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b318bf-172b-450b-8c9c-3a0f48f7d37a None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:44.642706 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:44.661212 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b318bf-172b-450b-8c9c-3a0f48f7d37a None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:44.693271 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2dc5e9-bf93-4c02-90cf-7dae15780149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:44.693908 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2dc5e9-bf93-4c02-90cf-7dae15780149 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:44.694187 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2dc5e9-bf93-4c02-90cf-7dae15780149 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:44.694457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2dc5e9-bf93-4c02-90cf-7dae15780149 None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:44.695135 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2dc5e9-bf93-4c02-90cf-7dae15780149 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:44.695434 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2dc5e9-bf93-4c02-90cf-7dae15780149 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:44.697516 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2dc5e9-bf93-4c02-90cf-7dae15780149 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:44.708727 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 626/1266] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:44.714751 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5120e3-36b0-4a85-baa6-a231c590358f None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:44.811795 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5120e3-36b0-4a85-baa6-a231c590358f None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:44.831031 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:44.844681 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caecf931-cf5b-462b-906f-e69432d4e0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:44.845304 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecf931-cf5b-462b-906f-e69432d4e0b4 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:44.845620 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecf931-cf5b-462b-906f-e69432d4e0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:44.845897 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecf931-cf5b-462b-906f-e69432d4e0b4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:44.853999 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caecf931-cf5b-462b-906f-e69432d4e0b4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:44.855438 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caecf931-cf5b-462b-906f-e69432d4e0b4 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:44.866382 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-caecf931-cf5b-462b-906f-e69432d4e0b4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:41:44.866382 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:44.866382 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:44.866382 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:44.866382 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:44.866382 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:44.866382 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:44.866382 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:44.866382 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:44.866382 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:44.866382 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:44.866382 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:44.866382 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:41:44.866382 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:41:44.866382 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:41:44.866382 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:41:44.872699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:44.872699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:44.872699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:41:44.872699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:44.872699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:41:44.872699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:44.872699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:44.872699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:44.872699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:44.872699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:44.872699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:44.872699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:44.872699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:44.872699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:44.872699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:44.872699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:44.872699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:44.872699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:44.873795 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:44.873795 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:44.873795 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:41:44.873795 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:41:44.873795 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:41:44.873795 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:41:44.873795 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:41:44.873795 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:41:44.873795 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:41:44.873795 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:41:44.873795 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 641/1267] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:44.874495 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2dc5e9-bf93-4c02-90cf-7dae15780149 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:44.975982 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2dc5e9-bf93-4c02-90cf-7dae15780149 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:45.018001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac8e74-9153-422e-be54-43a3bb6853d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:45.018774 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac8e74-9153-422e-be54-43a3bb6853d0 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:45.019092 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac8e74-9153-422e-be54-43a3bb6853d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:45.019455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac8e74-9153-422e-be54-43a3bb6853d0 None admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:45.020273 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac8e74-9153-422e-be54-43a3bb6853d0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:45.020582 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac8e74-9153-422e-be54-43a3bb6853d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:45.022045 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac8e74-9153-422e-be54-43a3bb6853d0 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:45.031046 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:45.040768 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 627/1268] 10.222.0.46 () {56 vars in 1143 bytes} [Wed Aug 3 12:41:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:41:45.046466 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caecf931-cf5b-462b-906f-e69432d4e0b4 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:45.143142 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caecf931-cf5b-462b-906f-e69432d4e0b4 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:45.175797 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca453050-e9cc-4de4-a44e-d7165d1cd90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:45.176421 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca453050-e9cc-4de4-a44e-d7165d1cd90e None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:45.176705 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca453050-e9cc-4de4-a44e-d7165d1cd90e None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:45.176982 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca453050-e9cc-4de4-a44e-d7165d1cd90e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:45.187819 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca453050-e9cc-4de4-a44e-d7165d1cd90e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:45.189261 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca453050-e9cc-4de4-a44e-d7165d1cd90e None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:45.203243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-ca453050-e9cc-4de4-a44e-d7165d1cd90e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:45.203243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:45.203243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:45.203243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:45.203243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:45.203243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:45.203243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:45.203243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:45.203243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:45.203243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:45.203243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:45.203243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:45.203243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:45.203243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:45.203243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:45.204235 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:45.204235 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:45.204235 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:45.204235 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:45.204235 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:45.204235 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:45.204235 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:45.204235 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:45.204235 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:45.204235 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:45.204235 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:45.204235 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:45.204235 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:45.204235 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:45.204235 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:45.204235 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:45.204235 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:45.205291 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:45.205291 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:45.205291 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:45.205291 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:41:45.205291 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 642/1269] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:45.210018 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac8e74-9153-422e-be54-43a3bb6853d0 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:45.306127 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac8e74-9153-422e-be54-43a3bb6853d0 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:45.338531 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2393e71-394f-47fb-84b5-9b94e67e2ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:45.339122 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2393e71-394f-47fb-84b5-9b94e67e2ba1 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:45.339402 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2393e71-394f-47fb-84b5-9b94e67e2ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:45.339669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2393e71-394f-47fb-84b5-9b94e67e2ba1 None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:45.340345 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2393e71-394f-47fb-84b5-9b94e67e2ba1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:45.340643 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2393e71-394f-47fb-84b5-9b94e67e2ba1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:45.342011 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2393e71-394f-47fb-84b5-9b94e67e2ba1 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:45.353412 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 628/1270] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:45.359062 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca453050-e9cc-4de4-a44e-d7165d1cd90e None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:45.389887 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:45.457377 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca453050-e9cc-4de4-a44e-d7165d1cd90e None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:45.490700 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829b40a-ddc5-4aff-86d6-2b64624cccde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:45.491325 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829b40a-ddc5-4aff-86d6-2b64624cccde None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:45.491608 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829b40a-ddc5-4aff-86d6-2b64624cccde None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:45.491887 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829b40a-ddc5-4aff-86d6-2b64624cccde None admin] PATH_INFO: `/v3/projects/service` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:45.499068 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829b40a-ddc5-4aff-86d6-2b64624cccde None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:45.500510 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829b40a-ddc5-4aff-86d6-2b64624cccde None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:45.511847 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-a829b40a-ddc5-4aff-86d6-2b64624cccde None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:45.511847 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:45.511847 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:45.511847 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:45.511847 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:45.511847 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:45.511847 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:45.511847 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:45.511847 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:45.511847 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:45.511847 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:45.511847 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:45.511847 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:41:45.511847 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:41:45.511847 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:41:45.512712 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:41:45.512712 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:45.512712 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:45.512712 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:45.512712 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:45.512712 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:45.512712 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:45.512712 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:45.512712 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:45.512712 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:45.512712 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:45.512712 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:45.512712 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:45.512712 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:45.512712 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:45.512712 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:45.512712 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:45.513661 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:41:45.513661 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:41:45.513661 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:41:45.513661 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:41:45.513661 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:41:45.513661 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:41:45.513661 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:45.513661 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:41:45.513661 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 643/1271] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:41:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:45.518727 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2393e71-394f-47fb-84b5-9b94e67e2ba1 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:45.575938 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:45.617186 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2393e71-394f-47fb-84b5-9b94e67e2ba1 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:45.649863 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69406661-7355-46c4-93e7-0c97c7a1b28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:45.650467 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69406661-7355-46c4-93e7-0c97c7a1b28e None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:45.650751 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69406661-7355-46c4-93e7-0c97c7a1b28e None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:45.651028 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69406661-7355-46c4-93e7-0c97c7a1b28e None admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:45.651778 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69406661-7355-46c4-93e7-0c97c7a1b28e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:45.652089 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69406661-7355-46c4-93e7-0c97c7a1b28e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:45.653513 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69406661-7355-46c4-93e7-0c97c7a1b28e None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:45.665734 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 629/1272] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 3 12:41:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:45.671638 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829b40a-ddc5-4aff-86d6-2b64624cccde None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:45.759448 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:45.768156 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829b40a-ddc5-4aff-86d6-2b64624cccde None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:45.801008 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10288da3-62c7-4371-af84-402f382138bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:45.801696 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10288da3-62c7-4371-af84-402f382138bf None admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:45.801982 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10288da3-62c7-4371-af84-402f382138bf None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:45.802260 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10288da3-62c7-4371-af84-402f382138bf None admin] PATH_INFO: `/v3/projects/6ac833dfff634496816842c851545d21/users/a56847173abb48d39c0ee6fb9cdbbbaa/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:45.804166 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10288da3-62c7-4371-af84-402f382138bf None admin] RBAC: Authorizing `identity:create_grant(project_id=6ac833dfff634496816842c851545d21, user_id=a56847173abb48d39c0ee6fb9cdbbbaa, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:45.806384 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10288da3-62c7-4371-af84-402f382138bf None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:45.818412 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 644/1273] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Aug 3 12:41:45 2022] PUT /identity/v3/projects/6ac833dfff634496816842c851545d21/users/a56847173abb48d39c0ee6fb9cdbbbaa/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:41:47.791873 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dda9fb-e246-4243-b997-ccdf4d0de672 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:47.792380 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dda9fb-e246-4243-b997-ccdf4d0de672 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:47.792470 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dda9fb-e246-4243-b997-ccdf4d0de672 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:47.793818 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 630/1274] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:41:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:47.798998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd6cec-7272-40fe-8e47-724fc7becf31 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:47.799393 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd6cec-7272-40fe-8e47-724fc7becf31 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:47.799544 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd6cec-7272-40fe-8e47-724fc7becf31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:47.817283 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-d1bd6cec-7272-40fe-8e47-724fc7becf31 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:47.818484 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-d1bd6cec-7272-40fe-8e47-724fc7becf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:47.883276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 645/1275] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:41:47.906650 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dda9fb-e246-4243-b997-ccdf4d0de672 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:48.015748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dda9fb-e246-4243-b997-ccdf4d0de672 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:48.032719 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:48.049397 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82790d0b-ccf1-4147-9544-3b50cad7e325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:48.050000 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82790d0b-ccf1-4147-9544-3b50cad7e325 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:48.050285 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82790d0b-ccf1-4147-9544-3b50cad7e325 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:48.050561 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82790d0b-ccf1-4147-9544-3b50cad7e325 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:48.060404 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82790d0b-ccf1-4147-9544-3b50cad7e325 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 03 12:41:48.065323 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-82790d0b-ccf1-4147-9544-3b50cad7e325 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:41:48.065323 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:48.065323 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:48.065323 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:48.065323 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:48.065323 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:48.065323 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:48.065323 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:48.065323 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:48.065323 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:48.065323 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:48.065323 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:48.065323 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 03 12:41:48.065323 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 03 12:41:48.065323 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 03 12:41:48.065323 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 03 12:41:48.066409 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 03 12:41:48.066409 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 03 12:41:48.066409 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 03 12:41:48.066409 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 03 12:41:48.066409 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:48.066409 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:48.066409 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:48.066409 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:48.066409 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:48.066409 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:48.066409 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:48.066409 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:48.066409 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:48.066409 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:48.066409 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:48.066409 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:48.067280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:48.067280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:48.067280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:48.067280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:48.067280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 03 12:41:48.067280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 03 12:41:48.067280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 03 12:41:48.067280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 03 12:41:48.067280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 03 12:41:48.067280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 03 12:41:48.067280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 03 12:41:48.067280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:41:48.067280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 631/1276] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Aug 3 12:41:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:48.073350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd6cec-7272-40fe-8e47-724fc7becf31 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:48.152120 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:48.170387 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd6cec-7272-40fe-8e47-724fc7becf31 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:48.203626 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51455f-3ecb-4717-b6cf-568fad1bc85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:48.204235 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51455f-3ecb-4717-b6cf-568fad1bc85d None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:48.204516 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51455f-3ecb-4717-b6cf-568fad1bc85d None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:48.204798 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51455f-3ecb-4717-b6cf-568fad1bc85d None admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:48.205542 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51455f-3ecb-4717-b6cf-568fad1bc85d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:48.205850 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51455f-3ecb-4717-b6cf-568fad1bc85d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:48.207214 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51455f-3ecb-4717-b6cf-568fad1bc85d None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:48.215822 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 646/1277] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Aug 3 12:41:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:48.221540 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82790d0b-ccf1-4147-9544-3b50cad7e325 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:48.323868 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82790d0b-ccf1-4147-9544-3b50cad7e325 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:48.357093 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29e80c-9464-4b81-bbec-a2cb655750dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:48.357773 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29e80c-9464-4b81-bbec-a2cb655750dc None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:48.358056 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29e80c-9464-4b81-bbec-a2cb655750dc None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:48.358333 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29e80c-9464-4b81-bbec-a2cb655750dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:48.368759 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d29e80c-9464-4b81-bbec-a2cb655750dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:48.370228 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d29e80c-9464-4b81-bbec-a2cb655750dc None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:48.385076 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-8d29e80c-9464-4b81-bbec-a2cb655750dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:48.385076 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:48.385076 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:48.385076 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:48.385076 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:48.385076 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:48.385076 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:48.385076 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:48.385076 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:48.385076 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:48.385076 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:48.385076 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:48.385076 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:48.385076 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:48.385076 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:48.386129 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:48.386129 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:48.386129 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:48.386129 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:48.386129 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:48.386129 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:48.386129 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:48.386129 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:48.386129 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:48.386129 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:48.386129 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:48.386129 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:48.386129 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:48.386129 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:48.386129 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:48.386129 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:48.386129 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:48.387197 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:48.387197 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:48.387197 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:48.387197 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:41:48.387197 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 632/1278] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:48.391997 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51455f-3ecb-4717-b6cf-568fad1bc85d None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:48.486361 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51455f-3ecb-4717-b6cf-568fad1bc85d None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:48.518939 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e1f63-5406-4985-99de-b9130203093d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:48.519532 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e1f63-5406-4985-99de-b9130203093d None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:48.519810 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e1f63-5406-4985-99de-b9130203093d None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:48.520080 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e1f63-5406-4985-99de-b9130203093d None admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:48.520757 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e1f63-5406-4985-99de-b9130203093d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:48.521056 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e1f63-5406-4985-99de-b9130203093d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:48.522426 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e1f63-5406-4985-99de-b9130203093d None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:48.533854 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 647/1279] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:48.539347 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29e80c-9464-4b81-bbec-a2cb655750dc None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:48.577038 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:48.644417 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29e80c-9464-4b81-bbec-a2cb655750dc None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:48.676282 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeeac00-c794-4815-aff8-c594172fb3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:48.676903 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeeac00-c794-4815-aff8-c594172fb3fc None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:48.677180 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeeac00-c794-4815-aff8-c594172fb3fc None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:48.677450 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeeac00-c794-4815-aff8-c594172fb3fc None admin] PATH_INFO: `/v3/users/placement` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:48.685056 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeeac00-c794-4815-aff8-c594172fb3fc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:48.686496 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeeac00-c794-4815-aff8-c594172fb3fc None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:48.698031 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-2eeeac00-c794-4815-aff8-c594172fb3fc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:41:48.698031 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:48.698031 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:48.698031 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:48.698031 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:48.698031 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:48.698031 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:48.698031 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:48.698031 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:48.698031 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:48.698031 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:48.698031 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:48.698031 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 03 12:41:48.698031 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 03 12:41:48.698031 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 03 12:41:48.698031 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 03 12:41:48.698955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:48.698955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:48.698955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 03 12:41:48.698955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:48.698955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 03 12:41:48.698955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 03 12:41:48.698955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:48.698955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:48.698955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:48.698955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:48.698955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:48.698955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:48.698955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:48.698955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:48.698955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:48.698955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:48.698955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:48.698955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:48.699935 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:48.699935 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:48.699935 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 03 12:41:48.699935 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 03 12:41:48.699935 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 03 12:41:48.699935 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 03 12:41:48.699935 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 03 12:41:48.699935 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 03 12:41:48.699935 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 03 12:41:48.699935 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:41:48.699935 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 633/1280] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:48.704908 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e1f63-5406-4985-99de-b9130203093d None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:48.708631 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:48.799761 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e1f63-5406-4985-99de-b9130203093d None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:48.831975 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515500b-674f-450b-9ab3-ea66d88718f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:48.832519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515500b-674f-450b-9ab3-ea66d88718f7 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:48.832798 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515500b-674f-450b-9ab3-ea66d88718f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:48.833069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515500b-674f-450b-9ab3-ea66d88718f7 None admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:48.833871 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515500b-674f-450b-9ab3-ea66d88718f7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:48.834176 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515500b-674f-450b-9ab3-ea66d88718f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:48.835586 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515500b-674f-450b-9ab3-ea66d88718f7 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:48.852520 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 648/1281] 10.222.0.46 () {56 vars in 1143 bytes} [Wed Aug 3 12:41:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:48.858313 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeeac00-c794-4815-aff8-c594172fb3fc None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:48.950256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:48.961666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeeac00-c794-4815-aff8-c594172fb3fc None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:48.995470 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171afca-67d7-428c-b310-a75ccb6c4ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:48.996073 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171afca-67d7-428c-b310-a75ccb6c4ba8 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:48.996356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171afca-67d7-428c-b310-a75ccb6c4ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:48.996628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171afca-67d7-428c-b310-a75ccb6c4ba8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:49.061226 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8171afca-67d7-428c-b310-a75ccb6c4ba8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:49.062692 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8171afca-67d7-428c-b310-a75ccb6c4ba8 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:49.147895 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:49.158851 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 634/1282] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Aug 3 12:41:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 03 12:41:49.165231 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515500b-674f-450b-9ab3-ea66d88718f7 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:49.224492 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:49.263488 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515500b-674f-450b-9ab3-ea66d88718f7 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:49.299094 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece5154-912b-498a-b6d3-c2256541578f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:49.299730 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece5154-912b-498a-b6d3-c2256541578f None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:49.300011 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece5154-912b-498a-b6d3-c2256541578f None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:49.300284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece5154-912b-498a-b6d3-c2256541578f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:49.310291 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece5154-912b-498a-b6d3-c2256541578f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:49.311725 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece5154-912b-498a-b6d3-c2256541578f None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:49.325934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-eece5154-912b-498a-b6d3-c2256541578f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:49.325934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:49.325934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:49.325934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:49.325934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:49.325934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:49.325934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:49.325934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:49.325934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:49.325934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:49.325934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:49.325934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:49.325934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 03 12:41:49.325934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 03 12:41:49.325934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 03 12:41:49.326965 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 03 12:41:49.326965 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:49.326965 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:49.326965 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:49.326965 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:49.326965 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:49.326965 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:49.326965 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:49.326965 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:49.326965 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:49.326965 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:49.326965 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:49.326965 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:49.326965 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:49.326965 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:49.326965 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:49.326965 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:49.328056 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 03 12:41:49.328056 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 03 12:41:49.328056 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 03 12:41:49.328056 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:41:49.328056 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 649/1283] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:41:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:49.332715 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171afca-67d7-428c-b310-a75ccb6c4ba8 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:49.428858 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171afca-67d7-428c-b310-a75ccb6c4ba8 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:49.461298 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14dec4-bc23-4836-b845-af7c111ad6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:49.462478 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14dec4-bc23-4836-b845-af7c111ad6cf None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:49.462761 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14dec4-bc23-4836-b845-af7c111ad6cf None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:49.463036 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14dec4-bc23-4836-b845-af7c111ad6cf None admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:49.463722 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14dec4-bc23-4836-b845-af7c111ad6cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:49.464027 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14dec4-bc23-4836-b845-af7c111ad6cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:49.465368 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14dec4-bc23-4836-b845-af7c111ad6cf None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:49.476170 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 635/1284] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Aug 3 12:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:49.481834 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece5154-912b-498a-b6d3-c2256541578f None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:49.579218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece5154-912b-498a-b6d3-c2256541578f None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:49.593093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:49.613301 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acda22-a28b-4c81-bb12-419d67ff668f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:49.613962 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acda22-a28b-4c81-bb12-419d67ff668f None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:49.614246 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acda22-a28b-4c81-bb12-419d67ff668f None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:49.614522 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acda22-a28b-4c81-bb12-419d67ff668f None admin] PATH_INFO: `/v3/projects/service` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:49.621201 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acda22-a28b-4c81-bb12-419d67ff668f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:49.622679 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acda22-a28b-4c81-bb12-419d67ff668f None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:49.636478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application [None req-92acda22-a28b-4c81-bb12-419d67ff668f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:49.636478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:49.636478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:49.636478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:49.636478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:49.636478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:49.636478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:49.636478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:49.636478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:49.636478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:49.636478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:49.636478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:49.636478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 03 12:41:49.636478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 03 12:41:49.636478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 03 12:41:49.637537 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 03 12:41:49.637537 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:49.637537 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:49.637537 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:49.637537 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:49.637537 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:49.637537 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:49.637537 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:49.637537 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:49.637537 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:49.637537 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:49.637537 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:49.637537 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:49.637537 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:49.637537 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:49.637537 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:49.637537 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:49.638734 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 03 12:41:49.638734 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 03 12:41:49.638734 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 03 12:41:49.638734 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 03 12:41:49.638734 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 03 12:41:49.638734 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 03 12:41:49.638734 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 03 12:41:49.638734 dv-cinder-850836-4-smb devstack@keystone.service[91789]: ERROR keystone.server.flask.application Aug 03 12:41:49.638734 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 650/1285] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Aug 3 12:41:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:49.643428 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14dec4-bc23-4836-b845-af7c111ad6cf None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:49.692969 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:49.742401 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14dec4-bc23-4836-b845-af7c111ad6cf None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:49.775739 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f08ca7-7e0c-4313-8c5e-b2142ad75893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:49.776343 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f08ca7-7e0c-4313-8c5e-b2142ad75893 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:49.776624 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f08ca7-7e0c-4313-8c5e-b2142ad75893 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:49.776902 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f08ca7-7e0c-4313-8c5e-b2142ad75893 None admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:49.777680 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f08ca7-7e0c-4313-8c5e-b2142ad75893 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:49.777991 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f08ca7-7e0c-4313-8c5e-b2142ad75893 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:49.779410 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f08ca7-7e0c-4313-8c5e-b2142ad75893 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:49.791049 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 636/1286] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Aug 3 12:41:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:41:49.797119 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acda22-a28b-4c81-bb12-419d67ff668f None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:49.893165 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acda22-a28b-4c81-bb12-419d67ff668f None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:49.925101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159b1c9-9cb3-4226-969b-9a161e26e370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:49.925730 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159b1c9-9cb3-4226-969b-9a161e26e370 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:49.926013 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159b1c9-9cb3-4226-969b-9a161e26e370 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:49.926285 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159b1c9-9cb3-4226-969b-9a161e26e370 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:49.927063 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0159b1c9-9cb3-4226-969b-9a161e26e370 None admin] RBAC: Adding query filter params (role.id=0e57d142f86c471883fc07a89fe66ec8, scope.project.id=6ac833dfff634496816842c851545d21, user.id=a56847173abb48d39c0ee6fb9cdbbbaa) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:49.927372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0159b1c9-9cb3-4226-969b-9a161e26e370 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:49.928786 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0159b1c9-9cb3-4226-969b-9a161e26e370 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:49.935154 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 651/1287] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Aug 3 12:41:49 2022] GET /identity/v3/role_assignments?user.id=a56847173abb48d39c0ee6fb9cdbbbaa&scope.project.id=6ac833dfff634496816842c851545d21&role.id=0e57d142f86c471883fc07a89fe66ec8 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:51.947563 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf57694-7add-4757-a4b8-db5ffa8ebdea None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:51.948151 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf57694-7add-4757-a4b8-db5ffa8ebdea None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:51.948151 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf57694-7add-4757-a4b8-db5ffa8ebdea None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:51.949860 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 637/1288] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:41:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:51.955324 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36654bdc-1869-47f8-8c95-1d4a330b2228 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:51.955754 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36654bdc-1869-47f8-8c95-1d4a330b2228 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:51.956021 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36654bdc-1869-47f8-8c95-1d4a330b2228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:51.978175 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-36654bdc-1869-47f8-8c95-1d4a330b2228 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:51.979610 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-36654bdc-1869-47f8-8c95-1d4a330b2228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:52.015025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:52.051700 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 652/1289] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:41:52.074310 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf57694-7add-4757-a4b8-db5ffa8ebdea None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:52.170357 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf57694-7add-4757-a4b8-db5ffa8ebdea None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:52.180954 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:52.204274 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c156f6-5ca1-4b08-a651-715ce7b3f76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:52.204831 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c156f6-5ca1-4b08-a651-715ce7b3f76c None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:52.205108 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c156f6-5ca1-4b08-a651-715ce7b3f76c None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:52.205378 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c156f6-5ca1-4b08-a651-715ce7b3f76c None admin] PATH_INFO: `/v3/services/placement` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:52.206025 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c156f6-5ca1-4b08-a651-715ce7b3f76c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:52.207369 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c156f6-5ca1-4b08-a651-715ce7b3f76c None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:52.216087 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-f8c156f6-5ca1-4b08-a651-715ce7b3f76c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 03 12:41:52.216087 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:52.216087 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:41:52.216087 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:41:52.216087 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:41:52.216087 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:41:52.216087 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:41:52.216087 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:41:52.216087 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 03 12:41:52.216087 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:41:52.216087 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:41:52.216087 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:41:52.216087 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:52.216087 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:52.216087 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:52.216087 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:52.216087 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:52.217294 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:52.217294 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:52.217294 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:52.217294 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:52.217294 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:52.217294 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:52.217294 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:41:52.217294 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:41:52.217294 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:41:52.217294 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:41:52.217294 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:52.217294 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:52.217294 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:52.217294 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:52.217294 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:52.217294 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:52.218193 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:52.218193 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:52.218193 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:52.218193 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:52.218193 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:52.218193 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:52.218193 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:52.218193 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:52.218193 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:52.218193 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:52.218193 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:41:52.218193 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:41:52.218193 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 03 12:41:52.218193 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:41:52.218193 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 638/1290] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Aug 3 12:41:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:52.223269 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36654bdc-1869-47f8-8c95-1d4a330b2228 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:52.319793 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36654bdc-1869-47f8-8c95-1d4a330b2228 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:52.353328 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141e9fd-1de6-4476-a462-e8a412371edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:52.353972 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141e9fd-1de6-4476-a462-e8a412371edc None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:52.354255 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141e9fd-1de6-4476-a462-e8a412371edc None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:52.354530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141e9fd-1de6-4476-a462-e8a412371edc None admin] PATH_INFO: `/v3/services` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:52.355209 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f141e9fd-1de6-4476-a462-e8a412371edc None admin] RBAC: Adding query filter params (name=placement) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:52.355515 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f141e9fd-1de6-4476-a462-e8a412371edc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:52.356878 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f141e9fd-1de6-4476-a462-e8a412371edc None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:52.361613 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 653/1291] 10.222.0.46 () {56 vars in 1116 bytes} [Wed Aug 3 12:41:52 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:52.367284 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c156f6-5ca1-4b08-a651-715ce7b3f76c None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:52.465100 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c156f6-5ca1-4b08-a651-715ce7b3f76c None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:52.498081 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f76fa3-bd6d-40fb-a187-563ce93708f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:52.498677 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f76fa3-bd6d-40fb-a187-563ce93708f2 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:52.498958 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f76fa3-bd6d-40fb-a187-563ce93708f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:52.499229 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f76fa3-bd6d-40fb-a187-563ce93708f2 None admin] PATH_INFO: `/v3/services` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:52.499899 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f76fa3-bd6d-40fb-a187-563ce93708f2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:52.500203 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f76fa3-bd6d-40fb-a187-563ce93708f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:52.501576 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f76fa3-bd6d-40fb-a187-563ce93708f2 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:52.505902 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 639/1292] 10.222.0.46 () {56 vars in 1116 bytes} [Wed Aug 3 12:41:52 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:54.488611 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7ea1d-b089-4429-95b3-be972977e138 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:54.489128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7ea1d-b089-4429-95b3-be972977e138 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:54.489217 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7ea1d-b089-4429-95b3-be972977e138 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:54.490572 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 654/1293] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:54.496608 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b74fe5-72e7-4b1c-acd2-dfd003a5ed3f None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:54.497001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b74fe5-72e7-4b1c-acd2-dfd003a5ed3f None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:54.497162 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b74fe5-72e7-4b1c-acd2-dfd003a5ed3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:54.515689 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-f4b74fe5-72e7-4b1c-acd2-dfd003a5ed3f None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:54.516890 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-f4b74fe5-72e7-4b1c-acd2-dfd003a5ed3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:54.545572 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:54.582899 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 640/1294] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:41:54.604580 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7ea1d-b089-4429-95b3-be972977e138 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:54.636920 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:54.705240 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7ea1d-b089-4429-95b3-be972977e138 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:54.737510 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f4546-e99d-402e-a790-15b1375ec03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:54.738120 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f4546-e99d-402e-a790-15b1375ec03b None admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:54.738397 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f4546-e99d-402e-a790-15b1375ec03b None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:54.738666 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f4546-e99d-402e-a790-15b1375ec03b None admin] PATH_INFO: `/v3/services` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:54.739355 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f4546-e99d-402e-a790-15b1375ec03b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:54.740718 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f4546-e99d-402e-a790-15b1375ec03b None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:54.759962 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 655/1295] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Aug 3 12:41:54 2022] POST /identity/v3/services => generated 246 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:41:56.763232 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5dd4c-226e-49d0-9c56-a84204d26acd None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:56.763771 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5dd4c-226e-49d0-9c56-a84204d26acd None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:56.763771 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5dd4c-226e-49d0-9c56-a84204d26acd None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:56.765159 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 641/1296] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:56.770317 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fd50f-7115-4e70-aab4-051bc816ab5f None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:56.770737 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fd50f-7115-4e70-aab4-051bc816ab5f None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:56.770866 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fd50f-7115-4e70-aab4-051bc816ab5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:56.789089 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-9a5fd50f-7115-4e70-aab4-051bc816ab5f None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:56.791193 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-9a5fd50f-7115-4e70-aab4-051bc816ab5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:56.861841 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 656/1297] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:56 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 03 12:41:56.884804 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5dd4c-226e-49d0-9c56-a84204d26acd None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:56.993460 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5dd4c-226e-49d0-9c56-a84204d26acd None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:57.030088 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4860a9-723d-4e70-b84f-0fc717d7f29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:57.030651 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4860a9-723d-4e70-b84f-0fc717d7f29d None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:57.030929 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4860a9-723d-4e70-b84f-0fc717d7f29d None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:57.031195 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4860a9-723d-4e70-b84f-0fc717d7f29d None admin] PATH_INFO: `/v3/services/placement` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:57.031812 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4860a9-723d-4e70-b84f-0fc717d7f29d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:57.033157 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4860a9-723d-4e70-b84f-0fc717d7f29d None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:57.042376 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-6a4860a9-723d-4e70-b84f-0fc717d7f29d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 03 12:41:57.042376 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:57.042376 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:41:57.042376 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:41:57.042376 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:41:57.042376 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:41:57.042376 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:41:57.042376 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:41:57.042376 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 03 12:41:57.042376 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:41:57.042376 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:41:57.042376 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:41:57.042376 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:57.042376 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:57.042376 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:57.042376 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:57.042376 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:57.043613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:57.043613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:57.043613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:57.043613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:57.043613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:57.043613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:57.043613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:41:57.043613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:41:57.043613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:41:57.043613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:41:57.043613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:57.043613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:57.043613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:57.043613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:57.043613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:57.043613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:57.044542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:57.044542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:57.044542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:57.044542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:57.044542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:57.044542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:57.044542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:57.044542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:57.044542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:57.044542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:57.044542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:41:57.044542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:41:57.044542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 03 12:41:57.044542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:41:57.044542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 642/1298] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Aug 3 12:41:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:57.049696 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5fd50f-7115-4e70-aab4-051bc816ab5f None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:57.067804 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:57.145885 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5fd50f-7115-4e70-aab4-051bc816ab5f None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:57.178791 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a071c2-a33f-4a25-ba75-6bcfd6c1fb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:57.179390 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a071c2-a33f-4a25-ba75-6bcfd6c1fb46 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:57.179667 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a071c2-a33f-4a25-ba75-6bcfd6c1fb46 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:57.180610 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a071c2-a33f-4a25-ba75-6bcfd6c1fb46 None admin] PATH_INFO: `/v3/services` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:57.181285 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a071c2-a33f-4a25-ba75-6bcfd6c1fb46 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:57.181604 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a071c2-a33f-4a25-ba75-6bcfd6c1fb46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:57.182961 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a071c2-a33f-4a25-ba75-6bcfd6c1fb46 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:57.187903 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 657/1299] 10.222.0.46 () {56 vars in 1116 bytes} [Wed Aug 3 12:41:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:57.193852 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4860a9-723d-4e70-b84f-0fc717d7f29d None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:57.225064 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:57.297706 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4860a9-723d-4e70-b84f-0fc717d7f29d None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:57.330053 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4d423-6ff1-4bce-8188-5838d2d38350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:57.330655 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4d423-6ff1-4bce-8188-5838d2d38350 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:57.330933 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4d423-6ff1-4bce-8188-5838d2d38350 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:57.331203 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4d423-6ff1-4bce-8188-5838d2d38350 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:57.331942 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4d423-6ff1-4bce-8188-5838d2d38350 None admin] RBAC: Adding query filter params (interface=public, service_id=28222d5f11da4a4280a477dfae4f9fa7, region_id=RegionOne) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:57.332249 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4d423-6ff1-4bce-8188-5838d2d38350 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:57.333623 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4d423-6ff1-4bce-8188-5838d2d38350 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:57.338999 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 643/1300] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Aug 3 12:41:57 2022] GET /identity/v3/endpoints?service_id=28222d5f11da4a4280a477dfae4f9fa7&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:57.344581 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a071c2-a33f-4a25-ba75-6bcfd6c1fb46 None admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:57.422935 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:57.440423 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a071c2-a33f-4a25-ba75-6bcfd6c1fb46 None admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:57.473059 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae94b9-16d4-4802-a271-066ec734fc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:57.473684 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae94b9-16d4-4802-a271-066ec734fc5c None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:57.473982 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae94b9-16d4-4802-a271-066ec734fc5c None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:57.474251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae94b9-16d4-4802-a271-066ec734fc5c None admin] PATH_INFO: `/v3/services` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:57.474899 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae94b9-16d4-4802-a271-066ec734fc5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:57.476252 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae94b9-16d4-4802-a271-066ec734fc5c None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:57.483606 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 658/1301] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Aug 3 12:41:57 2022] GET /identity/v3/services => generated 2191 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:41:59.478823 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380e294-a123-489b-b6d5-c483984dbad8 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:59.479370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380e294-a123-489b-b6d5-c483984dbad8 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:59.479370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380e294-a123-489b-b6d5-c483984dbad8 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:59.480728 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 644/1302] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:41:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:41:59.485859 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754bad9-c8b0-40d8-aa5a-44cee44bef46 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:59.486282 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754bad9-c8b0-40d8-aa5a-44cee44bef46 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:59.486391 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754bad9-c8b0-40d8-aa5a-44cee44bef46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:59.504749 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-8754bad9-c8b0-40d8-aa5a-44cee44bef46 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:41:59.505959 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-8754bad9-c8b0-40d8-aa5a-44cee44bef46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:41:59.569073 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 659/1303] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:41:59 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 03 12:41:59.591466 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380e294-a123-489b-b6d5-c483984dbad8 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:59.684048 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:59.691211 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380e294-a123-489b-b6d5-c483984dbad8 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:59.724046 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139af52-7be9-41a3-bd0b-7a60c4e319d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:59.724663 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139af52-7be9-41a3-bd0b-7a60c4e319d7 None admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:59.724937 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139af52-7be9-41a3-bd0b-7a60c4e319d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:59.725203 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139af52-7be9-41a3-bd0b-7a60c4e319d7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:59.725844 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139af52-7be9-41a3-bd0b-7a60c4e319d7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:59.727288 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139af52-7be9-41a3-bd0b-7a60c4e319d7 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:59.735814 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application [None req-b139af52-7be9-41a3-bd0b-7a60c4e319d7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 03 12:41:59.735814 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:59.735814 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 03 12:41:59.735814 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 03 12:41:59.735814 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 03 12:41:59.735814 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 03 12:41:59.735814 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 03 12:41:59.735814 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:41:59.735814 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 03 12:41:59.735814 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:41:59.735814 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 03 12:41:59.735814 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:41:59.735814 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 03 12:41:59.735814 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 03 12:41:59.735814 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 03 12:41:59.735814 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 03 12:41:59.735814 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 03 12:41:59.736960 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 03 12:41:59.736960 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 03 12:41:59.736960 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 03 12:41:59.736960 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 03 12:41:59.736960 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 03 12:41:59.736960 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 03 12:41:59.736960 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 03 12:41:59.736960 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 03 12:41:59.736960 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 03 12:41:59.736960 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 03 12:41:59.736960 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 03 12:41:59.736960 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 03 12:41:59.736960 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 03 12:41:59.736960 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 03 12:41:59.736960 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 03 12:41:59.736960 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 03 12:41:59.738229 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 03 12:41:59.738229 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application with Lock( Aug 03 12:41:59.738229 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 03 12:41:59.738229 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self._enter() Aug 03 12:41:59.738229 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 03 12:41:59.738229 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 03 12:41:59.738229 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 03 12:41:59.738229 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application return self.creator() Aug 03 12:41:59.738229 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 03 12:41:59.738229 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application created_value = creator( Aug 03 12:41:59.738229 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 03 12:41:59.738229 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 03 12:41:59.738229 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 03 12:41:59.738229 dv-cinder-850836-4-smb devstack@keystone.service[91788]: ERROR keystone.server.flask.application Aug 03 12:41:59.738229 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 645/1304] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Aug 3 12:41:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 03 12:41:59.743598 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754bad9-c8b0-40d8-aa5a-44cee44bef46 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:59.815934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:41:59.838503 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754bad9-c8b0-40d8-aa5a-44cee44bef46 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:41:59.870885 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad1817-80e1-4eb4-868f-eec2ff6abc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:41:59.871482 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad1817-80e1-4eb4-868f-eec2ff6abc62 None admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:41:59.871761 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad1817-80e1-4eb4-868f-eec2ff6abc62 None admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:41:59.872033 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad1817-80e1-4eb4-868f-eec2ff6abc62 None admin] PATH_INFO: `/v3/services` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:41:59.872705 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad1817-80e1-4eb4-868f-eec2ff6abc62 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:41:59.873005 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad1817-80e1-4eb4-868f-eec2ff6abc62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:41:59.874385 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad1817-80e1-4eb4-868f-eec2ff6abc62 None admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:41:59.879327 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 660/1305] 10.222.0.46 () {56 vars in 1116 bytes} [Wed Aug 3 12:41:59 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:41:59.885610 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139af52-7be9-41a3-bd0b-7a60c4e319d7 None admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:41:59.998357 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139af52-7be9-41a3-bd0b-7a60c4e319d7 None admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:42:00.032268 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2284bd-905c-409f-b80d-2d9ed9cb9d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:42:00.032874 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2284bd-905c-409f-b80d-2d9ed9cb9d35 None admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:42:00.033155 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2284bd-905c-409f-b80d-2d9ed9cb9d35 None admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:42:00.033428 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2284bd-905c-409f-b80d-2d9ed9cb9d35 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:42:00.034155 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2284bd-905c-409f-b80d-2d9ed9cb9d35 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:42:00.035507 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2284bd-905c-409f-b80d-2d9ed9cb9d35 None admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:42:00.054597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 646/1306] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:41:59 2022] POST /identity/v3/endpoints => generated 331 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:42:09.876813 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=30 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:42:10.050409 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:02.693246 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045ea24-44fd-45b2-9711-a6cea92f855f None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:02.694448 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045ea24-44fd-45b2-9711-a6cea92f855f None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:02.695458 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045ea24-44fd-45b2-9711-a6cea92f855f None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:02.702707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86015a-f0b5-4c09-ad30-aa2318eda519 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:02.703587 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86015a-f0b5-4c09-ad30-aa2318eda519 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:02.704089 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86015a-f0b5-4c09-ad30-aa2318eda519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:02.708858 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 661/1307] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:43:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:43:02.794799 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-fd86015a-f0b5-4c09-ad30-aa2318eda519 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:43:02.795957 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-fd86015a-f0b5-4c09-ad30-aa2318eda519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:02.952966 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 647/1308] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:43:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:43:03.018716 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d8fed-53a2-447e-af2d-6e345f7e3ee5 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:03.019379 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d8fed-53a2-447e-af2d-6e345f7e3ee5 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:03.019860 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d8fed-53a2-447e-af2d-6e345f7e3ee5 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:03.021460 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 662/1309] 10.222.0.46 () {54 vars in 965 bytes} [Wed Aug 3 12:43:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:43:03.028466 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea765f6-a623-4676-bdd1-7060231fbeda None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:03.029050 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea765f6-a623-4676-bdd1-7060231fbeda None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:03.029559 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea765f6-a623-4676-bdd1-7060231fbeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:03.185535 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-4ea765f6-a623-4676-bdd1-7060231fbeda None None] MFA Rules not processed for user `e0cd747cb5f64ff7b5f8d67d3d640fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:43:03.186774 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-4ea765f6-a623-4676-bdd1-7060231fbeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:03.238585 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:03.333929 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 648/1310] 10.222.0.46 () {58 vars in 1062 bytes} [Wed Aug 3 12:43:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:43:03.334766 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d8fed-53a2-447e-af2d-6e345f7e3ee5 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:03.337350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-b22d8fed-53a2-447e-af2d-6e345f7e3ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:03.528174 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d8fed-53a2-447e-af2d-6e345f7e3ee5 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:03.621374 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602af0ae-d93a-479a-b304-1c0121bd2b9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:03.622390 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602af0ae-d93a-479a-b304-1c0121bd2b9f service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:03.622883 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602af0ae-d93a-479a-b304-1c0121bd2b9f service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:03.623341 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602af0ae-d93a-479a-b304-1c0121bd2b9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:03.625587 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-602af0ae-d93a-479a-b304-1c0121bd2b9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:03.689325 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:03.753316 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602af0ae-d93a-479a-b304-1c0121bd2b9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:03.755664 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602af0ae-d93a-479a-b304-1c0121bd2b9f service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:03.776912 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 663/1311] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:43:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:43:06.135228 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f1a77-aecd-4253-9981-2f855154c44f None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:06.135756 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f1a77-aecd-4253-9981-2f855154c44f None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:06.135844 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f1a77-aecd-4253-9981-2f855154c44f None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:06.137324 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 649/1312] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:43:06.142582 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1524f45-9699-477c-85a9-a141b6d72930 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:06.142996 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1524f45-9699-477c-85a9-a141b6d72930 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:06.143135 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1524f45-9699-477c-85a9-a141b6d72930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:06.213816 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-d1524f45-9699-477c-85a9-a141b6d72930 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:43:06.215050 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-d1524f45-9699-477c-85a9-a141b6d72930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:06.314739 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 664/1313] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:43:06.353101 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f1a77-aecd-4253-9981-2f855154c44f None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:06.354711 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-746f1a77-aecd-4253-9981-2f855154c44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:06.459043 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f1a77-aecd-4253-9981-2f855154c44f None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:06.532992 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:06.535637 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b208925-8cd2-47c9-8e04-8943d9d9b396 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:06.536380 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b208925-8cd2-47c9-8e04-8943d9d9b396 service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:06.536997 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b208925-8cd2-47c9-8e04-8943d9d9b396 service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:06.537330 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b208925-8cd2-47c9-8e04-8943d9d9b396 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:06.540085 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-2b208925-8cd2-47c9-8e04-8943d9d9b396 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:06.659121 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b208925-8cd2-47c9-8e04-8943d9d9b396 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:06.660667 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b208925-8cd2-47c9-8e04-8943d9d9b396 service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:06.683785 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 650/1314] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:43:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:43:08.996011 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1801d-f205-4301-a867-11159ceb0d26 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:08.996513 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1801d-f205-4301-a867-11159ceb0d26 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:08.996611 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1801d-f205-4301-a867-11159ceb0d26 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:08.997953 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 665/1315] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:43:09.002894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1122d-bcd3-4915-b515-b10d1476f338 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:09.003305 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1122d-bcd3-4915-b515-b10d1476f338 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:09.003477 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1122d-bcd3-4915-b515-b10d1476f338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:09.068241 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-4ac1122d-bcd3-4915-b515-b10d1476f338 None None] MFA Rules not processed for user `354f0ccac1cc4be991872072a6c781a0`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:43:09.070151 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-4ac1122d-bcd3-4915-b515-b10d1476f338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:09.121076 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:09.165708 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 651/1316] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:43:09 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:43:09.204796 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1801d-f205-4301-a867-11159ceb0d26 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:09.206433 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-00a1801d-f205-4301-a867-11159ceb0d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:09.216761 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:09.310849 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1801d-f205-4301-a867-11159ceb0d26 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:09.383414 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488f17a-4e3b-4740-b354-7a207b1667fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:09.384024 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488f17a-4e3b-4740-b354-7a207b1667fe service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:09.384307 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488f17a-4e3b-4740-b354-7a207b1667fe service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:09.384578 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488f17a-4e3b-4740-b354-7a207b1667fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:09.386249 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-4488f17a-4e3b-4740-b354-7a207b1667fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:09.448356 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:09.494140 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488f17a-4e3b-4740-b354-7a207b1667fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:09.495844 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488f17a-4e3b-4740-b354-7a207b1667fe service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:09.514387 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 666/1317] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:43:09 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:43:12.025185 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e365e1-8281-4406-9f68-71d378126314 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:12.025847 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e365e1-8281-4406-9f68-71d378126314 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:12.025847 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e365e1-8281-4406-9f68-71d378126314 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:12.027161 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 652/1318] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:43:12.032389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068e9a8-b8eb-442c-9308-0c337e4580e0 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:12.032781 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068e9a8-b8eb-442c-9308-0c337e4580e0 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:12.032934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068e9a8-b8eb-442c-9308-0c337e4580e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:12.097677 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-1068e9a8-b8eb-442c-9308-0c337e4580e0 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:43:12.098878 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-1068e9a8-b8eb-442c-9308-0c337e4580e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:12.195105 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 667/1319] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:43:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:43:12.233462 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e365e1-8281-4406-9f68-71d378126314 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:12.235057 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-00e365e1-8281-4406-9f68-71d378126314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:12.338665 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e365e1-8281-4406-9f68-71d378126314 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:12.409811 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd007ffc-34fa-434d-9124-b25bf6eba485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:12.410416 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd007ffc-34fa-434d-9124-b25bf6eba485 service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:12.410692 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd007ffc-34fa-434d-9124-b25bf6eba485 service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:12.410962 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd007ffc-34fa-434d-9124-b25bf6eba485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:12.412581 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-bd007ffc-34fa-434d-9124-b25bf6eba485 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:12.420412 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:12.519934 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd007ffc-34fa-434d-9124-b25bf6eba485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:12.521362 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd007ffc-34fa-434d-9124-b25bf6eba485 service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:12.540817 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 653/1320] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:43:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:43:15.216552 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdddb39-7d15-4adf-8da9-95b874fd6b87 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:15.217057 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdddb39-7d15-4adf-8da9-95b874fd6b87 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:15.217057 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdddb39-7d15-4adf-8da9-95b874fd6b87 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:15.218491 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 668/1321] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:43:15.223697 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90da975-5eb3-4efd-93de-95e4d242862f None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:15.224137 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90da975-5eb3-4efd-93de-95e4d242862f None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:15.224230 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90da975-5eb3-4efd-93de-95e4d242862f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:15.294094 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-a90da975-5eb3-4efd-93de-95e4d242862f None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:43:15.295783 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-a90da975-5eb3-4efd-93de-95e4d242862f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:15.360345 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:15.405773 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 654/1322] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:43:15.456256 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27f44d-dfa6-4104-8520-f8b0398a4c76 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:15.456541 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27f44d-dfa6-4104-8520-f8b0398a4c76 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:15.456820 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27f44d-dfa6-4104-8520-f8b0398a4c76 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:15.458255 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 669/1323] 10.222.0.46 () {54 vars in 965 bytes} [Wed Aug 3 12:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:43:15.464927 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0c0e3-14a4-4635-b242-98a4c8724245 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:15.465360 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0c0e3-14a4-4635-b242-98a4c8724245 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:15.465684 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0c0e3-14a4-4635-b242-98a4c8724245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:15.546881 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-02c0c0e3-14a4-4635-b242-98a4c8724245 None None] MFA Rules not processed for user `e0cd747cb5f64ff7b5f8d67d3d640fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:43:15.548108 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-02c0c0e3-14a4-4635-b242-98a4c8724245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:15.625106 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 655/1324] 10.222.0.46 () {58 vars in 1062 bytes} [Wed Aug 3 12:43:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:43:15.634597 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27f44d-dfa6-4104-8520-f8b0398a4c76 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:15.636135 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-1c27f44d-dfa6-4104-8520-f8b0398a4c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:15.655984 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:15.742240 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27f44d-dfa6-4104-8520-f8b0398a4c76 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:15.816357 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760fb68-c963-4516-b8e8-dde7edb82c67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:15.816842 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760fb68-c963-4516-b8e8-dde7edb82c67 service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:15.817123 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760fb68-c963-4516-b8e8-dde7edb82c67 service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:15.817398 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760fb68-c963-4516-b8e8-dde7edb82c67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:15.819082 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-e760fb68-c963-4516-b8e8-dde7edb82c67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:15.890425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:15.929714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760fb68-c963-4516-b8e8-dde7edb82c67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:15.931174 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760fb68-c963-4516-b8e8-dde7edb82c67 service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:15.951135 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 670/1325] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:43:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:43:18.245821 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb664d-a32c-4a11-87a7-5af7c3eaabd6 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:18.246364 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb664d-a32c-4a11-87a7-5af7c3eaabd6 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:18.246483 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb664d-a32c-4a11-87a7-5af7c3eaabd6 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:18.247792 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 656/1326] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:43:18.253477 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e1836-9c2c-438e-be1b-937fa5926aff None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:18.253970 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e1836-9c2c-438e-be1b-937fa5926aff None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:18.254217 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e1836-9c2c-438e-be1b-937fa5926aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:18.324359 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-2e1e1836-9c2c-438e-be1b-937fa5926aff None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:43:18.325588 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-2e1e1836-9c2c-438e-be1b-937fa5926aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:18.428137 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 671/1327] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:43:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:43:18.465844 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb664d-a32c-4a11-87a7-5af7c3eaabd6 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:18.467379 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-77bb664d-a32c-4a11-87a7-5af7c3eaabd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:18.529900 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:18.573722 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb664d-a32c-4a11-87a7-5af7c3eaabd6 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:18.648327 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e503b-4544-4408-866d-9ccd362fccc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:18.648936 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e503b-4544-4408-866d-9ccd362fccc1 service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:18.649215 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e503b-4544-4408-866d-9ccd362fccc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:18.649479 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e503b-4544-4408-866d-9ccd362fccc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:18.651129 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-bf3e503b-4544-4408-866d-9ccd362fccc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:18.757719 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:18.760210 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e503b-4544-4408-866d-9ccd362fccc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:18.762176 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e503b-4544-4408-866d-9ccd362fccc1 service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:18.781582 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 657/1328] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:43:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:43:20.838971 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62379b8-a071-4cfe-9b35-c25f00d4b6e8 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:20.839466 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62379b8-a071-4cfe-9b35-c25f00d4b6e8 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:20.839466 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62379b8-a071-4cfe-9b35-c25f00d4b6e8 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:20.840808 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 672/1329] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:43:20.846239 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b5084-1a41-47f2-882a-f11a1109bff2 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:20.846698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b5084-1a41-47f2-882a-f11a1109bff2 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:20.846807 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b5084-1a41-47f2-882a-f11a1109bff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:20.912785 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-d43b5084-1a41-47f2-882a-f11a1109bff2 None None] MFA Rules not processed for user `354f0ccac1cc4be991872072a6c781a0`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:43:20.914737 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-d43b5084-1a41-47f2-882a-f11a1109bff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:21.018892 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 658/1330] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:43:20 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:43:21.056290 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62379b8-a071-4cfe-9b35-c25f00d4b6e8 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:21.057928 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-e62379b8-a071-4cfe-9b35-c25f00d4b6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:21.099441 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:21.175649 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62379b8-a071-4cfe-9b35-c25f00d4b6e8 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:21.247457 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac807e-4b5b-4bd5-b5b9-1e68ce3041a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:21.248068 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac807e-4b5b-4bd5-b5b9-1e68ce3041a3 service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:21.248343 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac807e-4b5b-4bd5-b5b9-1e68ce3041a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:21.248613 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac807e-4b5b-4bd5-b5b9-1e68ce3041a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:21.250265 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-d0ac807e-4b5b-4bd5-b5b9-1e68ce3041a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:21.328652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:21.360623 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac807e-4b5b-4bd5-b5b9-1e68ce3041a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:21.362027 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac807e-4b5b-4bd5-b5b9-1e68ce3041a3 service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:21.380493 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 673/1331] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:43:21 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:43:23.858523 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ca6ee-5a19-4466-bcb6-ce441f7e2535 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:23.859058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ca6ee-5a19-4466-bcb6-ce441f7e2535 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:23.859058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ca6ee-5a19-4466-bcb6-ce441f7e2535 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:23.860445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 659/1332] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:43:23.866086 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293c445-465f-4787-aa4b-bf6890bd5963 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:23.866534 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293c445-465f-4787-aa4b-bf6890bd5963 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:23.866651 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293c445-465f-4787-aa4b-bf6890bd5963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:23.933797 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-4293c445-465f-4787-aa4b-bf6890bd5963 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:43:23.935014 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-4293c445-465f-4787-aa4b-bf6890bd5963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:24.031941 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 674/1333] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:43:24.067072 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ca6ee-5a19-4466-bcb6-ce441f7e2535 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:24.068605 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-845ca6ee-5a19-4466-bcb6-ce441f7e2535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:24.139133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:24.173779 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ca6ee-5a19-4466-bcb6-ce441f7e2535 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:24.245385 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492e9d9-40c3-499d-ba09-06a60df7960a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:24.246035 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492e9d9-40c3-499d-ba09-06a60df7960a service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:24.246310 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492e9d9-40c3-499d-ba09-06a60df7960a service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:24.246579 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492e9d9-40c3-499d-ba09-06a60df7960a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:24.248203 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-f492e9d9-40c3-499d-ba09-06a60df7960a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:24.354905 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492e9d9-40c3-499d-ba09-06a60df7960a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:24.356322 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492e9d9-40c3-499d-ba09-06a60df7960a service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:24.366614 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:24.376200 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 660/1334] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:43:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:43:26.411699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda3e05-a2ea-4b1a-94bc-39477dde033f None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:26.412271 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda3e05-a2ea-4b1a-94bc-39477dde033f None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:26.412271 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda3e05-a2ea-4b1a-94bc-39477dde033f None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:26.413712 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 675/1335] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:43:26.418815 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101927d0-ffa1-405d-b284-3412311a41fb None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:26.419203 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101927d0-ffa1-405d-b284-3412311a41fb None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:26.419374 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101927d0-ffa1-405d-b284-3412311a41fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:26.484036 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-101927d0-ffa1-405d-b284-3412311a41fb None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:43:26.485240 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-101927d0-ffa1-405d-b284-3412311a41fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:26.581628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 661/1336] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:43:26.622004 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda3e05-a2ea-4b1a-94bc-39477dde033f None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:26.623548 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-ffda3e05-a2ea-4b1a-94bc-39477dde033f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:26.663579 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:26.728526 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda3e05-a2ea-4b1a-94bc-39477dde033f None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:26.801019 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e6b45-ecf7-4dc0-9144-b011ed7544bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:26.801660 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e6b45-ecf7-4dc0-9144-b011ed7544bb service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:26.801941 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e6b45-ecf7-4dc0-9144-b011ed7544bb service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:26.802218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e6b45-ecf7-4dc0-9144-b011ed7544bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:26.803919 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-023e6b45-ecf7-4dc0-9144-b011ed7544bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:26.886192 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:26.918532 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e6b45-ecf7-4dc0-9144-b011ed7544bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:26.919980 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e6b45-ecf7-4dc0-9144-b011ed7544bb service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:26.937967 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 676/1337] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:43:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:43:29.374968 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d558a1-f527-43a5-b43d-552347701714 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:29.375540 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d558a1-f527-43a5-b43d-552347701714 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:29.375540 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d558a1-f527-43a5-b43d-552347701714 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:29.376872 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 662/1338] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:43:29.382138 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfd461-57b9-46ca-8b9d-9e4120f20af7 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:29.382581 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfd461-57b9-46ca-8b9d-9e4120f20af7 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:29.382688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfd461-57b9-46ca-8b9d-9e4120f20af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:29.447720 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-61bfd461-57b9-46ca-8b9d-9e4120f20af7 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:43:29.448925 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-61bfd461-57b9-46ca-8b9d-9e4120f20af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:29.546043 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 677/1339] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:43:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:43:29.582442 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d558a1-f527-43a5-b43d-552347701714 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:29.584063 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-50d558a1-f527-43a5-b43d-552347701714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:29.662127 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:29.691903 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d558a1-f527-43a5-b43d-552347701714 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:29.765164 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491b529-d0e7-42af-a0c6-ed9e454419ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:29.765799 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491b529-d0e7-42af-a0c6-ed9e454419ad service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:29.766080 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491b529-d0e7-42af-a0c6-ed9e454419ad service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:29.766353 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491b529-d0e7-42af-a0c6-ed9e454419ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:29.767969 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-3491b529-d0e7-42af-a0c6-ed9e454419ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:29.874219 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3491b529-d0e7-42af-a0c6-ed9e454419ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:29.875565 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3491b529-d0e7-42af-a0c6-ed9e454419ad service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:29.894783 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 663/1340] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:43:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:43:33.927546 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286ee9d-d5c9-4377-be9c-06e94c7f5692 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:33.928099 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286ee9d-d5c9-4377-be9c-06e94c7f5692 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:33.928099 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286ee9d-d5c9-4377-be9c-06e94c7f5692 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:33.930208 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 678/1341] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:43:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:43:33.935760 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ea69e-acf6-4b77-9da1-890bb061e704 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:33.936215 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ea69e-acf6-4b77-9da1-890bb061e704 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:33.936332 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ea69e-acf6-4b77-9da1-890bb061e704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:33.942309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:34.004694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-c10ea69e-acf6-4b77-9da1-890bb061e704 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:43:34.005952 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-c10ea69e-acf6-4b77-9da1-890bb061e704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:34.103069 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 664/1342] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:43:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:43:34.142402 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286ee9d-d5c9-4377-be9c-06e94c7f5692 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:34.143960 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-6286ee9d-d5c9-4377-be9c-06e94c7f5692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:34.192547 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:34.248971 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286ee9d-d5c9-4377-be9c-06e94c7f5692 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:34.324913 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecd12a-369e-4b02-9527-edc782178380 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:34.325557 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecd12a-369e-4b02-9527-edc782178380 service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:34.325842 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecd12a-369e-4b02-9527-edc782178380 service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:34.326118 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecd12a-369e-4b02-9527-edc782178380 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:34.327760 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-f3ecd12a-369e-4b02-9527-edc782178380 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:34.422631 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:34.439741 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ecd12a-369e-4b02-9527-edc782178380 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:34.441187 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ecd12a-369e-4b02-9527-edc782178380 service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:34.460149 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 679/1343] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:43:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:43:37.073221 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e73b40-0605-4798-a1fd-ffffa9c926c9 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:37.073787 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e73b40-0605-4798-a1fd-ffffa9c926c9 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:37.073878 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e73b40-0605-4798-a1fd-ffffa9c926c9 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:37.075234 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 665/1344] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:43:37.080997 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9859c-3c8d-4a5a-8cc5-e960031f43b8 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:37.081644 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9859c-3c8d-4a5a-8cc5-e960031f43b8 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:37.081644 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9859c-3c8d-4a5a-8cc5-e960031f43b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:37.155883 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-3ad9859c-3c8d-4a5a-8cc5-e960031f43b8 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:43:37.157107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-3ad9859c-3c8d-4a5a-8cc5-e960031f43b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:37.262078 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 680/1345] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:43:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:43:37.301009 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e73b40-0605-4798-a1fd-ffffa9c926c9 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:37.302681 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-a4e73b40-0605-4798-a1fd-ffffa9c926c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:37.391347 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:37.410643 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e73b40-0605-4798-a1fd-ffffa9c926c9 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:37.489462 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a4dd4-11e9-4534-879d-35b70a13c772 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:37.490232 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a4dd4-11e9-4534-879d-35b70a13c772 service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:37.490520 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a4dd4-11e9-4534-879d-35b70a13c772 service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:37.491345 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a4dd4-11e9-4534-879d-35b70a13c772 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:37.493159 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-884a4dd4-11e9-4534-879d-35b70a13c772 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:37.611848 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a4dd4-11e9-4534-879d-35b70a13c772 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:37.613398 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a4dd4-11e9-4534-879d-35b70a13c772 service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:37.638348 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 666/1346] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:43:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:43:41.700491 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fd299-abbb-4105-a9c3-cc09e0949e52 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:41.701099 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fd299-abbb-4105-a9c3-cc09e0949e52 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:41.701099 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fd299-abbb-4105-a9c3-cc09e0949e52 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:41.702477 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 681/1347] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:43:41.707739 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87cb37-15d4-4b7b-af4b-a4308bfdc49e None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:41.708182 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87cb37-15d4-4b7b-af4b-a4308bfdc49e None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:41.708279 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87cb37-15d4-4b7b-af4b-a4308bfdc49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:41.724716 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:41.779777 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-cf87cb37-15d4-4b7b-af4b-a4308bfdc49e None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:43:41.780948 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-cf87cb37-15d4-4b7b-af4b-a4308bfdc49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:41.903867 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 667/1348] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:43:41.942458 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258fd299-abbb-4105-a9c3-cc09e0949e52 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:41.945298 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-258fd299-abbb-4105-a9c3-cc09e0949e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:42.007463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:42.057518 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258fd299-abbb-4105-a9c3-cc09e0949e52 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:42.135624 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bb531-96b6-4c2b-9f60-0ad5bde31a76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:42.136250 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bb531-96b6-4c2b-9f60-0ad5bde31a76 service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:42.136531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bb531-96b6-4c2b-9f60-0ad5bde31a76 service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:42.136811 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bb531-96b6-4c2b-9f60-0ad5bde31a76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:42.138528 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-564bb531-96b6-4c2b-9f60-0ad5bde31a76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:42.268600 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564bb531-96b6-4c2b-9f60-0ad5bde31a76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:42.269543 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:42.270849 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564bb531-96b6-4c2b-9f60-0ad5bde31a76 service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:42.291349 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 682/1349] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:43:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:43:47.262411 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3064517-97be-4bbb-93a1-ce80d71ae4c7 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:47.263321 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3064517-97be-4bbb-93a1-ce80d71ae4c7 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:47.263824 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3064517-97be-4bbb-93a1-ce80d71ae4c7 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:47.265702 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 668/1350] 10.222.0.46 () {54 vars in 921 bytes} [Wed Aug 3 12:43:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:43:47.271014 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b066e0-11f0-4ecc-bd87-c139da6ce64d None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:47.271881 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b066e0-11f0-4ecc-bd87-c139da6ce64d None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:47.272368 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b066e0-11f0-4ecc-bd87-c139da6ce64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:47.404283 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-14b066e0-11f0-4ecc-bd87-c139da6ce64d None None] MFA Rules not processed for user `a56847173abb48d39c0ee6fb9cdbbbaa`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:43:47.405524 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-14b066e0-11f0-4ecc-bd87-c139da6ce64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:47.530012 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 683/1351] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Aug 3 12:43:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:43:51.728591 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658dd8b4-44ef-411d-8198-48ee1ea1d5a2 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:51.729152 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658dd8b4-44ef-411d-8198-48ee1ea1d5a2 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:51.729152 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658dd8b4-44ef-411d-8198-48ee1ea1d5a2 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:51.730701 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 669/1352] 10.222.0.46 () {54 vars in 921 bytes} [Wed Aug 3 12:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:43:51.735757 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4f1d2-426e-4278-81de-9af632b90f54 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:51.736511 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4f1d2-426e-4278-81de-9af632b90f54 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:51.737064 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4f1d2-426e-4278-81de-9af632b90f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:51.798264 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:51.827127 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-97d4f1d2-426e-4278-81de-9af632b90f54 None None] MFA Rules not processed for user `a56847173abb48d39c0ee6fb9cdbbbaa`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:43:51.828714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-97d4f1d2-426e-4278-81de-9af632b90f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:51.901697 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=59 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:51.957337 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 684/1353] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Aug 3 12:43:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:43:53.206537 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c615c5-3a4a-441b-8918-6e2561017fc2 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:53.207052 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c615c5-3a4a-441b-8918-6e2561017fc2 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:53.207052 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c615c5-3a4a-441b-8918-6e2561017fc2 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:53.208426 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 670/1354] 10.222.0.46 () {54 vars in 921 bytes} [Wed Aug 3 12:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:43:53.214280 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80495f-ab1f-4eae-83d5-c92b49ad4c21 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:53.214821 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80495f-ab1f-4eae-83d5-c92b49ad4c21 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:53.214917 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80495f-ab1f-4eae-83d5-c92b49ad4c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:53.295686 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-ae80495f-ab1f-4eae-83d5-c92b49ad4c21 None None] MFA Rules not processed for user `a56847173abb48d39c0ee6fb9cdbbbaa`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:43:53.296907 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-ae80495f-ab1f-4eae-83d5-c92b49ad4c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:53.341103 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:53.406195 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 685/1355] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Aug 3 12:43:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:43:56.853132 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ba4b7-9552-4349-9857-4a34c16552d8 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:56.853668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ba4b7-9552-4349-9857-4a34c16552d8 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:56.855446 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ba4b7-9552-4349-9857-4a34c16552d8 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:56.857098 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 671/1356] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:43:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:43:56.863202 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62414863-6283-490a-94b0-4f1421fe09e5 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:56.863658 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62414863-6283-490a-94b0-4f1421fe09e5 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:56.863759 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62414863-6283-490a-94b0-4f1421fe09e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:56.944384 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-62414863-6283-490a-94b0-4f1421fe09e5 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:43:56.945968 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-62414863-6283-490a-94b0-4f1421fe09e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:57.059886 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 686/1357] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:43:57.110269 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474ece0-3b09-4ce2-a7a9-60786f303ec2 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:57.111029 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474ece0-3b09-4ce2-a7a9-60786f303ec2 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:57.111532 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474ece0-3b09-4ce2-a7a9-60786f303ec2 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:57.113516 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 672/1358] 10.222.0.46 () {54 vars in 962 bytes} [Wed Aug 3 12:43:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:43:57.123827 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c2ddb-91eb-46d3-ad87-b0b9ce546213 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:57.124473 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c2ddb-91eb-46d3-ad87-b0b9ce546213 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:57.124969 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c2ddb-91eb-46d3-ad87-b0b9ce546213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:57.145296 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:57.213182 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-b17c2ddb-91eb-46d3-ad87-b0b9ce546213 None None] MFA Rules not processed for user `dcf670ff4f62486dbf70cf6ea0f08bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:43:57.214423 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-b17c2ddb-91eb-46d3-ad87-b0b9ce546213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:57.345190 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 687/1359] 10.222.0.46 () {58 vars in 1059 bytes} [Wed Aug 3 12:43:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:43:57.353081 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474ece0-3b09-4ce2-a7a9-60786f303ec2 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:43:57.354628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-0474ece0-3b09-4ce2-a7a9-60786f303ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:57.510207 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474ece0-3b09-4ce2-a7a9-60786f303ec2 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:43:57.592990 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:43:57.649438 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50cec3-d2fe-41d9-8713-cb19f1410267 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:43:57.650014 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50cec3-d2fe-41d9-8713-cb19f1410267 service nova] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:57.650296 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50cec3-d2fe-41d9-8713-cb19f1410267 service nova] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:57.650573 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50cec3-d2fe-41d9-8713-cb19f1410267 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:57.652228 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-7c50cec3-d2fe-41d9-8713-cb19f1410267 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:43:57.750371 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50cec3-d2fe-41d9-8713-cb19f1410267 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:43:57.751978 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50cec3-d2fe-41d9-8713-cb19f1410267 service nova] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:43:57.772539 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 673/1360] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:43:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:43:59.985772 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9d0fd-c735-4f32-b3c5-6e68d73b0cf5 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:59.986348 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9d0fd-c735-4f32-b3c5-6e68d73b0cf5 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:59.986348 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9d0fd-c735-4f32-b3c5-6e68d73b0cf5 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:43:59.987723 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 688/1361] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:43:59.993447 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b85f86-5b27-45e6-88f7-ef60b2d10a35 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:43:59.993941 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b85f86-5b27-45e6-88f7-ef60b2d10a35 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:43:59.994135 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b85f86-5b27-45e6-88f7-ef60b2d10a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:00.066360 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-a7b85f86-5b27-45e6-88f7-ef60b2d10a35 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:44:00.067561 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-a7b85f86-5b27-45e6-88f7-ef60b2d10a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:00.111790 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:00.176739 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 674/1362] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:44:00.221426 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9d0fd-c735-4f32-b3c5-6e68d73b0cf5 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:00.223580 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-c0d9d0fd-c735-4f32-b3c5-6e68d73b0cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:00.312605 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:00.416339 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9d0fd-c735-4f32-b3c5-6e68d73b0cf5 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:00.562084 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba47557-1118-45e1-898b-b3d61677e655 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:00.562887 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba47557-1118-45e1-898b-b3d61677e655 service nova] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:00.563255 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba47557-1118-45e1-898b-b3d61677e655 service nova] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:00.563597 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba47557-1118-45e1-898b-b3d61677e655 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:00.565854 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-3ba47557-1118-45e1-898b-b3d61677e655 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:00.592012 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:00.662776 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba47557-1118-45e1-898b-b3d61677e655 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:00.664475 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba47557-1118-45e1-898b-b3d61677e655 service nova] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:00.683743 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 689/1363] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:44:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:44:03.028523 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9bfd9-0be8-48c8-9a20-c1b55882969f None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:03.029080 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9bfd9-0be8-48c8-9a20-c1b55882969f None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:03.029080 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9bfd9-0be8-48c8-9a20-c1b55882969f None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:03.030460 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 675/1364] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:44:03.035685 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602afa97-8940-46e6-9917-316dedd82a25 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:03.036119 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602afa97-8940-46e6-9917-316dedd82a25 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:03.036231 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602afa97-8940-46e6-9917-316dedd82a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:03.121212 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-602afa97-8940-46e6-9917-316dedd82a25 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:44:03.122567 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-602afa97-8940-46e6-9917-316dedd82a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:03.227128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:03.245870 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 690/1365] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:44:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:44:03.282948 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab11444-5c8b-432f-9fe4-ff88b36e8e66 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:03.283542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab11444-5c8b-432f-9fe4-ff88b36e8e66 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:03.284667 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab11444-5c8b-432f-9fe4-ff88b36e8e66 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:03.286734 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 676/1366] 10.222.0.46 () {54 vars in 962 bytes} [Wed Aug 3 12:44:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:44:03.292902 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9246b7d-4c0a-4596-87fb-db508560a32a None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:03.293189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9246b7d-4c0a-4596-87fb-db508560a32a None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:03.293463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9246b7d-4c0a-4596-87fb-db508560a32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:03.372883 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-e9246b7d-4c0a-4596-87fb-db508560a32a None None] MFA Rules not processed for user `dcf670ff4f62486dbf70cf6ea0f08bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:44:03.374118 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-e9246b7d-4c0a-4596-87fb-db508560a32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:03.501653 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 691/1367] 10.222.0.46 () {58 vars in 1059 bytes} [Wed Aug 3 12:44:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:44:03.509396 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab11444-5c8b-432f-9fe4-ff88b36e8e66 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:03.510973 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-6ab11444-5c8b-432f-9fe4-ff88b36e8e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:03.672199 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab11444-5c8b-432f-9fe4-ff88b36e8e66 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:03.693877 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:03.791533 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e051b3-7043-4112-92b2-11cefb4c00f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:03.792067 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e051b3-7043-4112-92b2-11cefb4c00f7 service nova] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:03.792344 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e051b3-7043-4112-92b2-11cefb4c00f7 service nova] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:03.792614 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e051b3-7043-4112-92b2-11cefb4c00f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:03.794282 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-28e051b3-7043-4112-92b2-11cefb4c00f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:03.890023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e051b3-7043-4112-92b2-11cefb4c00f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:03.891602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e051b3-7043-4112-92b2-11cefb4c00f7 service nova] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:03.910457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 677/1368] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:44:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:44:04.952884 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d500d-b64c-4ab9-a399-816a921477d9 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:04.953410 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d500d-b64c-4ab9-a399-816a921477d9 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:04.954116 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d500d-b64c-4ab9-a399-816a921477d9 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:04.956066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 692/1369] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:44:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:44:04.961688 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ccbac2-70bf-4812-b10e-653df403962c None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:04.962137 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ccbac2-70bf-4812-b10e-653df403962c None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:04.962353 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ccbac2-70bf-4812-b10e-653df403962c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:04.997451 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:05.033314 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-a2ccbac2-70bf-4812-b10e-653df403962c None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:44:05.034754 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-a2ccbac2-70bf-4812-b10e-653df403962c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:05.150750 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 678/1370] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:44:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:44:05.493739 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0eef4-5be4-45a5-8861-4fcbc36d7e0f None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:05.493739 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0eef4-5be4-45a5-8861-4fcbc36d7e0f None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:05.493739 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0eef4-5be4-45a5-8861-4fcbc36d7e0f None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:05.496297 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 693/1371] 10.222.0.46 () {54 vars in 964 bytes} [Wed Aug 3 12:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:44:05.500577 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366e202-4828-40ec-925d-447b64835a44 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:05.500874 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366e202-4828-40ec-925d-447b64835a44 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:05.501156 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366e202-4828-40ec-925d-447b64835a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:05.582883 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-8366e202-4828-40ec-925d-447b64835a44 None None] MFA Rules not processed for user `603adceaefb94e218cc1e683529a60b5`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:44:05.584572 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-8366e202-4828-40ec-925d-447b64835a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:05.634405 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:05.667580 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 679/1372] 10.222.0.46 () {58 vars in 1061 bytes} [Wed Aug 3 12:44:05 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:44:05.675137 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0eef4-5be4-45a5-8861-4fcbc36d7e0f None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:05.676706 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-4fc0eef4-5be4-45a5-8861-4fcbc36d7e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:05.730701 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:05.788305 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0eef4-5be4-45a5-8861-4fcbc36d7e0f None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:05.872246 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282cf422-c0bc-4c8d-881d-5e3fc857c0c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:05.872789 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282cf422-c0bc-4c8d-881d-5e3fc857c0c9 service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:05.873074 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282cf422-c0bc-4c8d-881d-5e3fc857c0c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:05.873346 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282cf422-c0bc-4c8d-881d-5e3fc857c0c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:05.875024 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-282cf422-c0bc-4c8d-881d-5e3fc857c0c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:05.978845 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:05.995500 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282cf422-c0bc-4c8d-881d-5e3fc857c0c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:05.995981 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9edb44-c111-4469-a67e-5fd69d22bf19 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:05.996449 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282cf422-c0bc-4c8d-881d-5e3fc857c0c9 service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:05.996544 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9edb44-c111-4469-a67e-5fd69d22bf19 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:05.996544 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9edb44-c111-4469-a67e-5fd69d22bf19 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:05.998079 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 680/1373] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:44:06.003355 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9f104-cebb-4a75-8433-39e169dbe6ba None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:06.003640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9f104-cebb-4a75-8433-39e169dbe6ba None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:06.003917 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9f104-cebb-4a75-8433-39e169dbe6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:06.016328 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 694/1374] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:44:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:44:06.077987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-23b9f104-cebb-4a75-8433-39e169dbe6ba None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:44:06.079135 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-23b9f104-cebb-4a75-8433-39e169dbe6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:06.197832 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 681/1375] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:44:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:44:06.237417 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282cf422-c0bc-4c8d-881d-5e3fc857c0c9 service cinder] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:06.237417 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-282cf422-c0bc-4c8d-881d-5e3fc857c0c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:06.372077 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282cf422-c0bc-4c8d-881d-5e3fc857c0c9 service cinder] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:06.479717 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:06.491971 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbe482-aad8-4bf1-86ef-5851a8c6924e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:06.492593 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbe482-aad8-4bf1-86ef-5851a8c6924e service nova] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:06.492876 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbe482-aad8-4bf1-86ef-5851a8c6924e service nova] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:06.493155 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbe482-aad8-4bf1-86ef-5851a8c6924e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:06.494818 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-1ebbe482-aad8-4bf1-86ef-5851a8c6924e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:06.585971 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbe482-aad8-4bf1-86ef-5851a8c6924e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:06.587594 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbe482-aad8-4bf1-86ef-5851a8c6924e service nova] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:06.606001 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 695/1376] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:44:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:44:08.617993 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb91f12-f8b4-409b-8ff4-b2e3be8e7129 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:08.618480 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb91f12-f8b4-409b-8ff4-b2e3be8e7129 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:08.618572 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb91f12-f8b4-409b-8ff4-b2e3be8e7129 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:08.620011 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 682/1377] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:44:08.625885 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a436fc4-401d-497a-8fdd-96844de723b3 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:08.626299 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a436fc4-401d-497a-8fdd-96844de723b3 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:08.626409 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a436fc4-401d-497a-8fdd-96844de723b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:08.692666 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-2a436fc4-401d-497a-8fdd-96844de723b3 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:44:08.694560 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-2a436fc4-401d-497a-8fdd-96844de723b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:08.753298 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:08.797028 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 696/1378] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:44:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:44:08.843494 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb91f12-f8b4-409b-8ff4-b2e3be8e7129 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:08.845139 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-7fb91f12-f8b4-409b-8ff4-b2e3be8e7129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:08.899531 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:09.127968 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb91f12-f8b4-409b-8ff4-b2e3be8e7129 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:09.242673 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15488231-ac75-42f9-94ab-c0c7b654155c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:09.243294 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15488231-ac75-42f9-94ab-c0c7b654155c service nova] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:09.243578 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15488231-ac75-42f9-94ab-c0c7b654155c service nova] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:09.243850 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15488231-ac75-42f9-94ab-c0c7b654155c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:09.245484 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-15488231-ac75-42f9-94ab-c0c7b654155c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:09.257220 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:09.344852 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15488231-ac75-42f9-94ab-c0c7b654155c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:09.346489 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15488231-ac75-42f9-94ab-c0c7b654155c service nova] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:09.365308 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 683/1379] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:44:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:44:11.439978 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc3f80-7c0f-4f1d-8352-de0bea880c41 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:11.440512 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc3f80-7c0f-4f1d-8352-de0bea880c41 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:11.440512 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc3f80-7c0f-4f1d-8352-de0bea880c41 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:11.442081 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 697/1380] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:44:11.447840 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0d68d-1986-4145-af98-3f3862e60173 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:11.448263 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0d68d-1986-4145-af98-3f3862e60173 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:11.448439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0d68d-1986-4145-af98-3f3862e60173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:11.519997 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-b5d0d68d-1986-4145-af98-3f3862e60173 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:44:11.521138 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-b5d0d68d-1986-4145-af98-3f3862e60173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:11.621546 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:11.641622 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 684/1381] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:44:11.682574 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc3f80-7c0f-4f1d-8352-de0bea880c41 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:11.684098 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-cafc3f80-7c0f-4f1d-8352-de0bea880c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:11.843071 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc3f80-7c0f-4f1d-8352-de0bea880c41 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:11.909848 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:11.986042 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb02cf-9657-40db-9875-e95a85191df4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:11.986996 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb02cf-9657-40db-9875-e95a85191df4 service nova] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:11.987348 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb02cf-9657-40db-9875-e95a85191df4 service nova] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:11.987707 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb02cf-9657-40db-9875-e95a85191df4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:11.989409 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-e2fb02cf-9657-40db-9875-e95a85191df4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:12.091249 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb02cf-9657-40db-9875-e95a85191df4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:12.092863 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb02cf-9657-40db-9875-e95a85191df4 service nova] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:12.113126 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 698/1382] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:44:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:44:14.165944 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537f18a-c208-4b05-a2aa-f2bdff61c8f0 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:14.166486 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537f18a-c208-4b05-a2aa-f2bdff61c8f0 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:14.166643 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537f18a-c208-4b05-a2aa-f2bdff61c8f0 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:14.168477 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 685/1383] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:44:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:44:14.174934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a10e1-2685-4f48-ad58-5c0b3c0411d1 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:14.175367 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a10e1-2685-4f48-ad58-5c0b3c0411d1 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:14.175489 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a10e1-2685-4f48-ad58-5c0b3c0411d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:14.256453 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-4a5a10e1-2685-4f48-ad58-5c0b3c0411d1 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:44:14.258071 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-4a5a10e1-2685-4f48-ad58-5c0b3c0411d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:14.260699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:14.363228 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 699/1384] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:44:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:44:14.414065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537f18a-c208-4b05-a2aa-f2bdff61c8f0 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:14.415582 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-3537f18a-c208-4b05-a2aa-f2bdff61c8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:14.567348 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537f18a-c208-4b05-a2aa-f2bdff61c8f0 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:14.642053 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:14.694380 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92344f5-6f82-4fac-b6fe-fbd306d9b143 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:14.695002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92344f5-6f82-4fac-b6fe-fbd306d9b143 service nova] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:14.695279 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92344f5-6f82-4fac-b6fe-fbd306d9b143 service nova] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:14.695541 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92344f5-6f82-4fac-b6fe-fbd306d9b143 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:14.697168 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-d92344f5-6f82-4fac-b6fe-fbd306d9b143 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:14.787415 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92344f5-6f82-4fac-b6fe-fbd306d9b143 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:14.789008 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92344f5-6f82-4fac-b6fe-fbd306d9b143 service nova] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:14.807276 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 686/1385] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:44:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:44:17.346984 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac1242-9450-4aa8-bcf6-972e1aaef953 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:17.347554 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac1242-9450-4aa8-bcf6-972e1aaef953 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:17.347554 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac1242-9450-4aa8-bcf6-972e1aaef953 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:17.348941 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 700/1386] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:44:17.354357 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43b3ba-a915-41ca-a14f-68942828c8b1 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:17.354812 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43b3ba-a915-41ca-a14f-68942828c8b1 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:17.354985 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43b3ba-a915-41ca-a14f-68942828c8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:17.426889 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-ee43b3ba-a915-41ca-a14f-68942828c8b1 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:44:17.428961 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-ee43b3ba-a915-41ca-a14f-68942828c8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:17.461338 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:17.545643 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 687/1387] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:44:17.596012 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac1242-9450-4aa8-bcf6-972e1aaef953 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:17.597627 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-b3ac1242-9450-4aa8-bcf6-972e1aaef953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:17.738610 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:17.759243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac1242-9450-4aa8-bcf6-972e1aaef953 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:17.887443 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da2075-ec3d-4299-8835-12906e9d2db5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:17.888159 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da2075-ec3d-4299-8835-12906e9d2db5 service nova] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:17.888506 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da2075-ec3d-4299-8835-12906e9d2db5 service nova] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:17.888842 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da2075-ec3d-4299-8835-12906e9d2db5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:17.890930 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-38da2075-ec3d-4299-8835-12906e9d2db5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:17.993519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da2075-ec3d-4299-8835-12906e9d2db5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:17.995141 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da2075-ec3d-4299-8835-12906e9d2db5 service nova] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:18.000587 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:18.014519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 701/1388] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:44:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:44:20.048160 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21547ce4-9abe-4635-a350-5e5b4ec05a9e None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:20.048723 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21547ce4-9abe-4635-a350-5e5b4ec05a9e None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:20.048723 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21547ce4-9abe-4635-a350-5e5b4ec05a9e None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:20.050080 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 688/1389] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:44:20.055589 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1b51f-574b-4fb1-83fa-a1acfee5da5b None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:20.056041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1b51f-574b-4fb1-83fa-a1acfee5da5b None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:20.056138 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1b51f-574b-4fb1-83fa-a1acfee5da5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:20.122319 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-45f1b51f-574b-4fb1-83fa-a1acfee5da5b None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:44:20.123520 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-45f1b51f-574b-4fb1-83fa-a1acfee5da5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:20.221942 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 702/1390] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:44:20.265985 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21547ce4-9abe-4635-a350-5e5b4ec05a9e None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:20.269527 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-21547ce4-9abe-4635-a350-5e5b4ec05a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:20.416092 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21547ce4-9abe-4635-a350-5e5b4ec05a9e None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:20.425005 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:20.529885 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbb311-aab5-41c5-ac33-67666e40405d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:20.530508 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbb311-aab5-41c5-ac33-67666e40405d service nova] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:20.530787 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbb311-aab5-41c5-ac33-67666e40405d service nova] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:20.531061 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbb311-aab5-41c5-ac33-67666e40405d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:20.532673 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-e3bbb311-aab5-41c5-ac33-67666e40405d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:20.624290 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bbb311-aab5-41c5-ac33-67666e40405d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:20.625917 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bbb311-aab5-41c5-ac33-67666e40405d service nova] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:20.644241 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 689/1391] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:44:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:44:21.036173 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff515fa9-7beb-49da-b7b2-22835daa41eb None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:21.036477 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff515fa9-7beb-49da-b7b2-22835daa41eb None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:21.037283 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff515fa9-7beb-49da-b7b2-22835daa41eb None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:21.038690 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 703/1392] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:44:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:44:21.043996 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e234a97-4ed1-4ebf-b74c-be01057e0ba4 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:21.044285 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e234a97-4ed1-4ebf-b74c-be01057e0ba4 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:21.044587 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e234a97-4ed1-4ebf-b74c-be01057e0ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:21.061141 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:21.112462 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-3e234a97-4ed1-4ebf-b74c-be01057e0ba4 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:44:21.113704 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-3e234a97-4ed1-4ebf-b74c-be01057e0ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:21.211413 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 690/1393] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:44:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:44:21.267519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed067a7-05be-4a5f-b3fc-4ddb99e8a0f7 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:21.267519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed067a7-05be-4a5f-b3fc-4ddb99e8a0f7 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:21.267519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed067a7-05be-4a5f-b3fc-4ddb99e8a0f7 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:21.268791 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 704/1394] 10.222.0.46 () {54 vars in 966 bytes} [Wed Aug 3 12:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:44:21.277306 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d16a8-7163-44a8-9db4-6c7d88df9a26 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:21.277848 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d16a8-7163-44a8-9db4-6c7d88df9a26 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:21.278125 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d16a8-7163-44a8-9db4-6c7d88df9a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:21.358551 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-786d16a8-7163-44a8-9db4-6c7d88df9a26 None None] MFA Rules not processed for user `a2f23f4936684b63afc095986e43ec37`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:44:21.359758 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-786d16a8-7163-44a8-9db4-6c7d88df9a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:21.394627 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:21.437799 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 691/1395] 10.222.0.46 () {58 vars in 1063 bytes} [Wed Aug 3 12:44:21 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:44:21.445893 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed067a7-05be-4a5f-b3fc-4ddb99e8a0f7 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:21.447465 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-7ed067a7-05be-4a5f-b3fc-4ddb99e8a0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:21.520272 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:21.554885 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed067a7-05be-4a5f-b3fc-4ddb99e8a0f7 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:21.627080 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a3162-1770-4741-a60c-0b233484c252 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2f23f4936684b63afc095986e43ec37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:21.627696 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a3162-1770-4741-a60c-0b233484c252 service glance] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:21.627979 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a3162-1770-4741-a60c-0b233484c252 service glance] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:21.628251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a3162-1770-4741-a60c-0b233484c252 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:21.629905 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-7a3a3162-1770-4741-a60c-0b233484c252 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:21.739692 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a3162-1770-4741-a60c-0b233484c252 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:21.741844 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a3162-1770-4741-a60c-0b233484c252 service glance] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:21.758021 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:21.763255 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 705/1396] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:44:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:44:22.498495 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5b5ae-f685-4e07-8df3-a50247d198dd None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:22.498987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5b5ae-f685-4e07-8df3-a50247d198dd None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:22.499084 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5b5ae-f685-4e07-8df3-a50247d198dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:22.565747 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-cbb5b5ae-f685-4e07-8df3-a50247d198dd None None] MFA Rules not processed for user `a994c976b95744ed9723bf9c4386bde1`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:44:22.566971 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-cbb5b5ae-f685-4e07-8df3-a50247d198dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:22.652986 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 692/1397] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Aug 3 12:44:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:44:22.697453 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143bb7d-4b7f-44ed-9f6f-4cb533697248 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:22.697987 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143bb7d-4b7f-44ed-9f6f-4cb533697248 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:22.698078 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143bb7d-4b7f-44ed-9f6f-4cb533697248 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:22.699458 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 706/1398] 10.222.0.46 () {54 vars in 943 bytes} [Wed Aug 3 12:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:44:22.705029 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2206b-b060-4adc-85a7-c760602ac1de None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:22.705320 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2206b-b060-4adc-85a7-c760602ac1de None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:22.705452 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753ec1d-3851-47ba-a9d0-d4bedc083fc3 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:22.705635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2206b-b060-4adc-85a7-c760602ac1de None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:22.705773 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753ec1d-3851-47ba-a9d0-d4bedc083fc3 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:22.706027 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753ec1d-3851-47ba-a9d0-d4bedc083fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:22.707006 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 693/1399] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:44:22.712067 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e77ce-99b4-46b5-87c3-c039272e314c None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:22.712353 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e77ce-99b4-46b5-87c3-c039272e314c None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:22.712631 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e77ce-99b4-46b5-87c3-c039272e314c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:22.778848 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:22.781975 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-ad6e77ce-99b4-46b5-87c3-c039272e314c None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:44:22.783596 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-d753ec1d-3851-47ba-a9d0-d4bedc083fc3 None None] MFA Rules not processed for user `67df369737ea4c83bae134f4bf2de20d`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:44:22.783763 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-ad6e77ce-99b4-46b5-87c3-c039272e314c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:22.784780 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-d753ec1d-3851-47ba-a9d0-d4bedc083fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:22.883807 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 694/1400] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:44:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:44:22.893300 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 707/1401] 10.222.0.46 () {58 vars in 1040 bytes} [Wed Aug 3 12:44:22 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:44:22.903012 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e77ce-99b4-46b5-87c3-c039272e314c None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:22.904209 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-ad6e77ce-99b4-46b5-87c3-c039272e314c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:22.928554 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753ec1d-3851-47ba-a9d0-d4bedc083fc3 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:22.929781 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-d753ec1d-3851-47ba-a9d0-d4bedc083fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:22.992908 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:23.016209 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e77ce-99b4-46b5-87c3-c039272e314c None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:23.037089 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753ec1d-3851-47ba-a9d0-d4bedc083fc3 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:23.047434 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:23.125846 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe59fd-0fdc-4918-b155-101f8d6df1b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67df369737ea4c83bae134f4bf2de20d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:23.126467 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe59fd-0fdc-4918-b155-101f8d6df1b3 service swift] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:23.126767 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe59fd-0fdc-4918-b155-101f8d6df1b3 service swift] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:23.127020 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe59fd-0fdc-4918-b155-101f8d6df1b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:23.128728 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-35fe59fd-0fdc-4918-b155-101f8d6df1b3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:23.159216 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8d53d-431d-4567-bf9a-45e3059e2043 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:23.159841 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8d53d-431d-4567-bf9a-45e3059e2043 service nova] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:23.160122 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8d53d-431d-4567-bf9a-45e3059e2043 service nova] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:23.160401 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8d53d-431d-4567-bf9a-45e3059e2043 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:23.162103 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-65a8d53d-431d-4567-bf9a-45e3059e2043 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:23.211795 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe59fd-0fdc-4918-b155-101f8d6df1b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:23.213384 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe59fd-0fdc-4918-b155-101f8d6df1b3 service swift] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:23.221361 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 695/1402] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Aug 3 12:44:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 12:44:23.260953 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:23.286217 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a8d53d-431d-4567-bf9a-45e3059e2043 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:23.288875 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a8d53d-431d-4567-bf9a-45e3059e2043 service nova] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:23.308609 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 708/1403] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:44:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:44:25.345175 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85870191-fff1-47d9-a11a-43a688debe82 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:25.345744 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85870191-fff1-47d9-a11a-43a688debe82 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:25.345744 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85870191-fff1-47d9-a11a-43a688debe82 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:25.347295 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 696/1404] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:44:25.353069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1f5e6-3cfb-45b1-bad4-adcd3a27b663 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:25.353537 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1f5e6-3cfb-45b1-bad4-adcd3a27b663 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:25.353723 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1f5e6-3cfb-45b1-bad4-adcd3a27b663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:25.437704 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-33a1f5e6-3cfb-45b1-bad4-adcd3a27b663 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:44:25.439048 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-33a1f5e6-3cfb-45b1-bad4-adcd3a27b663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:25.546341 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 709/1405] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:44:25.592506 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85870191-fff1-47d9-a11a-43a688debe82 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:25.595560 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-85870191-fff1-47d9-a11a-43a688debe82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:25.673153 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:25.776207 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85870191-fff1-47d9-a11a-43a688debe82 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:25.906607 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b98801-3a1d-4023-96eb-5351ba854b49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:25.907295 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b98801-3a1d-4023-96eb-5351ba854b49 service nova] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:25.907568 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b98801-3a1d-4023-96eb-5351ba854b49 service nova] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:25.907835 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b98801-3a1d-4023-96eb-5351ba854b49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:25.909456 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-12b98801-3a1d-4023-96eb-5351ba854b49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:25.934294 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:26.049334 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b98801-3a1d-4023-96eb-5351ba854b49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:26.050978 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b98801-3a1d-4023-96eb-5351ba854b49 service nova] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:26.069813 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 697/1406] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:44:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:44:28.143286 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27de7aa-87a0-460a-ad4d-7aa2796cc666 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:28.143894 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27de7aa-87a0-460a-ad4d-7aa2796cc666 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:28.143894 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27de7aa-87a0-460a-ad4d-7aa2796cc666 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:28.145328 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 710/1407] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:44:28.151316 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a1890-15bc-47fb-bb3c-21613ea34a99 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:28.151788 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a1890-15bc-47fb-bb3c-21613ea34a99 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:28.151887 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a1890-15bc-47fb-bb3c-21613ea34a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:28.223862 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-a26a1890-15bc-47fb-bb3c-21613ea34a99 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:44:28.225345 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-a26a1890-15bc-47fb-bb3c-21613ea34a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:28.334094 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:28.337887 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 698/1408] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:44:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:44:28.383319 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27de7aa-87a0-460a-ad4d-7aa2796cc666 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:28.385253 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-b27de7aa-87a0-460a-ad4d-7aa2796cc666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:28.441645 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:28.553967 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27de7aa-87a0-460a-ad4d-7aa2796cc666 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:28.679480 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad48c20-594f-4062-81e3-ce44b7992dd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:28.680398 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad48c20-594f-4062-81e3-ce44b7992dd4 service nova] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:28.680838 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad48c20-594f-4062-81e3-ce44b7992dd4 service nova] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:28.681347 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad48c20-594f-4062-81e3-ce44b7992dd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:28.683467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-cad48c20-594f-4062-81e3-ce44b7992dd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:28.693323 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:28.787369 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad48c20-594f-4062-81e3-ce44b7992dd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:28.789030 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad48c20-594f-4062-81e3-ce44b7992dd4 service nova] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:28.810046 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 711/1409] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:44:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:44:38.807703 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=41 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:45.535609 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57709f5-d346-444a-909d-97f4ec53bd2b None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:45.536829 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57709f5-d346-444a-909d-97f4ec53bd2b None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:45.536829 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57709f5-d346-444a-909d-97f4ec53bd2b None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:45.538458 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 699/1410] 10.222.0.46 () {54 vars in 918 bytes} [Wed Aug 3 12:44:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:44:45.543775 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56232fdf-6a56-4177-abb0-b4195cc787b3 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:45.544200 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56232fdf-6a56-4177-abb0-b4195cc787b3 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:45.544302 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56232fdf-6a56-4177-abb0-b4195cc787b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:45.618459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-56232fdf-6a56-4177-abb0-b4195cc787b3 None None] MFA Rules not processed for user `a56847173abb48d39c0ee6fb9cdbbbaa`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:44:45.619580 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-56232fdf-6a56-4177-abb0-b4195cc787b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:45.725296 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 712/1411] 10.222.0.46 () {58 vars in 1015 bytes} [Wed Aug 3 12:44:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:44:45.740177 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fcd2b-563c-4ded-9a1a-47c803bead1f None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:45.740550 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fcd2b-563c-4ded-9a1a-47c803bead1f None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:45.740834 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fcd2b-563c-4ded-9a1a-47c803bead1f None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:45.742613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 700/1412] 10.222.0.46 () {54 vars in 918 bytes} [Wed Aug 3 12:44:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:44:45.747420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e0af7-2486-4b8a-af00-de2692a732df None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:45.747711 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e0af7-2486-4b8a-af00-de2692a732df None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:45.747991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e0af7-2486-4b8a-af00-de2692a732df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:45.820311 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:45.823472 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-f89e0af7-2486-4b8a-af00-de2692a732df None None] MFA Rules not processed for user `dcf670ff4f62486dbf70cf6ea0f08bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:44:45.825287 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-f89e0af7-2486-4b8a-af00-de2692a732df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:45.940454 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 713/1413] 10.222.0.46 () {58 vars in 1015 bytes} [Wed Aug 3 12:44:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:44:48.427340 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4fcafd-3c16-4b25-9c0d-899c6dc64049 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:48.427905 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4fcafd-3c16-4b25-9c0d-899c6dc64049 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:48.427905 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4fcafd-3c16-4b25-9c0d-899c6dc64049 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:48.429238 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 701/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:44:48.434552 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dff4ed-53da-4229-b263-5cf4abfb03bf None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:48.434965 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dff4ed-53da-4229-b263-5cf4abfb03bf None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:48.435100 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dff4ed-53da-4229-b263-5cf4abfb03bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:48.500588 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-d5dff4ed-53da-4229-b263-5cf4abfb03bf None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:44:48.501833 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-d5dff4ed-53da-4229-b263-5cf4abfb03bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:48.557276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:48.602678 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 714/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:44:48.646106 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4fcafd-3c16-4b25-9c0d-899c6dc64049 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:48.647708 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-ee4fcafd-3c16-4b25-9c0d-899c6dc64049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:48.795435 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4fcafd-3c16-4b25-9c0d-899c6dc64049 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:48.868924 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:48.909053 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca02c39-78fc-425d-be97-abf12e16f539 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:48.909702 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca02c39-78fc-425d-be97-abf12e16f539 service nova] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:48.909992 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca02c39-78fc-425d-be97-abf12e16f539 service nova] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:48.910270 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca02c39-78fc-425d-be97-abf12e16f539 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:48.912632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-3ca02c39-78fc-425d-be97-abf12e16f539 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:49.001030 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca02c39-78fc-425d-be97-abf12e16f539 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:49.002640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca02c39-78fc-425d-be97-abf12e16f539 service nova] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:49.020478 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 702/1416] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:44:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:44:49.916746 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d7ef2-3cec-4957-9ced-8fd6ba942bff None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:49.917287 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d7ef2-3cec-4957-9ced-8fd6ba942bff None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:49.917287 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d7ef2-3cec-4957-9ced-8fd6ba942bff None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:49.918704 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 715/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 12:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:44:49.923791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30548e97-b433-4cfe-8676-f4245663acda None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:49.924191 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30548e97-b433-4cfe-8676-f4245663acda None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:49.924343 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30548e97-b433-4cfe-8676-f4245663acda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:50.002581 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-30548e97-b433-4cfe-8676-f4245663acda None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:44:50.004025 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-30548e97-b433-4cfe-8676-f4245663acda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:50.031476 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:50.100456 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 703/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 12:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:44:50.251254 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d7ef2-3cec-4957-9ced-8fd6ba942bff None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:50.252788 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-0f1d7ef2-3cec-4957-9ced-8fd6ba942bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:50.404076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d7ef2-3cec-4957-9ced-8fd6ba942bff None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:50.444459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:50.516063 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c2226-6bf1-4ace-9cea-63415c965d19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:50.516598 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c2226-6bf1-4ace-9cea-63415c965d19 service nova] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:50.516873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c2226-6bf1-4ace-9cea-63415c965d19 service nova] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:50.517143 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c2226-6bf1-4ace-9cea-63415c965d19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:50.518788 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-a19c2226-6bf1-4ace-9cea-63415c965d19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:50.605766 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c2226-6bf1-4ace-9cea-63415c965d19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:50.607374 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c2226-6bf1-4ace-9cea-63415c965d19 service nova] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:50.625118 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 716/1419] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:44:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:44:51.505910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582aea9a-c2b9-4734-8ca9-68d1533f6188 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:51.506431 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582aea9a-c2b9-4734-8ca9-68d1533f6188 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:51.506431 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582aea9a-c2b9-4734-8ca9-68d1533f6188 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:51.507853 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 704/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 12:44:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:44:51.512713 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf59533-a125-4d15-a7b8-287a259e5108 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:51.513157 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf59533-a125-4d15-a7b8-287a259e5108 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:51.513252 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf59533-a125-4d15-a7b8-287a259e5108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:51.568801 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:51.591085 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-0bf59533-a125-4d15-a7b8-287a259e5108 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:44:51.592298 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-0bf59533-a125-4d15-a7b8-287a259e5108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:51.688097 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 717/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 12:44:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:44:51.840223 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582aea9a-c2b9-4734-8ca9-68d1533f6188 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:51.841678 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-582aea9a-c2b9-4734-8ca9-68d1533f6188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:51.984350 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582aea9a-c2b9-4734-8ca9-68d1533f6188 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:51.997310 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:52.099022 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e9aba-aa9c-4b12-b491-7da98f08fd74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:52.099840 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e9aba-aa9c-4b12-b491-7da98f08fd74 service nova] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:52.100120 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e9aba-aa9c-4b12-b491-7da98f08fd74 service nova] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:52.100395 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e9aba-aa9c-4b12-b491-7da98f08fd74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:52.102093 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-a68e9aba-aa9c-4b12-b491-7da98f08fd74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:52.190526 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e9aba-aa9c-4b12-b491-7da98f08fd74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:52.192141 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e9aba-aa9c-4b12-b491-7da98f08fd74 service nova] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:52.210458 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 705/1422] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:44:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:44:53.074045 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37de3d3-81ee-4fbf-86fd-dddb12be6ffc None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:53.074512 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37de3d3-81ee-4fbf-86fd-dddb12be6ffc None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:53.074602 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37de3d3-81ee-4fbf-86fd-dddb12be6ffc None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:53.075940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 718/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 12:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:44:53.080723 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e1b03-6557-483f-af7a-621e10af05f8 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:53.081130 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e1b03-6557-483f-af7a-621e10af05f8 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:53.081287 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e1b03-6557-483f-af7a-621e10af05f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:53.100351 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:53.156964 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-8a2e1b03-6557-483f-af7a-621e10af05f8 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:44:53.158203 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-8a2e1b03-6557-483f-af7a-621e10af05f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:53.254555 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 706/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 12:44:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:44:53.406514 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37de3d3-81ee-4fbf-86fd-dddb12be6ffc None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:53.408018 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-c37de3d3-81ee-4fbf-86fd-dddb12be6ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:53.517462 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:53.554057 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37de3d3-81ee-4fbf-86fd-dddb12be6ffc None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:53.665838 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58df8a2-ee3e-4e57-8d7b-bced3424ffb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:53.666383 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58df8a2-ee3e-4e57-8d7b-bced3424ffb9 service nova] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:53.666667 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58df8a2-ee3e-4e57-8d7b-bced3424ffb9 service nova] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:53.666946 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58df8a2-ee3e-4e57-8d7b-bced3424ffb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:53.668588 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-b58df8a2-ee3e-4e57-8d7b-bced3424ffb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:53.745383 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:53.759819 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58df8a2-ee3e-4e57-8d7b-bced3424ffb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:53.761425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58df8a2-ee3e-4e57-8d7b-bced3424ffb9 service nova] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:53.779506 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 719/1425] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:44:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:44:54.638749 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a61ef-beb5-44a1-a0b9-c0bc919f1239 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:54.639262 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a61ef-beb5-44a1-a0b9-c0bc919f1239 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:54.639262 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a61ef-beb5-44a1-a0b9-c0bc919f1239 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:54.640942 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 707/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 12:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:44:54.646115 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8b53d-0485-4794-a15e-30eb580a1ba8 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:54.646517 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8b53d-0485-4794-a15e-30eb580a1ba8 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:54.646663 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8b53d-0485-4794-a15e-30eb580a1ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:54.722729 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-78f8b53d-0485-4794-a15e-30eb580a1ba8 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:44:54.724541 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-78f8b53d-0485-4794-a15e-30eb580a1ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:54.820359 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 720/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 12:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:44:54.972021 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a61ef-beb5-44a1-a0b9-c0bc919f1239 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:54.974195 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-3a9a61ef-beb5-44a1-a0b9-c0bc919f1239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:55.058857 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:55.120990 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a61ef-beb5-44a1-a0b9-c0bc919f1239 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:55.232698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85a0a3-00cc-4e2e-9bc9-916eb9591da2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:55.233234 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85a0a3-00cc-4e2e-9bc9-916eb9591da2 service nova] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:55.233531 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85a0a3-00cc-4e2e-9bc9-916eb9591da2 service nova] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:55.233809 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85a0a3-00cc-4e2e-9bc9-916eb9591da2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:55.235441 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-3e85a0a3-00cc-4e2e-9bc9-916eb9591da2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:55.284865 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:55.326666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85a0a3-00cc-4e2e-9bc9-916eb9591da2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:55.328269 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85a0a3-00cc-4e2e-9bc9-916eb9591da2 service nova] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:55.346697 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 708/1428] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:44:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:44:56.150573 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a4aef-c7a5-4f20-ab3c-3a9797eefd47 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:56.151135 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a4aef-c7a5-4f20-ab3c-3a9797eefd47 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:56.151135 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a4aef-c7a5-4f20-ab3c-3a9797eefd47 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:56.152486 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 721/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 12:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:44:56.157483 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64cfa0-c8ed-431b-93fa-8d22c37c0f08 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:56.157926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64cfa0-c8ed-431b-93fa-8d22c37c0f08 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:56.158066 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64cfa0-c8ed-431b-93fa-8d22c37c0f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:56.235557 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-7e64cfa0-c8ed-431b-93fa-8d22c37c0f08 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:44:56.236768 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-7e64cfa0-c8ed-431b-93fa-8d22c37c0f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:56.340640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 709/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 12:44:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:44:56.492354 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a4aef-c7a5-4f20-ab3c-3a9797eefd47 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:56.493934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-1f9a4aef-c7a5-4f20-ab3c-3a9797eefd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:56.542232 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:56.639101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a4aef-c7a5-4f20-ab3c-3a9797eefd47 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:56.750939 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1df5d0-cc4c-4ba2-8c7b-a20406b9343d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:56.751482 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1df5d0-cc4c-4ba2-8c7b-a20406b9343d service nova] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:56.751766 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1df5d0-cc4c-4ba2-8c7b-a20406b9343d service nova] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:56.752043 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1df5d0-cc4c-4ba2-8c7b-a20406b9343d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:56.753708 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-5b1df5d0-cc4c-4ba2-8c7b-a20406b9343d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:56.760646 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:56.844146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1df5d0-cc4c-4ba2-8c7b-a20406b9343d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:56.845772 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1df5d0-cc4c-4ba2-8c7b-a20406b9343d service nova] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:56.863080 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 722/1431] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:44:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:44:57.667154 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334a0e6-d7b9-42fe-bd1f-8fcd349fa447 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:57.667753 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334a0e6-d7b9-42fe-bd1f-8fcd349fa447 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:57.667753 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334a0e6-d7b9-42fe-bd1f-8fcd349fa447 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:57.669069 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 710/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 12:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:44:57.673945 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e04cb-342a-49b9-84b6-3d0d8ddc573a None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:57.674356 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e04cb-342a-49b9-84b6-3d0d8ddc573a None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:57.674491 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e04cb-342a-49b9-84b6-3d0d8ddc573a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:57.750155 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-f02e04cb-342a-49b9-84b6-3d0d8ddc573a None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:44:57.751385 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-f02e04cb-342a-49b9-84b6-3d0d8ddc573a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:57.819443 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:57.849150 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 723/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 12:44:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:44:57.999455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334a0e6-d7b9-42fe-bd1f-8fcd349fa447 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:58.001032 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-f334a0e6-d7b9-42fe-bd1f-8fcd349fa447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:58.018861 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:58.148237 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334a0e6-d7b9-42fe-bd1f-8fcd349fa447 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:58.234319 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:58.261546 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bc41b-6049-4ec4-8f18-d1e608706295 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:58.262103 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bc41b-6049-4ec4-8f18-d1e608706295 service nova] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:58.262385 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bc41b-6049-4ec4-8f18-d1e608706295 service nova] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:58.262660 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bc41b-6049-4ec4-8f18-d1e608706295 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:58.264297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-9f8bc41b-6049-4ec4-8f18-d1e608706295 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:58.352916 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8bc41b-6049-4ec4-8f18-d1e608706295 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:58.354544 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8bc41b-6049-4ec4-8f18-d1e608706295 service nova] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:58.382347 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 711/1434] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:44:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:44:59.177425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f94776-a9d9-427a-9f88-59d8f9ac2058 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:59.178004 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f94776-a9d9-427a-9f88-59d8f9ac2058 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:59.178004 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f94776-a9d9-427a-9f88-59d8f9ac2058 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:59.179396 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 724/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 12:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:44:59.184385 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba095f-d6fb-427a-87e2-1c61f25cc6fd None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:59.184776 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba095f-d6fb-427a-87e2-1c61f25cc6fd None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:59.184942 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba095f-d6fb-427a-87e2-1c61f25cc6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:59.262180 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-73ba095f-d6fb-427a-87e2-1c61f25cc6fd None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:44:59.263403 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-73ba095f-d6fb-427a-87e2-1c61f25cc6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:59.305598 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:59.360898 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 712/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 12:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:44:59.510623 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f94776-a9d9-427a-9f88-59d8f9ac2058 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:44:59.512184 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-35f94776-a9d9-427a-9f88-59d8f9ac2058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:59.663725 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f94776-a9d9-427a-9f88-59d8f9ac2058 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:44:59.717978 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:44:59.778914 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3123e-9520-4f60-ab7b-ea40b6a6db9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:44:59.779558 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3123e-9520-4f60-ab7b-ea40b6a6db9d service nova] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:44:59.779842 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3123e-9520-4f60-ab7b-ea40b6a6db9d service nova] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:44:59.780117 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3123e-9520-4f60-ab7b-ea40b6a6db9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:44:59.781792 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-b3b3123e-9520-4f60-ab7b-ea40b6a6db9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:44:59.872539 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3123e-9520-4f60-ab7b-ea40b6a6db9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:44:59.874175 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3123e-9520-4f60-ab7b-ea40b6a6db9d service nova] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:44:59.892427 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 725/1437] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:44:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:45:00.701167 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec25efe-2611-4a42-b59a-d6da458c5978 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:00.701729 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec25efe-2611-4a42-b59a-d6da458c5978 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:00.701729 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec25efe-2611-4a42-b59a-d6da458c5978 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:00.703094 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 713/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 12:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:45:00.708541 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b0ceb-3b71-4d0a-b6f3-f71f6f6b6b6f None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:00.708984 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b0ceb-3b71-4d0a-b6f3-f71f6f6b6b6f None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:00.709085 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b0ceb-3b71-4d0a-b6f3-f71f6f6b6b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:00.783342 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-041b0ceb-3b71-4d0a-b6f3-f71f6f6b6b6f None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:45:00.784565 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-041b0ceb-3b71-4d0a-b6f3-f71f6f6b6b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:00.786698 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:00.879031 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 726/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 12:45:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:45:01.029034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec25efe-2611-4a42-b59a-d6da458c5978 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:01.030595 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-9ec25efe-2611-4a42-b59a-d6da458c5978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:01.178829 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec25efe-2611-4a42-b59a-d6da458c5978 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:01.204903 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:01.293850 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0b58a-7988-457c-804a-4c11bacb63ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:01.294406 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0b58a-7988-457c-804a-4c11bacb63ed service nova] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:01.294688 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0b58a-7988-457c-804a-4c11bacb63ed service nova] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:01.294960 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0b58a-7988-457c-804a-4c11bacb63ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:01.296624 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-56f0b58a-7988-457c-804a-4c11bacb63ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:01.386444 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0b58a-7988-457c-804a-4c11bacb63ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:01.388040 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0b58a-7988-457c-804a-4c11bacb63ed service nova] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:01.406136 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 714/1440] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:45:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:45:03.307224 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab1c12-b871-45a9-acac-a2dcbfcce86e None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:03.307725 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab1c12-b871-45a9-acac-a2dcbfcce86e None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:03.307725 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab1c12-b871-45a9-acac-a2dcbfcce86e None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:03.309111 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 727/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:45:03.314234 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fe6a8-bd72-40d6-9d8c-82b44f42f67e None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:03.314651 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fe6a8-bd72-40d6-9d8c-82b44f42f67e None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:03.314784 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fe6a8-bd72-40d6-9d8c-82b44f42f67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:03.357677 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:03.383183 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-093fe6a8-bd72-40d6-9d8c-82b44f42f67e None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:45:03.384409 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-093fe6a8-bd72-40d6-9d8c-82b44f42f67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:03.480058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 715/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:45:03.519106 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab1c12-b871-45a9-acac-a2dcbfcce86e None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:03.520829 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-ffab1c12-b871-45a9-acac-a2dcbfcce86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:03.627275 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab1c12-b871-45a9-acac-a2dcbfcce86e None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:03.661074 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:03.702323 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1207b-24d4-47d9-a7e6-aa4e72ceba2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:03.702931 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1207b-24d4-47d9-a7e6-aa4e72ceba2b service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:03.703206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1207b-24d4-47d9-a7e6-aa4e72ceba2b service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:03.703475 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1207b-24d4-47d9-a7e6-aa4e72ceba2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:03.705086 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-86d1207b-24d4-47d9-a7e6-aa4e72ceba2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:03.811564 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1207b-24d4-47d9-a7e6-aa4e72ceba2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:03.812985 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1207b-24d4-47d9-a7e6-aa4e72ceba2b service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:03.832313 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 728/1443] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:45:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:45:06.012910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2b153-8b6d-44f9-a0a2-b14e35fd08c3 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:06.013473 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2b153-8b6d-44f9-a0a2-b14e35fd08c3 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:06.013473 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2b153-8b6d-44f9-a0a2-b14e35fd08c3 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:06.014855 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 716/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:45:06.020104 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159abfe-b17d-47df-a8b5-6dd77ece2b25 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:06.020549 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159abfe-b17d-47df-a8b5-6dd77ece2b25 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:06.020656 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159abfe-b17d-47df-a8b5-6dd77ece2b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:06.086448 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-a159abfe-b17d-47df-a8b5-6dd77ece2b25 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:45:06.087670 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-a159abfe-b17d-47df-a8b5-6dd77ece2b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:06.101019 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:06.185594 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 729/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:45:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:45:06.224154 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b2b153-8b6d-44f9-a0a2-b14e35fd08c3 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:06.225744 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-50b2b153-8b6d-44f9-a0a2-b14e35fd08c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:06.330171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b2b153-8b6d-44f9-a0a2-b14e35fd08c3 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:06.342846 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:06.405894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14b729-555b-49b3-93f9-2a5e7cea5d26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:06.406505 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14b729-555b-49b3-93f9-2a5e7cea5d26 service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:06.406787 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14b729-555b-49b3-93f9-2a5e7cea5d26 service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:06.407062 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14b729-555b-49b3-93f9-2a5e7cea5d26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:06.408693 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-6a14b729-555b-49b3-93f9-2a5e7cea5d26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:06.518706 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14b729-555b-49b3-93f9-2a5e7cea5d26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:06.520849 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14b729-555b-49b3-93f9-2a5e7cea5d26 service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:06.540092 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 717/1446] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:45:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:45:08.837295 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc763cc5-3918-4f9a-af36-546d4815c8db None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:08.837869 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc763cc5-3918-4f9a-af36-546d4815c8db None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:08.837869 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc763cc5-3918-4f9a-af36-546d4815c8db None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:08.839243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 730/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:45:08.844609 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af433e-d12d-4db9-bf9b-b1e2d920733e None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:08.845103 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af433e-d12d-4db9-bf9b-b1e2d920733e None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:08.845212 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af433e-d12d-4db9-bf9b-b1e2d920733e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:08.894301 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:08.911969 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-75af433e-d12d-4db9-bf9b-b1e2d920733e None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:45:08.913169 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-75af433e-d12d-4db9-bf9b-b1e2d920733e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:09.007855 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 718/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:45:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:45:09.046184 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc763cc5-3918-4f9a-af36-546d4815c8db None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:09.047733 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-bc763cc5-3918-4f9a-af36-546d4815c8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:09.150682 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc763cc5-3918-4f9a-af36-546d4815c8db None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:09.190860 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:09.225350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d175843-0d85-4ba2-971a-fae63877d6d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:09.225989 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d175843-0d85-4ba2-971a-fae63877d6d0 service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:09.226274 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d175843-0d85-4ba2-971a-fae63877d6d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:09.226551 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d175843-0d85-4ba2-971a-fae63877d6d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:09.228198 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-8d175843-0d85-4ba2-971a-fae63877d6d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:09.337153 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d175843-0d85-4ba2-971a-fae63877d6d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:09.338549 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d175843-0d85-4ba2-971a-fae63877d6d0 service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:09.356586 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 731/1449] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:45:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:45:11.469052 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362540b-e200-4cc4-b4e1-daa9a7371af0 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:11.469609 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362540b-e200-4cc4-b4e1-daa9a7371af0 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:11.469609 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362540b-e200-4cc4-b4e1-daa9a7371af0 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:11.470958 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 719/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:45:11.476147 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517fd82-ee59-44dd-af7b-88688eab4344 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:11.476572 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517fd82-ee59-44dd-af7b-88688eab4344 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:11.476685 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517fd82-ee59-44dd-af7b-88688eab4344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:11.543677 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-f517fd82-ee59-44dd-af7b-88688eab4344 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:45:11.544899 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-f517fd82-ee59-44dd-af7b-88688eab4344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:11.565586 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:11.642554 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 732/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:45:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:45:11.681526 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362540b-e200-4cc4-b4e1-daa9a7371af0 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:11.683079 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-5362540b-e200-4cc4-b4e1-daa9a7371af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:11.786120 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362540b-e200-4cc4-b4e1-daa9a7371af0 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:11.806191 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:11.859024 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46440906-00f0-4a3a-8a49-1ca6743df28d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:11.859662 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46440906-00f0-4a3a-8a49-1ca6743df28d service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:11.859946 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46440906-00f0-4a3a-8a49-1ca6743df28d service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:11.860220 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46440906-00f0-4a3a-8a49-1ca6743df28d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:11.861877 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-46440906-00f0-4a3a-8a49-1ca6743df28d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:11.972397 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46440906-00f0-4a3a-8a49-1ca6743df28d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:11.974607 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46440906-00f0-4a3a-8a49-1ca6743df28d service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:11.993431 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 720/1452] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:45:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:45:14.093553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94593c7c-58bd-45d5-8cc8-cd54c5a9fbc7 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:14.094130 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94593c7c-58bd-45d5-8cc8-cd54c5a9fbc7 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:14.094130 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94593c7c-58bd-45d5-8cc8-cd54c5a9fbc7 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:14.095549 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 733/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:45:14.101372 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ab3f0-e487-42d5-a9df-5d5bc0fd00d9 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:14.101810 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ab3f0-e487-42d5-a9df-5d5bc0fd00d9 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:14.101962 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ab3f0-e487-42d5-a9df-5d5bc0fd00d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:14.165690 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:14.170246 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-440ab3f0-e487-42d5-a9df-5d5bc0fd00d9 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:45:14.171648 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-440ab3f0-e487-42d5-a9df-5d5bc0fd00d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:14.269971 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 721/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:45:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:45:14.307863 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94593c7c-58bd-45d5-8cc8-cd54c5a9fbc7 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:14.309405 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-94593c7c-58bd-45d5-8cc8-cd54c5a9fbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:14.412971 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94593c7c-58bd-45d5-8cc8-cd54c5a9fbc7 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:14.462665 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:14.486763 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b771a-1722-4d9d-b153-b04680cac77b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:14.487376 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b771a-1722-4d9d-b153-b04680cac77b service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:14.487655 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b771a-1722-4d9d-b153-b04680cac77b service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:14.487926 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b771a-1722-4d9d-b153-b04680cac77b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:14.489690 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-339b771a-1722-4d9d-b153-b04680cac77b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:14.602715 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b771a-1722-4d9d-b153-b04680cac77b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:14.604151 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b771a-1722-4d9d-b153-b04680cac77b service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:14.622402 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 734/1455] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:45:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:45:16.682315 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12829634-07f6-4f01-b9bc-d689dfeebb6c None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:16.682858 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12829634-07f6-4f01-b9bc-d689dfeebb6c None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:16.682858 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12829634-07f6-4f01-b9bc-d689dfeebb6c None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:16.684232 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 722/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:45:16.689360 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc07c3e-2dee-4a10-95a3-8d5bf35b75d2 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:16.689855 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc07c3e-2dee-4a10-95a3-8d5bf35b75d2 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:16.689951 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc07c3e-2dee-4a10-95a3-8d5bf35b75d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:16.758043 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-5bc07c3e-2dee-4a10-95a3-8d5bf35b75d2 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:45:16.759236 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-5bc07c3e-2dee-4a10-95a3-8d5bf35b75d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:16.788331 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:16.857958 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 735/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:45:16.896785 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12829634-07f6-4f01-b9bc-d689dfeebb6c None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:16.898366 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-12829634-07f6-4f01-b9bc-d689dfeebb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:17.002871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12829634-07f6-4f01-b9bc-d689dfeebb6c None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:17.031608 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:17.077862 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160b941-8d39-43cb-b9bb-86a8c3828723 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:17.078481 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160b941-8d39-43cb-b9bb-86a8c3828723 service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:17.078763 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160b941-8d39-43cb-b9bb-86a8c3828723 service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:17.079039 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160b941-8d39-43cb-b9bb-86a8c3828723 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:17.080676 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-5160b941-8d39-43cb-b9bb-86a8c3828723 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:17.188736 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5160b941-8d39-43cb-b9bb-86a8c3828723 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:17.190185 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5160b941-8d39-43cb-b9bb-86a8c3828723 service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:17.209674 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 723/1458] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:45:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:45:19.261125 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f3026-79c7-48b9-a075-7a24f8894381 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:19.261740 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f3026-79c7-48b9-a075-7a24f8894381 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:19.261740 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f3026-79c7-48b9-a075-7a24f8894381 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:19.263078 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 736/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:45:19.268259 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b338a92-7100-4e04-9bde-7fd59a7b7f29 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:19.268679 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b338a92-7100-4e04-9bde-7fd59a7b7f29 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:19.268802 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b338a92-7100-4e04-9bde-7fd59a7b7f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:19.335114 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-4b338a92-7100-4e04-9bde-7fd59a7b7f29 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:45:19.336235 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-4b338a92-7100-4e04-9bde-7fd59a7b7f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:19.345501 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:19.436565 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 724/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:45:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:45:19.474500 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f3026-79c7-48b9-a075-7a24f8894381 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:19.476086 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-a54f3026-79c7-48b9-a075-7a24f8894381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:19.580345 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f3026-79c7-48b9-a075-7a24f8894381 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:19.635627 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:19.654636 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806f5db-3f55-46aa-879a-d0f102f7aa6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:19.655241 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806f5db-3f55-46aa-879a-d0f102f7aa6a service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:19.655519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806f5db-3f55-46aa-879a-d0f102f7aa6a service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:19.655807 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806f5db-3f55-46aa-879a-d0f102f7aa6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:19.657410 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-6806f5db-3f55-46aa-879a-d0f102f7aa6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:19.764406 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806f5db-3f55-46aa-879a-d0f102f7aa6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:19.765887 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806f5db-3f55-46aa-879a-d0f102f7aa6a service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:19.784049 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 737/1461] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:45:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:45:21.842469 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106811e-465b-4e9c-90d0-7922332ebd1f None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:21.843027 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106811e-465b-4e9c-90d0-7922332ebd1f None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:21.843027 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106811e-465b-4e9c-90d0-7922332ebd1f None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:21.844429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 725/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:45:21.850470 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53bea0-2ef7-4315-be82-a9fd88dc48cd None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:21.850913 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53bea0-2ef7-4315-be82-a9fd88dc48cd None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:21.851023 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53bea0-2ef7-4315-be82-a9fd88dc48cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:21.916711 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-2e53bea0-2ef7-4315-be82-a9fd88dc48cd None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:45:21.917973 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-2e53bea0-2ef7-4315-be82-a9fd88dc48cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:21.956172 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:22.015327 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 738/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:45:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:45:22.053778 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106811e-465b-4e9c-90d0-7922332ebd1f None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:22.055350 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-5106811e-465b-4e9c-90d0-7922332ebd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:22.158991 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106811e-465b-4e9c-90d0-7922332ebd1f None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:22.195866 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:22.232106 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b56261-ade6-4f47-9fe2-8dae15e098c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:22.232712 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b56261-ade6-4f47-9fe2-8dae15e098c2 service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:22.232989 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b56261-ade6-4f47-9fe2-8dae15e098c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:22.233256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b56261-ade6-4f47-9fe2-8dae15e098c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:22.235150 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-21b56261-ade6-4f47-9fe2-8dae15e098c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:22.342487 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b56261-ade6-4f47-9fe2-8dae15e098c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:22.343910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b56261-ade6-4f47-9fe2-8dae15e098c2 service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:22.362507 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 726/1464] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:45:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:45:24.378560 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042f8dd-e544-40fe-9ccc-69586896d8bf None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:24.379117 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042f8dd-e544-40fe-9ccc-69586896d8bf None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:24.379117 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042f8dd-e544-40fe-9ccc-69586896d8bf None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:24.380493 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 739/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:45:24.385921 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5761b-af8b-40f2-9b51-f2ef6214a0da None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:24.386352 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5761b-af8b-40f2-9b51-f2ef6214a0da None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:24.386530 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5761b-af8b-40f2-9b51-f2ef6214a0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:24.452220 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-37e5761b-af8b-40f2-9b51-f2ef6214a0da None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:45:24.453449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-37e5761b-af8b-40f2-9b51-f2ef6214a0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:24.472021 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:24.551714 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 727/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:45:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:45:24.588437 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042f8dd-e544-40fe-9ccc-69586896d8bf None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:24.590041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-2042f8dd-e544-40fe-9ccc-69586896d8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:24.702842 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042f8dd-e544-40fe-9ccc-69586896d8bf None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:24.888958 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:24.897094 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ac99c-532a-4253-9bde-bcedb60aea74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:24.897742 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ac99c-532a-4253-9bde-bcedb60aea74 service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:24.898028 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ac99c-532a-4253-9bde-bcedb60aea74 service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:24.898306 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ac99c-532a-4253-9bde-bcedb60aea74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:24.899934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-074ac99c-532a-4253-9bde-bcedb60aea74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:25.008351 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ac99c-532a-4253-9bde-bcedb60aea74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:25.009835 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ac99c-532a-4253-9bde-bcedb60aea74 service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:25.027487 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 740/1467] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:45:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:45:27.025439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b3d72-e63b-4f2a-9865-44822194fe37 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:27.026019 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b3d72-e63b-4f2a-9865-44822194fe37 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:27.026019 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b3d72-e63b-4f2a-9865-44822194fe37 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:27.027382 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:45:27.032543 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08caa5c-6015-4044-b72e-1e6efd1fc831 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:27.032938 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08caa5c-6015-4044-b72e-1e6efd1fc831 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:27.033087 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08caa5c-6015-4044-b72e-1e6efd1fc831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:27.097921 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-c08caa5c-6015-4044-b72e-1e6efd1fc831 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:45:27.099111 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-c08caa5c-6015-4044-b72e-1e6efd1fc831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:27.146429 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:27.193063 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:45:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:45:27.229254 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b3d72-e63b-4f2a-9865-44822194fe37 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:27.230822 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-c41b3d72-e63b-4f2a-9865-44822194fe37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:27.336956 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b3d72-e63b-4f2a-9865-44822194fe37 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:27.384360 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:27.410042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedec2e1-b720-4327-b0d4-262830e8ee4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:27.410653 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedec2e1-b720-4327-b0d4-262830e8ee4c service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:27.410933 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedec2e1-b720-4327-b0d4-262830e8ee4c service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:27.411204 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedec2e1-b720-4327-b0d4-262830e8ee4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:27.412828 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-aedec2e1-b720-4327-b0d4-262830e8ee4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:27.523010 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedec2e1-b720-4327-b0d4-262830e8ee4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:27.524449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedec2e1-b720-4327-b0d4-262830e8ee4c service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:27.542563 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 729/1470] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:45:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:45:37.190563 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=22 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:37.540241 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=66 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:47.630947 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69eb47-2d8e-404f-a4ff-a8100b59d601 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:47.631512 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69eb47-2d8e-404f-a4ff-a8100b59d601 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:47.631512 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69eb47-2d8e-404f-a4ff-a8100b59d601 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:47.632923 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 742/1471] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:45:47.638451 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003f7b0-82aa-4780-a9f1-908aa6bf1bde None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:47.638878 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003f7b0-82aa-4780-a9f1-908aa6bf1bde None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:47.638978 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003f7b0-82aa-4780-a9f1-908aa6bf1bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:47.704754 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-2003f7b0-82aa-4780-a9f1-908aa6bf1bde None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:45:47.706593 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-2003f7b0-82aa-4780-a9f1-908aa6bf1bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:47.802461 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 730/1472] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:45:47.885442 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae4640-238b-41e2-9be2-2ee71fd6b023 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:47.885760 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae4640-238b-41e2-9be2-2ee71fd6b023 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:47.886041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae4640-238b-41e2-9be2-2ee71fd6b023 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:47.887394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 743/1473] 10.222.0.46 () {54 vars in 966 bytes} [Wed Aug 3 12:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:45:47.892126 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b59ea3-0076-4942-a390-76bf028bbefb None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:47.892415 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b59ea3-0076-4942-a390-76bf028bbefb None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:47.892691 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b59ea3-0076-4942-a390-76bf028bbefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:47.970582 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-e0b59ea3-0076-4942-a390-76bf028bbefb None None] MFA Rules not processed for user `a2f23f4936684b63afc095986e43ec37`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:45:47.971836 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-e0b59ea3-0076-4942-a390-76bf028bbefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:47.991847 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:48.047066 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 731/1474] 10.222.0.46 () {58 vars in 1063 bytes} [Wed Aug 3 12:45:47 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:45:48.054770 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae4640-238b-41e2-9be2-2ee71fd6b023 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:48.056301 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-4dae4640-238b-41e2-9be2-2ee71fd6b023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:48.159901 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae4640-238b-41e2-9be2-2ee71fd6b023 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:48.233102 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d1495-4eab-42b0-a203-a0947c255eae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2f23f4936684b63afc095986e43ec37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:48.233734 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d1495-4eab-42b0-a203-a0947c255eae service glance] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:48.234017 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d1495-4eab-42b0-a203-a0947c255eae service glance] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:48.234291 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d1495-4eab-42b0-a203-a0947c255eae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:48.235913 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-937d1495-4eab-42b0-a203-a0947c255eae service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:48.290405 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:48.345232 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d1495-4eab-42b0-a203-a0947c255eae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:48.346755 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d1495-4eab-42b0-a203-a0947c255eae service glance] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:48.365565 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 744/1475] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:45:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:45:50.458161 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b824c4b-bacd-4e22-a4dc-2d96af0c2a25 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:50.458696 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b824c4b-bacd-4e22-a4dc-2d96af0c2a25 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:50.458696 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b824c4b-bacd-4e22-a4dc-2d96af0c2a25 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:50.460080 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 732/1476] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:45:50.465390 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706419f-6f3c-45fd-8863-b3feb89083ea None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:50.465816 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706419f-6f3c-45fd-8863-b3feb89083ea None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:50.465961 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706419f-6f3c-45fd-8863-b3feb89083ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:50.532503 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-f706419f-6f3c-45fd-8863-b3feb89083ea None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:45:50.534200 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-f706419f-6f3c-45fd-8863-b3feb89083ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:50.629427 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 745/1477] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:45:50.652977 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b824c4b-bacd-4e22-a4dc-2d96af0c2a25 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:50.654534 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-5b824c4b-bacd-4e22-a4dc-2d96af0c2a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:50.779916 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b824c4b-bacd-4e22-a4dc-2d96af0c2a25 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:50.827617 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:50.872320 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36d36e-6a40-481f-8f21-0a3efb3ed0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:50.872930 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36d36e-6a40-481f-8f21-0a3efb3ed0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:50.873213 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36d36e-6a40-481f-8f21-0a3efb3ed0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:50.873486 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36d36e-6a40-481f-8f21-0a3efb3ed0d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:50.874204 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36d36e-6a40-481f-8f21-0a3efb3ed0d2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:50.875912 dv-cinder-850836-4-smb devstack@keystone.service[91788]: WARNING py.warnings [None req-5d36d36e-6a40-481f-8f21-0a3efb3ed0d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:45:50.875912 dv-cinder-850836-4-smb devstack@keystone.service[91788]: warnings.warn(msg) Aug 03 12:45:50.875912 dv-cinder-850836-4-smb devstack@keystone.service[91788]: Aug 03 12:45:50.877132 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36d36e-6a40-481f-8f21-0a3efb3ed0d2 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:50.896568 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 733/1478] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Aug 3 12:45:50 2022] GET /identity/v3/projects => generated 2553 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:45:52.937938 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce016b80-6abc-4a81-aae6-1b81f7db7c1c None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:52.938504 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce016b80-6abc-4a81-aae6-1b81f7db7c1c None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:52.938504 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce016b80-6abc-4a81-aae6-1b81f7db7c1c None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:52.939910 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 746/1479] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:45:52.945275 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf96c1e-77a7-4e90-a874-76acac8288f6 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:52.945729 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf96c1e-77a7-4e90-a874-76acac8288f6 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:52.945870 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf96c1e-77a7-4e90-a874-76acac8288f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:53.019618 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-aaf96c1e-77a7-4e90-a874-76acac8288f6 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:45:53.020854 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-aaf96c1e-77a7-4e90-a874-76acac8288f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:53.120575 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 734/1480] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:45:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:45:53.164472 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce016b80-6abc-4a81-aae6-1b81f7db7c1c None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:53.166039 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-ce016b80-6abc-4a81-aae6-1b81f7db7c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:53.176173 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:53.312327 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce016b80-6abc-4a81-aae6-1b81f7db7c1c None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:53.391819 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:53.425165 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06672db6-d8c7-4f73-b3b0-7753b6f69c67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:53.425802 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06672db6-d8c7-4f73-b3b0-7753b6f69c67 service nova] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:53.426080 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06672db6-d8c7-4f73-b3b0-7753b6f69c67 service nova] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:53.426348 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06672db6-d8c7-4f73-b3b0-7753b6f69c67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:53.427954 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-06672db6-d8c7-4f73-b3b0-7753b6f69c67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:53.516823 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06672db6-d8c7-4f73-b3b0-7753b6f69c67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:53.519227 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06672db6-d8c7-4f73-b3b0-7753b6f69c67 service nova] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:53.536795 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 747/1481] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:45:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:45:55.708629 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bdc39-0a98-4c5b-aa0e-66e75ffabcea None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:55.709191 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bdc39-0a98-4c5b-aa0e-66e75ffabcea None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:55.709191 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bdc39-0a98-4c5b-aa0e-66e75ffabcea None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:55.710574 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 735/1482] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:45:55.715683 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52673f-f951-4ba0-83dd-ca638691a85b None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:55.716058 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52673f-f951-4ba0-83dd-ca638691a85b None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:55.716240 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52673f-f951-4ba0-83dd-ca638691a85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:55.781509 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-9b52673f-f951-4ba0-83dd-ca638691a85b None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:45:55.782722 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-9b52673f-f951-4ba0-83dd-ca638691a85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:55.828309 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:55.878870 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 748/1483] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:45:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:45:55.915778 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36bdc39-0a98-4c5b-aa0e-66e75ffabcea None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:55.917303 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-d36bdc39-0a98-4c5b-aa0e-66e75ffabcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:55.940742 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:56.020986 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36bdc39-0a98-4c5b-aa0e-66e75ffabcea None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:56.093196 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc520c-2487-4c17-ae57-77b099015379 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:56.093769 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc520c-2487-4c17-ae57-77b099015379 service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:56.094051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc520c-2487-4c17-ae57-77b099015379 service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:56.094323 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc520c-2487-4c17-ae57-77b099015379 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:56.096658 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-77dc520c-2487-4c17-ae57-77b099015379 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:56.169656 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:56.204474 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc520c-2487-4c17-ae57-77b099015379 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:56.206586 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc520c-2487-4c17-ae57-77b099015379 service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:56.225179 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 736/1484] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:45:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:45:58.271347 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f200a7b-9656-42eb-b4e0-441fb04ab819 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:58.271775 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f200a7b-9656-42eb-b4e0-441fb04ab819 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:58.271907 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f200a7b-9656-42eb-b4e0-441fb04ab819 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:58.273327 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 749/1485] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:45:58.278594 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb293b-9db3-4c7d-97b9-632da3be7124 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:58.279055 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb293b-9db3-4c7d-97b9-632da3be7124 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:58.279153 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb293b-9db3-4c7d-97b9-632da3be7124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:58.345416 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-0bcb293b-9db3-4c7d-97b9-632da3be7124 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:45:58.346905 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-0bcb293b-9db3-4c7d-97b9-632da3be7124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:58.443887 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 737/1486] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:45:58.484054 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f200a7b-9656-42eb-b4e0-441fb04ab819 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:45:58.485648 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-5f200a7b-9656-42eb-b4e0-441fb04ab819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:58.588634 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f200a7b-9656-42eb-b4e0-441fb04ab819 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:45:58.658964 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:45:58.660614 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97e856-954f-4467-947d-6d9385c856f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:45:58.661243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97e856-954f-4467-947d-6d9385c856f6 service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:45:58.661621 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97e856-954f-4467-947d-6d9385c856f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:45:58.661915 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97e856-954f-4467-947d-6d9385c856f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:45:58.664098 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-1d97e856-954f-4467-947d-6d9385c856f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:45:58.773439 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d97e856-954f-4467-947d-6d9385c856f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:45:58.774924 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d97e856-954f-4467-947d-6d9385c856f6 service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:45:58.795186 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 750/1487] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:45:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:46:00.885483 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868c6b9-1043-492c-b71a-ad6187d6f8b8 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:46:00.886090 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868c6b9-1043-492c-b71a-ad6187d6f8b8 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:46:00.886090 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868c6b9-1043-492c-b71a-ad6187d6f8b8 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:46:00.887472 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 738/1488] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:46:00.892818 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d288f-9190-4990-b5fd-145b39fbaafb None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:46:00.893257 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d288f-9190-4990-b5fd-145b39fbaafb None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:46:00.893364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d288f-9190-4990-b5fd-145b39fbaafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:46:00.959229 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-f90d288f-9190-4990-b5fd-145b39fbaafb None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:46:00.960445 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-f90d288f-9190-4990-b5fd-145b39fbaafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:46:01.013753 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:46:01.058657 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 751/1489] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:46:01.101664 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868c6b9-1043-492c-b71a-ad6187d6f8b8 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:46:01.103225 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-a868c6b9-1043-492c-b71a-ad6187d6f8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:46:01.138503 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:46:01.205519 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868c6b9-1043-492c-b71a-ad6187d6f8b8 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:46:01.278159 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c67337-57ec-4aa5-ad60-d1d48c7fc9e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:46:01.278786 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c67337-57ec-4aa5-ad60-d1d48c7fc9e7 service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:46:01.279084 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c67337-57ec-4aa5-ad60-d1d48c7fc9e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:46:01.279342 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c67337-57ec-4aa5-ad60-d1d48c7fc9e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:46:01.280988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-80c67337-57ec-4aa5-ad60-d1d48c7fc9e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:46:01.361846 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:46:01.391016 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c67337-57ec-4aa5-ad60-d1d48c7fc9e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:46:01.392952 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c67337-57ec-4aa5-ad60-d1d48c7fc9e7 service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:46:01.411897 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 739/1490] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:46:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:46:03.565650 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d66456-4059-4943-91a8-38cef8831085 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:46:03.566275 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d66456-4059-4943-91a8-38cef8831085 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:46:03.566275 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d66456-4059-4943-91a8-38cef8831085 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:46:03.567578 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 752/1491] 10.222.0.46 () {54 vars in 926 bytes} [Wed Aug 3 12:46:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:46:03.572713 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25239eac-6cde-404f-91ef-4d96dde17949 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:46:03.573138 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25239eac-6cde-404f-91ef-4d96dde17949 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:46:03.573297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25239eac-6cde-404f-91ef-4d96dde17949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:46:03.643325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-25239eac-6cde-404f-91ef-4d96dde17949 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:46:03.644528 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-25239eac-6cde-404f-91ef-4d96dde17949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:46:03.740720 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 740/1492] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Aug 3 12:46:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:46:03.779329 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d66456-4059-4943-91a8-38cef8831085 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:46:03.780912 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-b2d66456-4059-4943-91a8-38cef8831085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:46:03.882957 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d66456-4059-4943-91a8-38cef8831085 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:46:03.955255 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf0a31-b66d-4a64-8bb0-bd9bc59e33e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:46:03.955859 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf0a31-b66d-4a64-8bb0-bd9bc59e33e6 service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:46:03.956167 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf0a31-b66d-4a64-8bb0-bd9bc59e33e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:46:03.956442 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf0a31-b66d-4a64-8bb0-bd9bc59e33e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:46:03.958078 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-2caf0a31-b66d-4a64-8bb0-bd9bc59e33e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:46:03.968171 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:46:04.070055 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf0a31-b66d-4a64-8bb0-bd9bc59e33e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:46:04.071526 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf0a31-b66d-4a64-8bb0-bd9bc59e33e6 service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:46:04.089950 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 753/1493] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:46:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:46:13.738737 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=82 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:46:14.087656 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=50 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:47:30.521963 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf4a4a-e80b-47a0-a30a-5c967d20f495 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:47:30.522524 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf4a4a-e80b-47a0-a30a-5c967d20f495 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:47:30.522524 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf4a4a-e80b-47a0-a30a-5c967d20f495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:47:30.601143 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-8fcf4a4a-e80b-47a0-a30a-5c967d20f495 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:47:30.602389 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-8fcf4a4a-e80b-47a0-a30a-5c967d20f495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:47:30.700003 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 741/1494] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:47:30.708520 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069ec46-7efd-4400-b977-a8ced70df98e None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:47:30.709027 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069ec46-7efd-4400-b977-a8ced70df98e None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:47:30.709138 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069ec46-7efd-4400-b977-a8ced70df98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:47:30.786648 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-f069ec46-7efd-4400-b977-a8ced70df98e None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:47:30.787820 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-f069ec46-7efd-4400-b977-a8ced70df98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:47:30.883736 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 754/1495] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:47:30.888384 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf4a4a-e80b-47a0-a30a-5c967d20f495 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:47:30.890227 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-8fcf4a4a-e80b-47a0-a30a-5c967d20f495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:47:30.901625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf4a4a-e80b-47a0-a30a-5c967d20f495 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:47:30.962664 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:47:30.996083 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dbb272-36e8-418c-9d38-df2c00c4c778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:47:30.996948 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbb272-36e8-418c-9d38-df2c00c4c778 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:47:30.997221 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbb272-36e8-418c-9d38-df2c00c4c778 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:47:30.997485 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbb272-36e8-418c-9d38-df2c00c4c778 admin admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:47:30.998204 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dbb272-36e8-418c-9d38-df2c00c4c778 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:47:30.999005 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dbb272-36e8-418c-9d38-df2c00c4c778 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:47:31.000067 dv-cinder-850836-4-smb devstack@keystone.service[91788]: WARNING py.warnings [None req-15dbb272-36e8-418c-9d38-df2c00c4c778 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:47:31.000067 dv-cinder-850836-4-smb devstack@keystone.service[91788]: warnings.warn(msg) Aug 03 12:47:31.000067 dv-cinder-850836-4-smb devstack@keystone.service[91788]: Aug 03 12:47:31.000943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dbb272-36e8-418c-9d38-df2c00c4c778 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:47:31.012045 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 742/1496] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:47:31.021044 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069ec46-7efd-4400-b977-a8ced70df98e None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:47:31.030224 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069ec46-7efd-4400-b977-a8ced70df98e None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:47:31.091479 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:47:31.126381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778615f-cd4e-42e7-ba7d-e454257ad596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:47:31.126998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778615f-cd4e-42e7-ba7d-e454257ad596 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:47:31.127278 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778615f-cd4e-42e7-ba7d-e454257ad596 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:47:31.127550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778615f-cd4e-42e7-ba7d-e454257ad596 admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:47:31.128222 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778615f-cd4e-42e7-ba7d-e454257ad596 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:47:31.129984 dv-cinder-850836-4-smb devstack@keystone.service[91789]: WARNING py.warnings [None req-9778615f-cd4e-42e7-ba7d-e454257ad596 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:47:31.129984 dv-cinder-850836-4-smb devstack@keystone.service[91789]: warnings.warn(msg) Aug 03 12:47:31.129984 dv-cinder-850836-4-smb devstack@keystone.service[91789]: Aug 03 12:47:31.131189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778615f-cd4e-42e7-ba7d-e454257ad596 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:47:31.185805 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 755/1497] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:47:31 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:47:31.190833 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dbb272-36e8-418c-9d38-df2c00c4c778 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:47:31.192406 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-15dbb272-36e8-418c-9d38-df2c00c4c778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:47:31.225157 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dbb272-36e8-418c-9d38-df2c00c4c778 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:47:31.321409 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e107e3-a977-4481-9da3-d618ddb25abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:47:31.322054 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e107e3-a977-4481-9da3-d618ddb25abe admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:47:31.322341 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e107e3-a977-4481-9da3-d618ddb25abe admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:47:31.322616 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e107e3-a977-4481-9da3-d618ddb25abe admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:47:31.323287 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e107e3-a977-4481-9da3-d618ddb25abe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:47:31.324299 dv-cinder-850836-4-smb devstack@keystone.service[91788]: WARNING py.warnings [None req-82e107e3-a977-4481-9da3-d618ddb25abe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:47:31.324299 dv-cinder-850836-4-smb devstack@keystone.service[91788]: warnings.warn(msg) Aug 03 12:47:31.324299 dv-cinder-850836-4-smb devstack@keystone.service[91788]: Aug 03 12:47:31.325532 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e107e3-a977-4481-9da3-d618ddb25abe admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:47:31.367254 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 743/1498] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:47:31 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:47:31.371290 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778615f-cd4e-42e7-ba7d-e454257ad596 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:47:31.373454 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-9778615f-cd4e-42e7-ba7d-e454257ad596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:47:31.443045 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778615f-cd4e-42e7-ba7d-e454257ad596 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:47:31.526969 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:47:31.539393 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edc767-7300-4ddc-8132-0cd886e49302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:47:31.540269 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edc767-7300-4ddc-8132-0cd886e49302 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:47:31.540551 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edc767-7300-4ddc-8132-0cd886e49302 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:47:31.540818 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edc767-7300-4ddc-8132-0cd886e49302 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:47:31.541870 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1edc767-7300-4ddc-8132-0cd886e49302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:47:31.542879 dv-cinder-850836-4-smb devstack@keystone.service[91789]: WARNING py.warnings [None req-c1edc767-7300-4ddc-8132-0cd886e49302 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:47:31.542879 dv-cinder-850836-4-smb devstack@keystone.service[91789]: warnings.warn(msg) Aug 03 12:47:31.542879 dv-cinder-850836-4-smb devstack@keystone.service[91789]: Aug 03 12:47:31.543753 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1edc767-7300-4ddc-8132-0cd886e49302 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:47:31.556668 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 756/1499] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:47:31.560633 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e107e3-a977-4481-9da3-d618ddb25abe admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:47:31.562260 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-82e107e3-a977-4481-9da3-d618ddb25abe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:47:31.573666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e107e3-a977-4481-9da3-d618ddb25abe admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:47:31.599406 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:47:31.671700 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369e1fe-ae1c-4c36-8d4f-d8db9db47c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:47:31.672240 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369e1fe-ae1c-4c36-8d4f-d8db9db47c7c admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:47:31.672519 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369e1fe-ae1c-4c36-8d4f-d8db9db47c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:47:31.672789 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369e1fe-ae1c-4c36-8d4f-d8db9db47c7c admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:47:31.673486 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369e1fe-ae1c-4c36-8d4f-d8db9db47c7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:47:31.674519 dv-cinder-850836-4-smb devstack@keystone.service[91788]: WARNING py.warnings [None req-6369e1fe-ae1c-4c36-8d4f-d8db9db47c7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:47:31.674519 dv-cinder-850836-4-smb devstack@keystone.service[91788]: warnings.warn(msg) Aug 03 12:47:31.674519 dv-cinder-850836-4-smb devstack@keystone.service[91788]: Aug 03 12:47:31.675400 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369e1fe-ae1c-4c36-8d4f-d8db9db47c7c admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:47:31.687672 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 744/1500] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:47:31.691841 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edc767-7300-4ddc-8132-0cd886e49302 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:47:31.693368 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-c1edc767-7300-4ddc-8132-0cd886e49302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:47:31.727144 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edc767-7300-4ddc-8132-0cd886e49302 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:47:31.818903 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f23b8-e3be-415e-9b60-09ff2aeaa9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:47:31.819590 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f23b8-e3be-415e-9b60-09ff2aeaa9c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:47:31.819872 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f23b8-e3be-415e-9b60-09ff2aeaa9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:47:31.820145 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f23b8-e3be-415e-9b60-09ff2aeaa9c4 admin admin] PATH_INFO: `/v3/projects/97230fefd5344dbf80bce83a35eb158a/users/bd2e61912e8b42619d0a5c78f414ccba/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:47:31.843783 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f23b8-e3be-415e-9b60-09ff2aeaa9c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97230fefd5344dbf80bce83a35eb158a, user_id=bd2e61912e8b42619d0a5c78f414ccba, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:47:31.844825 dv-cinder-850836-4-smb devstack@keystone.service[91789]: WARNING py.warnings [None req-103f23b8-e3be-415e-9b60-09ff2aeaa9c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:47:31.844825 dv-cinder-850836-4-smb devstack@keystone.service[91789]: warnings.warn(msg) Aug 03 12:47:31.844825 dv-cinder-850836-4-smb devstack@keystone.service[91789]: Aug 03 12:47:31.846821 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f23b8-e3be-415e-9b60-09ff2aeaa9c4 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:47:31.870726 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 757/1501] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:47:31 2022] PUT /identity/v3/projects/97230fefd5344dbf80bce83a35eb158a/users/bd2e61912e8b42619d0a5c78f414ccba/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:47:31.883213 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe006a7-42c2-419c-b157-6eef67bd221c None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:47:31.883662 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe006a7-42c2-419c-b157-6eef67bd221c None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:47:31.883942 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe006a7-42c2-419c-b157-6eef67bd221c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:47:31.944618 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-2fe006a7-42c2-419c-b157-6eef67bd221c None None] MFA Rules not processed for user `bd2e61912e8b42619d0a5c78f414ccba`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:47:31.945810 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-2fe006a7-42c2-419c-b157-6eef67bd221c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:47:32.031949 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 745/1502] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:47:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:47:32.044982 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f8d55-3e56-40b8-847d-28c370b8047e None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:47:32.045265 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f8d55-3e56-40b8-847d-28c370b8047e None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:47:32.045562 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f8d55-3e56-40b8-847d-28c370b8047e None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:47:32.046916 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 758/1503] 10.222.0.46 () {54 vars in 964 bytes} [Wed Aug 3 12:47:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:47:32.051575 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d7b0f-4d32-46c8-b6c0-b2506aa4ad2b None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:47:32.051868 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d7b0f-4d32-46c8-b6c0-b2506aa4ad2b None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:47:32.052148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d7b0f-4d32-46c8-b6c0-b2506aa4ad2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:47:32.083496 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:47:32.129206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-279d7b0f-4d32-46c8-b6c0-b2506aa4ad2b None None] MFA Rules not processed for user `603adceaefb94e218cc1e683529a60b5`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:47:32.130462 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-279d7b0f-4d32-46c8-b6c0-b2506aa4ad2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:47:32.207617 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 746/1504] 10.222.0.46 () {58 vars in 1061 bytes} [Wed Aug 3 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:47:32.215342 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f8d55-3e56-40b8-847d-28c370b8047e None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:47:32.216894 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-ae5f8d55-3e56-40b8-847d-28c370b8047e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:47:32.268523 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:47:32.321258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f8d55-3e56-40b8-847d-28c370b8047e None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:47:32.393739 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545e85a-69d9-47e9-8ec9-60b044e5a9f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:47:32.394410 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545e85a-69d9-47e9-8ec9-60b044e5a9f3 service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:47:32.394687 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545e85a-69d9-47e9-8ec9-60b044e5a9f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:47:32.394956 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545e85a-69d9-47e9-8ec9-60b044e5a9f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:47:32.396587 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-6545e85a-69d9-47e9-8ec9-60b044e5a9f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:47:32.502492 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6545e85a-69d9-47e9-8ec9-60b044e5a9f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:47:32.503927 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6545e85a-69d9-47e9-8ec9-60b044e5a9f3 service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:47:32.507384 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:47:32.522447 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 759/1505] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:47:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:47:32.567807 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cc1ed-fc38-482c-a8ee-e08555d15de3 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:47:32.568252 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cc1ed-fc38-482c-a8ee-e08555d15de3 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:47:32.568391 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cc1ed-fc38-482c-a8ee-e08555d15de3 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:47:32.569700 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 747/1506] 10.222.0.46 () {52 vars in 830 bytes} [Wed Aug 3 12:47:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:47:32.573176 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545e85a-69d9-47e9-8ec9-60b044e5a9f3 service cinder] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:47:32.574419 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-6545e85a-69d9-47e9-8ec9-60b044e5a9f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:47:32.672308 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545e85a-69d9-47e9-8ec9-60b044e5a9f3 service cinder] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:47:32.766701 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569283d-ac78-45ba-a551-65bdb8288f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:47:32.767335 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569283d-ac78-45ba-a551-65bdb8288f01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:47:32.767523 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569283d-ac78-45ba-a551-65bdb8288f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:47:32.767797 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569283d-ac78-45ba-a551-65bdb8288f01 admin admin] PATH_INFO: `/v3/users/bd2e61912e8b42619d0a5c78f414ccba` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:47:32.779783 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a569283d-ac78-45ba-a551-65bdb8288f01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd2e61912e8b42619d0a5c78f414ccba)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:47:32.781314 dv-cinder-850836-4-smb devstack@keystone.service[91789]: WARNING py.warnings [None req-a569283d-ac78-45ba-a551-65bdb8288f01 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:47:32.781314 dv-cinder-850836-4-smb devstack@keystone.service[91789]: warnings.warn(msg) Aug 03 12:47:32.781314 dv-cinder-850836-4-smb devstack@keystone.service[91789]: Aug 03 12:47:32.782555 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a569283d-ac78-45ba-a551-65bdb8288f01 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:47:32.791969 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:47:32.847329 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-a569283d-ac78-45ba-a551-65bdb8288f01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd2e61912e8b42619d0a5c78f414ccba'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:47:32.847907 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-a569283d-ac78-45ba-a551-65bdb8288f01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd2e61912e8b42619d0a5c78f414ccba'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:47:32.848335 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-a569283d-ac78-45ba-a551-65bdb8288f01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd2e61912e8b42619d0a5c78f414ccba'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:47:32.870835 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-a569283d-ac78-45ba-a551-65bdb8288f01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd2e61912e8b42619d0a5c78f414ccba'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:47:32.884681 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-a569283d-ac78-45ba-a551-65bdb8288f01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd2e61912e8b42619d0a5c78f414ccba'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:47:32.899413 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 760/1507] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:47:32 2022] DELETE /identity/v3/users/bd2e61912e8b42619d0a5c78f414ccba => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:47:32.904001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07f9e0-1f79-40cc-b1bc-b0b2dd203b70 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:47:32.904292 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07f9e0-1f79-40cc-b1bc-b0b2dd203b70 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:47:32.904569 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07f9e0-1f79-40cc-b1bc-b0b2dd203b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:47:32.962471 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-ca07f9e0-1f79-40cc-b1bc-b0b2dd203b70 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:47:32.963680 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-ca07f9e0-1f79-40cc-b1bc-b0b2dd203b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:47:33.041445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:47:33.056256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 748/1508] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:47:33.065960 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569283d-ac78-45ba-a551-65bdb8288f01 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:47:33.067338 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-a569283d-ac78-45ba-a551-65bdb8288f01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:47:33.167162 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569283d-ac78-45ba-a551-65bdb8288f01 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:47:33.221901 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:47:33.242191 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40564c-e93c-4211-9808-083de6049756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:47:33.242809 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40564c-e93c-4211-9808-083de6049756 service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:47:33.243088 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40564c-e93c-4211-9808-083de6049756 service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:47:33.243359 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40564c-e93c-4211-9808-083de6049756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:47:33.244974 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-de40564c-e93c-4211-9808-083de6049756 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:47:33.354959 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40564c-e93c-4211-9808-083de6049756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:47:33.356323 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40564c-e93c-4211-9808-083de6049756 service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:47:33.374853 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 761/1509] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:47:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:47:33.800102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07f9e0-1f79-40cc-b1bc-b0b2dd203b70 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:47:33.801395 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-ca07f9e0-1f79-40cc-b1bc-b0b2dd203b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:47:33.813309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07f9e0-1f79-40cc-b1bc-b0b2dd203b70 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:47:33.912479 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e2d69f-275c-438f-b3ec-031c8b841a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:47:33.913047 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2d69f-275c-438f-b3ec-031c8b841a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:47:33.913328 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2d69f-275c-438f-b3ec-031c8b841a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:47:33.913640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2d69f-275c-438f-b3ec-031c8b841a18 admin admin] PATH_INFO: `/v3/projects/97230fefd5344dbf80bce83a35eb158a` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:47:33.924956 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e2d69f-275c-438f-b3ec-031c8b841a18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97230fefd5344dbf80bce83a35eb158a)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:47:33.926018 dv-cinder-850836-4-smb devstack@keystone.service[91788]: WARNING py.warnings [None req-93e2d69f-275c-438f-b3ec-031c8b841a18 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:47:33.926018 dv-cinder-850836-4-smb devstack@keystone.service[91788]: warnings.warn(msg) Aug 03 12:47:33.926018 dv-cinder-850836-4-smb devstack@keystone.service[91788]: Aug 03 12:47:33.927212 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e2d69f-275c-438f-b3ec-031c8b841a18 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:47:33.992902 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-93e2d69f-275c-438f-b3ec-031c8b841a18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97230fefd5344dbf80bce83a35eb158a', 'request_id': 'req-93e2d69f-275c-438f-b3ec-031c8b841a18'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:47:34.006273 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-93e2d69f-275c-438f-b3ec-031c8b841a18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97230fefd5344dbf80bce83a35eb158a', 'request_id': 'req-93e2d69f-275c-438f-b3ec-031c8b841a18'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:47:34.012325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-93e2d69f-275c-438f-b3ec-031c8b841a18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97230fefd5344dbf80bce83a35eb158a', 'request_id': 'req-93e2d69f-275c-438f-b3ec-031c8b841a18'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:47:34.038141 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-93e2d69f-275c-438f-b3ec-031c8b841a18 admin admin] The token cache is being invalidate because project 97230fefd5344dbf80bce83a35eb158a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:47:34.038429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-93e2d69f-275c-438f-b3ec-031c8b841a18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:47:34.038949 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-93e2d69f-275c-438f-b3ec-031c8b841a18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:47:34.040290 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 749/1510] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:47:33 2022] DELETE /identity/v3/projects/97230fefd5344dbf80bce83a35eb158a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:47:43.372664 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=62 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:47:44.036094 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:49:21.500744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2610e9-c8bf-41eb-aec0-85b03c7ec48f None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:49:21.501361 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2610e9-c8bf-41eb-aec0-85b03c7ec48f None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:49:21.501361 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2610e9-c8bf-41eb-aec0-85b03c7ec48f None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:49:21.502730 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 762/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 12:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:49:21.507923 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f5dff-db21-4565-9427-dfe70f2a0716 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:49:21.508361 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f5dff-db21-4565-9427-dfe70f2a0716 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:49:21.508497 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f5dff-db21-4565-9427-dfe70f2a0716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:49:21.592075 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-4b2f5dff-db21-4565-9427-dfe70f2a0716 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:49:21.593414 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-4b2f5dff-db21-4565-9427-dfe70f2a0716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:49:21.703980 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 750/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 12:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:49:21.857308 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2610e9-c8bf-41eb-aec0-85b03c7ec48f None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:49:21.859424 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-3e2610e9-c8bf-41eb-aec0-85b03c7ec48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:49:21.983617 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2610e9-c8bf-41eb-aec0-85b03c7ec48f None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:49:21.989126 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ba624-4a21-463e-82cd-02c56488e3f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:49:21.989769 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ba624-4a21-463e-82cd-02c56488e3f9 service nova] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:49:21.990558 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ba624-4a21-463e-82cd-02c56488e3f9 service nova] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:49:21.990829 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ba624-4a21-463e-82cd-02c56488e3f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:49:21.999283 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ba624-4a21-463e-82cd-02c56488e3f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:49:22.000856 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ba624-4a21-463e-82cd-02c56488e3f9 service nova] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:49:22.011067 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 763/1513] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:49:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:49:22.840541 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3f76c-b66a-40d9-9f9e-cbf717c48a71 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:49:22.841135 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3f76c-b66a-40d9-9f9e-cbf717c48a71 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:49:22.841135 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3f76c-b66a-40d9-9f9e-cbf717c48a71 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:49:22.842514 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 751/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 12:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:49:22.847493 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564a94d-f855-4e9d-a676-959e9bf27281 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:49:22.847896 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564a94d-f855-4e9d-a676-959e9bf27281 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:49:22.848048 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564a94d-f855-4e9d-a676-959e9bf27281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:49:22.868286 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-c564a94d-f855-4e9d-a676-959e9bf27281 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:49:22.869525 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-c564a94d-f855-4e9d-a676-959e9bf27281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:49:22.877802 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 764/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 12:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:49:23.028416 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3f76c-b66a-40d9-9f9e-cbf717c48a71 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:49:23.043199 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3f76c-b66a-40d9-9f9e-cbf717c48a71 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:49:23.048902 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abaf7d5-50c9-499c-b6cc-66c45116e2ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:49:23.049535 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abaf7d5-50c9-499c-b6cc-66c45116e2ea service nova] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:49:23.049822 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abaf7d5-50c9-499c-b6cc-66c45116e2ea service nova] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:49:23.050096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abaf7d5-50c9-499c-b6cc-66c45116e2ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:49:23.059577 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abaf7d5-50c9-499c-b6cc-66c45116e2ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:49:23.061183 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abaf7d5-50c9-499c-b6cc-66c45116e2ea service nova] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:49:23.070679 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 752/1516] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:49:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:49:23.447747 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6549e-a245-4169-b2e6-b0311bfcc6f6 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:49:23.447947 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6549e-a245-4169-b2e6-b0311bfcc6f6 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:49:23.448216 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6549e-a245-4169-b2e6-b0311bfcc6f6 None None] PATH_INFO: `/v3` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:49:23.449571 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 765/1517] 10.222.0.48 () {54 vars in 925 bytes} [Wed Aug 3 12:49:23 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:49:23.455569 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609307d-3aa9-47b9-9c93-11e2eebc7b54 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:49:23.455860 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609307d-3aa9-47b9-9c93-11e2eebc7b54 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:49:23.456142 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609307d-3aa9-47b9-9c93-11e2eebc7b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:49:23.519337 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-c609307d-3aa9-47b9-9c93-11e2eebc7b54 None None] MFA Rules not processed for user `a56847173abb48d39c0ee6fb9cdbbbaa`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:49:23.520563 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-c609307d-3aa9-47b9-9c93-11e2eebc7b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:49:23.538240 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:49:23.592460 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 753/1518] 10.222.0.48 () {58 vars in 1015 bytes} [Wed Aug 3 12:49:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:49:32.755633 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25012c7d-9f6b-4ac4-9010-191682a39a33 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:49:32.756186 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25012c7d-9f6b-4ac4-9010-191682a39a33 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:49:32.756186 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25012c7d-9f6b-4ac4-9010-191682a39a33 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:49:32.757832 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 766/1519] 10.222.0.46 () {54 vars in 961 bytes} [Wed Aug 3 12:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:49:32.762748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6085f2a-2bde-4606-8614-dbac9afffc38 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:49:32.763145 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6085f2a-2bde-4606-8614-dbac9afffc38 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:49:32.763329 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6085f2a-2bde-4606-8614-dbac9afffc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:49:32.783036 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-b6085f2a-2bde-4606-8614-dbac9afffc38 None None] MFA Rules not processed for user `a56847173abb48d39c0ee6fb9cdbbbaa`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:49:32.784248 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-b6085f2a-2bde-4606-8614-dbac9afffc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:49:32.794349 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 754/1520] 10.222.0.46 () {58 vars in 1058 bytes} [Wed Aug 3 12:49:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:49:32.801673 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25012c7d-9f6b-4ac4-9010-191682a39a33 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:49:32.815422 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25012c7d-9f6b-4ac4-9010-191682a39a33 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:49:32.820420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186e55d-e26d-4fc8-a5da-883198acd284 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56847173abb48d39c0ee6fb9cdbbbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:49:32.821012 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186e55d-e26d-4fc8-a5da-883198acd284 service placement] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:49:32.821300 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186e55d-e26d-4fc8-a5da-883198acd284 service placement] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:49:32.821603 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186e55d-e26d-4fc8-a5da-883198acd284 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:49:32.829766 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8186e55d-e26d-4fc8-a5da-883198acd284 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:49:32.831352 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8186e55d-e26d-4fc8-a5da-883198acd284 service placement] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:49:32.840940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 767/1521] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:49:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:49:34.384094 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ba66f-044a-4582-8cbd-4c599db00920 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:49:34.384676 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ba66f-044a-4582-8cbd-4c599db00920 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:49:34.384676 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ba66f-044a-4582-8cbd-4c599db00920 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:49:34.386022 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 755/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 12:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:49:34.390710 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d275985-64da-4272-b175-0ade673a2493 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:49:34.391147 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d275985-64da-4272-b175-0ade673a2493 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:49:34.391253 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d275985-64da-4272-b175-0ade673a2493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:49:34.411005 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-6d275985-64da-4272-b175-0ade673a2493 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:49:34.412208 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-6d275985-64da-4272-b175-0ade673a2493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:49:34.420534 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 768/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 12:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:49:34.573879 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ba66f-044a-4582-8cbd-4c599db00920 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:49:34.588168 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ba66f-044a-4582-8cbd-4c599db00920 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:49:34.593529 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918f1ef-e891-4188-831b-251d700417e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:49:34.594132 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918f1ef-e891-4188-831b-251d700417e8 service nova] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:49:34.594409 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918f1ef-e891-4188-831b-251d700417e8 service nova] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:49:34.594681 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918f1ef-e891-4188-831b-251d700417e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:49:34.603128 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918f1ef-e891-4188-831b-251d700417e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:49:34.604699 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918f1ef-e891-4188-831b-251d700417e8 service nova] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:49:34.613907 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 756/1524] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:49:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:49:35.427173 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a23be8-3515-4bf4-b49f-1d571311aeea None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:49:35.427718 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a23be8-3515-4bf4-b49f-1d571311aeea None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:49:35.427718 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a23be8-3515-4bf4-b49f-1d571311aeea None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:49:35.429252 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 769/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 3 12:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:49:35.433953 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b8bbb-9fc1-4d2b-b61b-9fa0b19ce98f None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:49:35.434446 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b8bbb-9fc1-4d2b-b61b-9fa0b19ce98f None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:49:35.434550 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b8bbb-9fc1-4d2b-b61b-9fa0b19ce98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:49:35.453376 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-305b8bbb-9fc1-4d2b-b61b-9fa0b19ce98f None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:49:35.454593 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-305b8bbb-9fc1-4d2b-b61b-9fa0b19ce98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:49:35.463139 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 757/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 3 12:49:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:49:35.617756 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a23be8-3515-4bf4-b49f-1d571311aeea None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:49:35.632998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a23be8-3515-4bf4-b49f-1d571311aeea None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:49:35.638466 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6035b-2faa-4cb4-9486-e8ccc9c3ab8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:49:35.639065 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6035b-2faa-4cb4-9486-e8ccc9c3ab8a service nova] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:49:35.639346 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6035b-2faa-4cb4-9486-e8ccc9c3ab8a service nova] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:49:35.639618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6035b-2faa-4cb4-9486-e8ccc9c3ab8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:49:35.648352 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6035b-2faa-4cb4-9486-e8ccc9c3ab8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:49:35.649961 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6035b-2faa-4cb4-9486-e8ccc9c3ab8a service nova] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:49:35.659287 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 770/1527] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:49:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:49:39.560021 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f5ae7-9310-4e09-bafb-8bdd261075d6 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:49:39.560592 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f5ae7-9310-4e09-bafb-8bdd261075d6 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:49:39.560592 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f5ae7-9310-4e09-bafb-8bdd261075d6 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:49:39.561958 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 758/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:49:39.567171 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa0a7a-74ac-42e5-b8e0-b0e11d76b876 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:49:39.567596 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa0a7a-74ac-42e5-b8e0-b0e11d76b876 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:49:39.567760 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa0a7a-74ac-42e5-b8e0-b0e11d76b876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:49:39.587935 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-b7aa0a7a-74ac-42e5-b8e0-b0e11d76b876 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:49:39.589142 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-b7aa0a7a-74ac-42e5-b8e0-b0e11d76b876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:49:39.597069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 771/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:49:39.669837 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f5ae7-9310-4e09-bafb-8bdd261075d6 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:49:39.671519 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-711f5ae7-9310-4e09-bafb-8bdd261075d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:49:39.749057 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f5ae7-9310-4e09-bafb-8bdd261075d6 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:49:39.752655 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5b494-32ef-43a6-845e-7406e30f37de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:49:39.753271 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5b494-32ef-43a6-845e-7406e30f37de service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:49:39.753572 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5b494-32ef-43a6-845e-7406e30f37de service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:49:39.753852 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5b494-32ef-43a6-845e-7406e30f37de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:49:39.763332 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5b494-32ef-43a6-845e-7406e30f37de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:49:39.764787 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5b494-32ef-43a6-845e-7406e30f37de service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:49:39.774944 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 759/1530] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:49:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:49:41.752014 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052b9d8-9ba4-4caa-a006-66d259dae773 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:49:41.752593 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052b9d8-9ba4-4caa-a006-66d259dae773 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:49:41.752593 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052b9d8-9ba4-4caa-a006-66d259dae773 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:49:41.753947 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 772/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:49:41.759141 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b325db7-69c8-45c2-946f-aa203f39cf82 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:49:41.759562 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b325db7-69c8-45c2-946f-aa203f39cf82 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:49:41.759800 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b325db7-69c8-45c2-946f-aa203f39cf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:49:41.779090 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-3b325db7-69c8-45c2-946f-aa203f39cf82 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:49:41.780299 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-3b325db7-69c8-45c2-946f-aa203f39cf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:49:41.788947 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 760/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:49:41.824593 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052b9d8-9ba4-4caa-a006-66d259dae773 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:49:41.835510 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052b9d8-9ba4-4caa-a006-66d259dae773 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:49:41.839082 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ec9e7-3589-4df4-bd89-697a05b11753 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:49:41.839681 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ec9e7-3589-4df4-bd89-697a05b11753 service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:49:41.839964 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ec9e7-3589-4df4-bd89-697a05b11753 service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:49:41.840240 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ec9e7-3589-4df4-bd89-697a05b11753 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:49:41.849101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ec9e7-3589-4df4-bd89-697a05b11753 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:49:41.851142 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ec9e7-3589-4df4-bd89-697a05b11753 service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:49:41.860489 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 773/1533] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:49:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:49:45.236096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19737186-efed-4629-9956-3ceb274270ea None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:49:45.236590 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19737186-efed-4629-9956-3ceb274270ea None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:49:45.236693 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19737186-efed-4629-9956-3ceb274270ea None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:49:45.238066 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 761/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:49:45.243086 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff47d3-7944-40f1-bce1-c262fbd2a771 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:49:45.243498 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff47d3-7944-40f1-bce1-c262fbd2a771 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:49:45.243635 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff47d3-7944-40f1-bce1-c262fbd2a771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:49:45.251478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=81 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:49:45.264460 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-2fff47d3-7944-40f1-bce1-c262fbd2a771 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:49:45.265711 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-2fff47d3-7944-40f1-bce1-c262fbd2a771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:49:45.274607 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 774/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:49:45.584202 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19737186-efed-4629-9956-3ceb274270ea None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:49:45.586621 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-19737186-efed-4629-9956-3ceb274270ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:49:45.651651 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:49:45.665410 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19737186-efed-4629-9956-3ceb274270ea None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:49:45.669084 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5016a-7a42-4ed6-a2b3-a766018fc8c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:49:45.669740 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5016a-7a42-4ed6-a2b3-a766018fc8c5 service cinder] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:49:45.670025 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5016a-7a42-4ed6-a2b3-a766018fc8c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:49:45.670301 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5016a-7a42-4ed6-a2b3-a766018fc8c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:49:45.679566 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b5016a-7a42-4ed6-a2b3-a766018fc8c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:49:45.680988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b5016a-7a42-4ed6-a2b3-a766018fc8c5 service cinder] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:49:45.690309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 762/1536] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:49:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:49:47.711752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220417bd-b886-4166-b17a-10d83c506118 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:49:47.712336 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220417bd-b886-4166-b17a-10d83c506118 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:49:47.712336 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220417bd-b886-4166-b17a-10d83c506118 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:49:47.713722 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 775/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Aug 3 12:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:49:47.718843 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d1f77-869c-4a08-9bb1-00506b5983ef None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:49:47.719251 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d1f77-869c-4a08-9bb1-00506b5983ef None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:49:47.719402 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d1f77-869c-4a08-9bb1-00506b5983ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:49:47.739843 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-266d1f77-869c-4a08-9bb1-00506b5983ef None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:49:47.741173 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-266d1f77-869c-4a08-9bb1-00506b5983ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:49:47.749429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 763/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Aug 3 12:49:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:49:48.057472 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220417bd-b886-4166-b17a-10d83c506118 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:49:48.059209 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-220417bd-b886-4166-b17a-10d83c506118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:49:48.072851 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220417bd-b886-4166-b17a-10d83c506118 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:49:48.076517 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47f577-0cab-434e-aeb3-26ef491b8a0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:49:48.077116 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47f577-0cab-434e-aeb3-26ef491b8a0c service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:49:48.077400 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47f577-0cab-434e-aeb3-26ef491b8a0c service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:49:48.077708 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47f577-0cab-434e-aeb3-26ef491b8a0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:49:48.087401 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a47f577-0cab-434e-aeb3-26ef491b8a0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:49:48.088841 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a47f577-0cab-434e-aeb3-26ef491b8a0c service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:49:48.098432 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 776/1539] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:49:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:49:57.735006 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=11 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:49:58.094154 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=8 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:27.542457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1806de9-b022-40e0-a33b-d2ebb10c037f None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:27.543097 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1806de9-b022-40e0-a33b-d2ebb10c037f None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:27.543097 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1806de9-b022-40e0-a33b-d2ebb10c037f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:27.568947 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-e1806de9-b022-40e0-a33b-d2ebb10c037f None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:27.570227 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-e1806de9-b022-40e0-a33b-d2ebb10c037f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:27.583327 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 764/1540] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:51:27.592015 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe68e6-9b8f-467c-bfe0-457bb95da2e9 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:27.592588 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe68e6-9b8f-467c-bfe0-457bb95da2e9 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:27.592588 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe68e6-9b8f-467c-bfe0-457bb95da2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:27.605116 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef89677-facb-47cc-a9dd-2f5fa0328f23 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:27.605430 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef89677-facb-47cc-a9dd-2f5fa0328f23 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:27.605717 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef89677-facb-47cc-a9dd-2f5fa0328f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:27.620436 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-b1fe68e6-9b8f-467c-bfe0-457bb95da2e9 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:27.621703 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-b1fe68e6-9b8f-467c-bfe0-457bb95da2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:27.635397 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-9ef89677-facb-47cc-a9dd-2f5fa0328f23 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:27.636643 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-9ef89677-facb-47cc-a9dd-2f5fa0328f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:27.637860 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 777/1541] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:27.645109 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe68e6-9b8f-467c-bfe0-457bb95da2e9 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:27.654029 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 765/1542] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:51:27.658641 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe68e6-9b8f-467c-bfe0-457bb95da2e9 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:27.664064 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f05d2-1de6-4f98-bf39-dbd7e122d616 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:27.664356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f05d2-1de6-4f98-bf39-dbd7e122d616 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:27.664640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f05d2-1de6-4f98-bf39-dbd7e122d616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:27.666919 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626c0a8-d9f8-4d25-9e6d-56ad13ce65b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:27.667863 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626c0a8-d9f8-4d25-9e6d-56ad13ce65b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:27.668241 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626c0a8-d9f8-4d25-9e6d-56ad13ce65b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:27.668523 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626c0a8-d9f8-4d25-9e6d-56ad13ce65b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:27.669244 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626c0a8-d9f8-4d25-9e6d-56ad13ce65b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:27.669650 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626c0a8-d9f8-4d25-9e6d-56ad13ce65b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:27.670672 dv-cinder-850836-4-smb devstack@keystone.service[91789]: WARNING py.warnings [None req-1626c0a8-d9f8-4d25-9e6d-56ad13ce65b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:51:27.670672 dv-cinder-850836-4-smb devstack@keystone.service[91789]: warnings.warn(msg) Aug 03 12:51:27.670672 dv-cinder-850836-4-smb devstack@keystone.service[91789]: Aug 03 12:51:27.671543 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626c0a8-d9f8-4d25-9e6d-56ad13ce65b4 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:27.691272 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 778/1543] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:27.703363 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98f785-9da6-437c-b8e0-802b22d13a3a None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:27.703668 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98f785-9da6-437c-b8e0-802b22d13a3a None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:27.704079 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98f785-9da6-437c-b8e0-802b22d13a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:27.707802 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-336f05d2-1de6-4f98-bf39-dbd7e122d616 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:27.709022 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-336f05d2-1de6-4f98-bf39-dbd7e122d616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:27.740452 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 766/1544] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:27.742171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f05d2-1de6-4f98-bf39-dbd7e122d616 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:27.760616 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-db98f785-9da6-437c-b8e0-802b22d13a3a None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:27.762839 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-db98f785-9da6-437c-b8e0-802b22d13a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:27.764941 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f05d2-1de6-4f98-bf39-dbd7e122d616 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:27.781314 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ecb0c-050c-4098-ad43-b956429b3732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:27.782937 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ecb0c-050c-4098-ad43-b956429b3732 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:27.783791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ecb0c-050c-4098-ad43-b956429b3732 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:27.784077 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ecb0c-050c-4098-ad43-b956429b3732 admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:27.784763 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ecb0c-050c-4098-ad43-b956429b3732 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:27.785817 dv-cinder-850836-4-smb devstack@keystone.service[91788]: WARNING py.warnings [None req-670ecb0c-050c-4098-ad43-b956429b3732 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:51:27.785817 dv-cinder-850836-4-smb devstack@keystone.service[91788]: warnings.warn(msg) Aug 03 12:51:27.785817 dv-cinder-850836-4-smb devstack@keystone.service[91788]: Aug 03 12:51:27.787010 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ecb0c-050c-4098-ad43-b956429b3732 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:27.791024 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 779/1545] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:27.794815 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98f785-9da6-437c-b8e0-802b22d13a3a None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:27.816479 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98f785-9da6-437c-b8e0-802b22d13a3a None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:27.828607 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe01687-9d5d-4de6-85c2-e260aa98cb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:27.829243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe01687-9d5d-4de6-85c2-e260aa98cb8a admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:27.829542 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe01687-9d5d-4de6-85c2-e260aa98cb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:27.829821 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe01687-9d5d-4de6-85c2-e260aa98cb8a admin admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:27.830523 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe01687-9d5d-4de6-85c2-e260aa98cb8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:27.830826 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe01687-9d5d-4de6-85c2-e260aa98cb8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:27.832414 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe01687-9d5d-4de6-85c2-e260aa98cb8a admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:27.846491 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 780/1546] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:27.847782 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7afc49-264a-4451-977d-22d9385ca595 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:27.848073 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7afc49-264a-4451-977d-22d9385ca595 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:27.848350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7afc49-264a-4451-977d-22d9385ca595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:27.852506 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 767/1547] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:51:27 2022] POST /identity/v3/projects => generated 403 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:27.858448 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e7dab-3445-43fc-9273-0be312417df5 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:27.859166 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e7dab-3445-43fc-9273-0be312417df5 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:27.859650 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e7dab-3445-43fc-9273-0be312417df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:27.870650 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-5b7afc49-264a-4451-977d-22d9385ca595 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:27.871528 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-5b7afc49-264a-4451-977d-22d9385ca595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:27.885899 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-827e7dab-3445-43fc-9273-0be312417df5 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:27.887548 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-827e7dab-3445-43fc-9273-0be312417df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:27.936345 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 781/1548] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:27.937675 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064fc3d-54e2-4c23-9a53-c3d80b69f8c1 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:27.937955 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064fc3d-54e2-4c23-9a53-c3d80b69f8c1 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:27.938227 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064fc3d-54e2-4c23-9a53-c3d80b69f8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:27.955751 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 768/1549] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:27.957429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fac792-f09a-445a-bbac-2a996547248a None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:27.957868 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fac792-f09a-445a-bbac-2a996547248a None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:27.958157 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fac792-f09a-445a-bbac-2a996547248a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:27.960027 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-2064fc3d-54e2-4c23-9a53-c3d80b69f8c1 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:27.961238 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-2064fc3d-54e2-4c23-9a53-c3d80b69f8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:27.969843 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 782/1550] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:27.970657 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064fc3d-54e2-4c23-9a53-c3d80b69f8c1 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:27.980306 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-39fac792-f09a-445a-bbac-2a996547248a None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:27.980805 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064fc3d-54e2-4c23-9a53-c3d80b69f8c1 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:27.981555 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-39fac792-f09a-445a-bbac-2a996547248a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:27.985523 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad6041-8698-4a5b-b467-aec13e056117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:27.986240 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad6041-8698-4a5b-b467-aec13e056117 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:27.986518 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad6041-8698-4a5b-b467-aec13e056117 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:27.986805 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad6041-8698-4a5b-b467-aec13e056117 admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:27.987471 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad6041-8698-4a5b-b467-aec13e056117 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:27.989372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad6041-8698-4a5b-b467-aec13e056117 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:27.990300 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 769/1551] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:27.991061 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fac792-f09a-445a-bbac-2a996547248a None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:28.001277 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fac792-f09a-445a-bbac-2a996547248a None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:28.006010 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea86631-bb3b-41c4-b66e-a2294cc0a928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:28.006619 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea86631-bb3b-41c4-b66e-a2294cc0a928 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.006908 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea86631-bb3b-41c4-b66e-a2294cc0a928 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.007185 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea86631-bb3b-41c4-b66e-a2294cc0a928 admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.007847 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea86631-bb3b-41c4-b66e-a2294cc0a928 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:28.010409 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea86631-bb3b-41c4-b66e-a2294cc0a928 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:28.023452 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 783/1552] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:51:27 2022] POST /identity/v3/projects => generated 389 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:28.025726 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1b9e7-87c0-4292-a691-27ca16c7d390 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.026056 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1b9e7-87c0-4292-a691-27ca16c7d390 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.026335 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1b9e7-87c0-4292-a691-27ca16c7d390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.034125 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 770/1553] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:51:27 2022] POST /identity/v3/users => generated 302 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:28.035335 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5358b-2d32-4949-a466-de84b1231210 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.035694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5358b-2d32-4949-a466-de84b1231210 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.036046 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5358b-2d32-4949-a466-de84b1231210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.045641 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-84f1b9e7-87c0-4292-a691-27ca16c7d390 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:28.046853 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-84f1b9e7-87c0-4292-a691-27ca16c7d390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:28.055317 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-d6e5358b-2d32-4949-a466-de84b1231210 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:28.057058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-d6e5358b-2d32-4949-a466-de84b1231210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:28.109108 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 784/1554] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:28.110526 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fa7c6-c0b5-4499-a901-69934b070eff None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.110876 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fa7c6-c0b5-4499-a901-69934b070eff None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.111221 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fa7c6-c0b5-4499-a901-69934b070eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.119036 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 771/1555] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:28.120156 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5358b-2d32-4949-a466-de84b1231210 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:28.131454 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-1e8fa7c6-c0b5-4499-a901-69934b070eff None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:28.131920 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5358b-2d32-4949-a466-de84b1231210 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:28.132677 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-1e8fa7c6-c0b5-4499-a901-69934b070eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:28.137260 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5bb6b-04a0-489a-a9c5-6988220ef421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:28.137872 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5bb6b-04a0-489a-a9c5-6988220ef421 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.138155 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5bb6b-04a0-489a-a9c5-6988220ef421 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.138429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5bb6b-04a0-489a-a9c5-6988220ef421 admin admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.139189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5bb6b-04a0-489a-a9c5-6988220ef421 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:28.139434 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5bb6b-04a0-489a-a9c5-6988220ef421 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:28.141028 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5bb6b-04a0-489a-a9c5-6988220ef421 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:28.141585 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 785/1556] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:28.142785 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b60cbe-1d5d-4195-9793-515d70b17b6a None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.143072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b60cbe-1d5d-4195-9793-515d70b17b6a None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.143348 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b60cbe-1d5d-4195-9793-515d70b17b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.154988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 772/1557] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:28.156150 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ad4ce-25c1-47a4-8983-0d33e13b9703 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.156665 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ad4ce-25c1-47a4-8983-0d33e13b9703 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.156947 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ad4ce-25c1-47a4-8983-0d33e13b9703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.163059 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-a1b60cbe-1d5d-4195-9793-515d70b17b6a None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:28.164297 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-a1b60cbe-1d5d-4195-9793-515d70b17b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:28.172709 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 786/1558] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:28.173479 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b60cbe-1d5d-4195-9793-515d70b17b6a None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:28.177079 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-e46ad4ce-25c1-47a4-8983-0d33e13b9703 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:28.178323 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-e46ad4ce-25c1-47a4-8983-0d33e13b9703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:28.186180 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b60cbe-1d5d-4195-9793-515d70b17b6a None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:28.187621 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 773/1559] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:28.188615 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ad4ce-25c1-47a4-8983-0d33e13b9703 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:28.194513 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d8df5-1171-4681-b8c6-748aa2062b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:28.195148 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d8df5-1171-4681-b8c6-748aa2062b09 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.195476 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d8df5-1171-4681-b8c6-748aa2062b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.195761 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d8df5-1171-4681-b8c6-748aa2062b09 admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.197054 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d8df5-1171-4681-b8c6-748aa2062b09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:28.198182 dv-cinder-850836-4-smb devstack@keystone.service[91789]: WARNING py.warnings [None req-c38d8df5-1171-4681-b8c6-748aa2062b09 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:51:28.198182 dv-cinder-850836-4-smb devstack@keystone.service[91789]: warnings.warn(msg) Aug 03 12:51:28.198182 dv-cinder-850836-4-smb devstack@keystone.service[91789]: Aug 03 12:51:28.198976 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ad4ce-25c1-47a4-8983-0d33e13b9703 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:28.199491 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d8df5-1171-4681-b8c6-748aa2062b09 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:28.203708 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92db0ec-1907-478c-8474-de6a04686b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:28.204312 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92db0ec-1907-478c-8474-de6a04686b1f admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.204595 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92db0ec-1907-478c-8474-de6a04686b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.204871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92db0ec-1907-478c-8474-de6a04686b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.205603 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92db0ec-1907-478c-8474-de6a04686b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:28.207180 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92db0ec-1907-478c-8474-de6a04686b1f admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:28.208544 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:28.220574 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 774/1560] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:51:28.221945 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb467a57-3f9e-4517-aaf1-c0b5588a9fd6 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.222244 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb467a57-3f9e-4517-aaf1-c0b5588a9fd6 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.222581 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb467a57-3f9e-4517-aaf1-c0b5588a9fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.223573 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 787/1561] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:51:28 2022] POST /identity/v3/users => generated 295 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:28.224586 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5a36d-230b-4e3b-a704-21c8a3b77b7e None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.224871 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5a36d-230b-4e3b-a704-21c8a3b77b7e None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.225142 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5a36d-230b-4e3b-a704-21c8a3b77b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.232785 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:28.242445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-eb467a57-3f9e-4517-aaf1-c0b5588a9fd6 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:28.243910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-eb467a57-3f9e-4517-aaf1-c0b5588a9fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:28.245845 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-0af5a36d-230b-4e3b-a704-21c8a3b77b7e None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:28.247085 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-0af5a36d-230b-4e3b-a704-21c8a3b77b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:28.255679 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 775/1562] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:28.255679 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb467a57-3f9e-4517-aaf1-c0b5588a9fd6 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:28.255907 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 788/1563] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:28.256392 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5a36d-230b-4e3b-a704-21c8a3b77b7e None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:28.265079 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb467a57-3f9e-4517-aaf1-c0b5588a9fd6 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:28.269079 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5a36d-230b-4e3b-a704-21c8a3b77b7e None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:28.270617 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358a6f0-c7b5-4ae2-b24a-308edc5b3211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:28.271232 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358a6f0-c7b5-4ae2-b24a-308edc5b3211 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.271517 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358a6f0-c7b5-4ae2-b24a-308edc5b3211 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.271794 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358a6f0-c7b5-4ae2-b24a-308edc5b3211 admin admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.276179 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d358a6f0-c7b5-4ae2-b24a-308edc5b3211 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:28.276179 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d358a6f0-c7b5-4ae2-b24a-308edc5b3211 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:28.276179 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d358a6f0-c7b5-4ae2-b24a-308edc5b3211 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:28.276467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b67e41-05b1-4a40-a23c-a015f10d1c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:28.276467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b67e41-05b1-4a40-a23c-a015f10d1c1d admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.276467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b67e41-05b1-4a40-a23c-a015f10d1c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.276688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b67e41-05b1-4a40-a23c-a015f10d1c1d admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.277367 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b67e41-05b1-4a40-a23c-a015f10d1c1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:28.279847 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b67e41-05b1-4a40-a23c-a015f10d1c1d admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:28.287622 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 776/1564] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:28.288515 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358a6f0-c7b5-4ae2-b24a-308edc5b3211 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:28.299359 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358a6f0-c7b5-4ae2-b24a-308edc5b3211 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:28.305049 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5c770-1939-49d4-adea-d2899e24b8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:28.305850 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5c770-1939-49d4-adea-d2899e24b8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.306141 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5c770-1939-49d4-adea-d2899e24b8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.306417 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5c770-1939-49d4-adea-d2899e24b8b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.307122 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5c770-1939-49d4-adea-d2899e24b8b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:28.307426 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5c770-1939-49d4-adea-d2899e24b8b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:28.309012 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5c770-1939-49d4-adea-d2899e24b8b9 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:28.313251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 789/1565] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:51:28 2022] POST /identity/v3/projects => generated 389 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:28.314192 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b67e41-05b1-4a40-a23c-a015f10d1c1d admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:28.323422 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 777/1566] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:28.326484 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5c770-1939-49d4-adea-d2899e24b8b9 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:28.338020 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5c770-1939-49d4-adea-d2899e24b8b9 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:28.381584 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b67e41-05b1-4a40-a23c-a015f10d1c1d admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:28.387643 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4b846-51df-4ce8-8929-3f34904a76fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:28.388381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4b846-51df-4ce8-8929-3f34904a76fa admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.388665 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4b846-51df-4ce8-8929-3f34904a76fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.389003 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4b846-51df-4ce8-8929-3f34904a76fa admin admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.389785 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4b846-51df-4ce8-8929-3f34904a76fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:28.390097 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4b846-51df-4ce8-8929-3f34904a76fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:28.391707 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4b846-51df-4ce8-8929-3f34904a76fa admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:28.396657 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c7324-be1d-4c25-9c47-0c490ad9d848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:28.397278 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c7324-be1d-4c25-9c47-0c490ad9d848 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.397596 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c7324-be1d-4c25-9c47-0c490ad9d848 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.397876 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c7324-be1d-4c25-9c47-0c490ad9d848 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.398601 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c7324-be1d-4c25-9c47-0c490ad9d848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:28.400947 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c7324-be1d-4c25-9c47-0c490ad9d848 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:28.405229 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 790/1567] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:28.406208 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4b846-51df-4ce8-8929-3f34904a76fa admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:28.417814 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 778/1568] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:51:28.418570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4b846-51df-4ce8-8929-3f34904a76fa admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:28.418778 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c7324-be1d-4c25-9c47-0c490ad9d848 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:28.424521 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db23130-b016-4b49-b11c-dc83ffb5b65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:28.425207 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db23130-b016-4b49-b11c-dc83ffb5b65d admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.425535 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db23130-b016-4b49-b11c-dc83ffb5b65d admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.425847 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db23130-b016-4b49-b11c-dc83ffb5b65d admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.426647 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db23130-b016-4b49-b11c-dc83ffb5b65d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:28.428434 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c7324-be1d-4c25-9c47-0c490ad9d848 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:28.428556 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db23130-b016-4b49-b11c-dc83ffb5b65d admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:28.433643 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928a9bb-efa1-4088-b89b-b0ff154acac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:28.434247 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928a9bb-efa1-4088-b89b-b0ff154acac8 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.434533 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928a9bb-efa1-4088-b89b-b0ff154acac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.434811 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928a9bb-efa1-4088-b89b-b0ff154acac8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.435531 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928a9bb-efa1-4088-b89b-b0ff154acac8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:28.435835 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928a9bb-efa1-4088-b89b-b0ff154acac8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:28.437415 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928a9bb-efa1-4088-b89b-b0ff154acac8 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:28.441922 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 791/1569] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:51:28.442758 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db23130-b016-4b49-b11c-dc83ffb5b65d admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:28.450494 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 779/1570] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:28.451300 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928a9bb-efa1-4088-b89b-b0ff154acac8 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:28.456502 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db23130-b016-4b49-b11c-dc83ffb5b65d admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:28.461327 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928a9bb-efa1-4088-b89b-b0ff154acac8 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:28.462299 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8fdd7-6cae-4a5e-8b56-0ddd53b62bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:28.463318 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8fdd7-6cae-4a5e-8b56-0ddd53b62bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.463779 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8fdd7-6cae-4a5e-8b56-0ddd53b62bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.464236 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8fdd7-6cae-4a5e-8b56-0ddd53b62bb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.465111 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8fdd7-6cae-4a5e-8b56-0ddd53b62bb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:28.465651 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8fdd7-6cae-4a5e-8b56-0ddd53b62bb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:28.466187 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2e331-c296-443b-8709-746847f7be83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:28.467153 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2e331-c296-443b-8709-746847f7be83 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.467153 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2e331-c296-443b-8709-746847f7be83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.467333 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2e331-c296-443b-8709-746847f7be83 admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.467907 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8fdd7-6cae-4a5e-8b56-0ddd53b62bb5 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:28.468021 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2e331-c296-443b-8709-746847f7be83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:28.469941 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2e331-c296-443b-8709-746847f7be83 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:28.489121 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 792/1571] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:28.489121 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8fdd7-6cae-4a5e-8b56-0ddd53b62bb5 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:28.495992 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8fdd7-6cae-4a5e-8b56-0ddd53b62bb5 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:28.502276 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 780/1572] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:51:28 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:28.502276 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2e331-c296-443b-8709-746847f7be83 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:28.502545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe4d19-cc04-4352-9734-71493c90d825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:28.502545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe4d19-cc04-4352-9734-71493c90d825 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.502925 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe4d19-cc04-4352-9734-71493c90d825 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.503238 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe4d19-cc04-4352-9734-71493c90d825 admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.503945 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe4d19-cc04-4352-9734-71493c90d825 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:28.506171 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe4d19-cc04-4352-9734-71493c90d825 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:28.530075 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 793/1573] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:51:28 2022] POST /identity/v3/users => generated 295 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:28.530914 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe4d19-cc04-4352-9734-71493c90d825 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:28.543083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe4d19-cc04-4352-9734-71493c90d825 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:28.573030 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2e331-c296-443b-8709-746847f7be83 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:28.577875 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2cc62-f09f-4e54-9031-844122ad9773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:28.578495 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2cc62-f09f-4e54-9031-844122ad9773 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.578769 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2cc62-f09f-4e54-9031-844122ad9773 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.579036 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2cc62-f09f-4e54-9031-844122ad9773 admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.579702 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa2cc62-f09f-4e54-9031-844122ad9773 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:28.581618 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa2cc62-f09f-4e54-9031-844122ad9773 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:28.605121 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4886f45-4d41-4000-b949-485030dbe8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:28.605801 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4886f45-4d41-4000-b949-485030dbe8f1 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.606067 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4886f45-4d41-4000-b949-485030dbe8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.606425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4886f45-4d41-4000-b949-485030dbe8f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.607014 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4886f45-4d41-4000-b949-485030dbe8f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:28.608943 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4886f45-4d41-4000-b949-485030dbe8f1 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:28.610104 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 781/1574] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:51:28 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:28.611016 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2cc62-f09f-4e54-9031-844122ad9773 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:28.621467 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:28.640625 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 794/1575] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:51:28 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:28.641450 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4886f45-4d41-4000-b949-485030dbe8f1 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:28.655531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:28.681154 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2cc62-f09f-4e54-9031-844122ad9773 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:28.708219 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4886f45-4d41-4000-b949-485030dbe8f1 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:28.713034 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf229d0-ec27-45df-8d77-59304e969eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:28.713688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf229d0-ec27-45df-8d77-59304e969eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.713986 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf229d0-ec27-45df-8d77-59304e969eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.714244 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf229d0-ec27-45df-8d77-59304e969eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.714959 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf229d0-ec27-45df-8d77-59304e969eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:28.716531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf229d0-ec27-45df-8d77-59304e969eb2 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:28.730533 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 795/1576] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:51:28.730533 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf229d0-ec27-45df-8d77-59304e969eb2 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:28.737840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf229d0-ec27-45df-8d77-59304e969eb2 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:28.740372 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2feda-37da-41b5-b2cd-48547ef6f073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:28.741161 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2feda-37da-41b5-b2cd-48547ef6f073 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.741444 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2feda-37da-41b5-b2cd-48547ef6f073 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.741751 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2feda-37da-41b5-b2cd-48547ef6f073 admin admin] PATH_INFO: `/v3/projects/d2235c29f1294ba7ab1a4e7f1434a447/users/8015b56c5cc5480f9f0276201529a96a/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.742508 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b50982-c7f7-4835-8f60-c19f8503c466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:28.743734 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b50982-c7f7-4835-8f60-c19f8503c466 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.744118 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b50982-c7f7-4835-8f60-c19f8503c466 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.744395 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b50982-c7f7-4835-8f60-c19f8503c466 admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.745051 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b50982-c7f7-4835-8f60-c19f8503c466 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:28.746968 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b50982-c7f7-4835-8f60-c19f8503c466 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:28.757849 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba2feda-37da-41b5-b2cd-48547ef6f073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2235c29f1294ba7ab1a4e7f1434a447, user_id=8015b56c5cc5480f9f0276201529a96a, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:28.759624 dv-cinder-850836-4-smb devstack@keystone.service[91788]: WARNING py.warnings [None req-9ba2feda-37da-41b5-b2cd-48547ef6f073 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:51:28.759624 dv-cinder-850836-4-smb devstack@keystone.service[91788]: warnings.warn(msg) Aug 03 12:51:28.759624 dv-cinder-850836-4-smb devstack@keystone.service[91788]: Aug 03 12:51:28.761578 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba2feda-37da-41b5-b2cd-48547ef6f073 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:28.774794 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 782/1577] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:51:28 2022] PUT /identity/v3/projects/d2235c29f1294ba7ab1a4e7f1434a447/users/8015b56c5cc5480f9f0276201529a96a/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:28.775753 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2feda-37da-41b5-b2cd-48547ef6f073 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:28.780206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 796/1578] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:51:28 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:28.781110 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b50982-c7f7-4835-8f60-c19f8503c466 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:28.845865 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b50982-c7f7-4835-8f60-c19f8503c466 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:28.846064 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2feda-37da-41b5-b2cd-48547ef6f073 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:28.850626 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b8618-bff8-4aea-a0c9-352ae15d6c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:28.850765 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7ef70-60df-482b-a605-957c97b89f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:28.851268 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7ef70-60df-482b-a605-957c97b89f6f admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.851381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b8618-bff8-4aea-a0c9-352ae15d6c4f admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.851552 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7ef70-60df-482b-a605-957c97b89f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.851661 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b8618-bff8-4aea-a0c9-352ae15d6c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.851849 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b8618-bff8-4aea-a0c9-352ae15d6c4f admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.851950 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7ef70-60df-482b-a605-957c97b89f6f admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.853078 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7ef70-60df-482b-a605-957c97b89f6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:28.853231 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b8618-bff8-4aea-a0c9-352ae15d6c4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:28.855161 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7ef70-60df-482b-a605-957c97b89f6f admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:28.855443 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b8618-bff8-4aea-a0c9-352ae15d6c4f admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:28.879370 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 797/1579] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:51:28 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:28.880342 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b8618-bff8-4aea-a0c9-352ae15d6c4f admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:28.889933 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 783/1580] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:51:28 2022] POST /identity/v3/projects => generated 405 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:28.889933 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7ef70-60df-482b-a605-957c97b89f6f admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:28.891302 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b8618-bff8-4aea-a0c9-352ae15d6c4f admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:28.916036 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:28.950628 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a7d22-2417-49cb-92ea-6b9c709bb515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:28.951270 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a7d22-2417-49cb-92ea-6b9c709bb515 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.951533 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a7d22-2417-49cb-92ea-6b9c709bb515 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.951811 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a7d22-2417-49cb-92ea-6b9c709bb515 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.952510 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a7d22-2417-49cb-92ea-6b9c709bb515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:28.954174 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a7d22-2417-49cb-92ea-6b9c709bb515 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:28.954297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7ef70-60df-482b-a605-957c97b89f6f admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:28.958868 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b5e5c-9d04-4264-8db8-86ce48f2bc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:28.959486 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b5e5c-9d04-4264-8db8-86ce48f2bc5f admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.959770 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b5e5c-9d04-4264-8db8-86ce48f2bc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.960047 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b5e5c-9d04-4264-8db8-86ce48f2bc5f admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.960705 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184b5e5c-9d04-4264-8db8-86ce48f2bc5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:28.962735 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184b5e5c-9d04-4264-8db8-86ce48f2bc5f admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:28.964438 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 798/1581] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:51:28.966363 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a7d22-2417-49cb-92ea-6b9c709bb515 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:28.976940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a7d22-2417-49cb-92ea-6b9c709bb515 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:28.982452 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1c514-0604-4b2e-aa45-3f09eaf291c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:28.983056 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1c514-0604-4b2e-aa45-3f09eaf291c2 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:28.983368 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1c514-0604-4b2e-aa45-3f09eaf291c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:28.983610 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1c514-0604-4b2e-aa45-3f09eaf291c2 admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:28.984297 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc1c514-0604-4b2e-aa45-3f09eaf291c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:28.985987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 784/1582] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:51:28 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:28.986433 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc1c514-0604-4b2e-aa45-3f09eaf291c2 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:28.987013 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b5e5c-9d04-4264-8db8-86ce48f2bc5f admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:28.997768 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:28.998056 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b5e5c-9d04-4264-8db8-86ce48f2bc5f admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:29.006314 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf945b59-9d19-49ba-a95f-de57a8feae07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:29.007021 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf945b59-9d19-49ba-a95f-de57a8feae07 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:29.007302 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf945b59-9d19-49ba-a95f-de57a8feae07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:29.007583 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf945b59-9d19-49ba-a95f-de57a8feae07 admin admin] PATH_INFO: `/v3/projects/b0e23361693d4d7d823e600c73855c3e/users/539502db204e415c85520d9b7fe77d99/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.013632 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 799/1583] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:51:28 2022] POST /identity/v3/users => generated 293 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:29.013632 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55087a03-9e6f-4425-8279-ef54e8ed142b None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:29.013632 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55087a03-9e6f-4425-8279-ef54e8ed142b None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:29.013632 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55087a03-9e6f-4425-8279-ef54e8ed142b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.026353 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf945b59-9d19-49ba-a95f-de57a8feae07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0e23361693d4d7d823e600c73855c3e, user_id=539502db204e415c85520d9b7fe77d99, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:29.029029 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf945b59-9d19-49ba-a95f-de57a8feae07 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:29.031995 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-55087a03-9e6f-4425-8279-ef54e8ed142b None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:29.033202 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-55087a03-9e6f-4425-8279-ef54e8ed142b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:29.042321 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 800/1584] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:29.043160 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55087a03-9e6f-4425-8279-ef54e8ed142b None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:29.043602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 785/1585] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:51:28 2022] PUT /identity/v3/projects/b0e23361693d4d7d823e600c73855c3e/users/539502db204e415c85520d9b7fe77d99/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:29.044272 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf945b59-9d19-49ba-a95f-de57a8feae07 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:29.057751 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55087a03-9e6f-4425-8279-ef54e8ed142b None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:29.109113 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf945b59-9d19-49ba-a95f-de57a8feae07 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:29.114220 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1386a12-7538-4c44-9300-3647a5f2d3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:29.114836 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1386a12-7538-4c44-9300-3647a5f2d3bf admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:29.115118 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1386a12-7538-4c44-9300-3647a5f2d3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:29.115393 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1386a12-7538-4c44-9300-3647a5f2d3bf admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.116097 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1386a12-7538-4c44-9300-3647a5f2d3bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:29.116375 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c608a-87aa-4de2-b4d2-73c2626ebfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:29.116997 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c608a-87aa-4de2-b4d2-73c2626ebfdc admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:29.117278 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c608a-87aa-4de2-b4d2-73c2626ebfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:29.117589 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c608a-87aa-4de2-b4d2-73c2626ebfdc admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.117731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1386a12-7538-4c44-9300-3647a5f2d3bf admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:29.119005 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c608a-87aa-4de2-b4d2-73c2626ebfdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:29.120904 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c608a-87aa-4de2-b4d2-73c2626ebfdc admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:29.129474 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 786/1586] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:51:29.130495 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1386a12-7538-4c44-9300-3647a5f2d3bf admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:29.141516 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1386a12-7538-4c44-9300-3647a5f2d3bf admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:29.144303 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 801/1587] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:51:29 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:29.145127 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c608a-87aa-4de2-b4d2-73c2626ebfdc admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:29.149044 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37c100-6b3d-46f2-b91f-ee8ce9d666bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:29.150395 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37c100-6b3d-46f2-b91f-ee8ce9d666bf admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:29.150679 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37c100-6b3d-46f2-b91f-ee8ce9d666bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:29.150950 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37c100-6b3d-46f2-b91f-ee8ce9d666bf admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.151602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37c100-6b3d-46f2-b91f-ee8ce9d666bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:29.153513 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37c100-6b3d-46f2-b91f-ee8ce9d666bf admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:29.155665 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c608a-87aa-4de2-b4d2-73c2626ebfdc admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:29.160480 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c4033f-d248-43a7-8de5-50c4b33f0a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:29.161135 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4033f-d248-43a7-8de5-50c4b33f0a2a admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:29.161459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4033f-d248-43a7-8de5-50c4b33f0a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:29.161768 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4033f-d248-43a7-8de5-50c4b33f0a2a admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.162605 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c4033f-d248-43a7-8de5-50c4b33f0a2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:29.164235 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c4033f-d248-43a7-8de5-50c4b33f0a2a admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:29.175870 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 787/1588] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:51:29 2022] POST /identity/v3/users => generated 303 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:29.176875 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 802/1589] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:51:29.177001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37c100-6b3d-46f2-b91f-ee8ce9d666bf admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:29.177999 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c4033f-d248-43a7-8de5-50c4b33f0a2a admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:29.188257 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c4033f-d248-43a7-8de5-50c4b33f0a2a admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:29.189250 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37c100-6b3d-46f2-b91f-ee8ce9d666bf admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:29.192870 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc4853-d5d5-4ff6-aeb0-ee1b90ede830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:29.193476 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc4853-d5d5-4ff6-aeb0-ee1b90ede830 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:29.193790 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc4853-d5d5-4ff6-aeb0-ee1b90ede830 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:29.194071 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc4853-d5d5-4ff6-aeb0-ee1b90ede830 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.194196 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36760ce-bc63-4a85-89a7-ffa0ecda7c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:29.194760 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc4853-d5d5-4ff6-aeb0-ee1b90ede830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:29.194919 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36760ce-bc63-4a85-89a7-ffa0ecda7c1b admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:29.195261 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36760ce-bc63-4a85-89a7-ffa0ecda7c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:29.195599 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36760ce-bc63-4a85-89a7-ffa0ecda7c1b admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.196384 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36760ce-bc63-4a85-89a7-ffa0ecda7c1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:29.196764 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc4853-d5d5-4ff6-aeb0-ee1b90ede830 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:29.198127 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36760ce-bc63-4a85-89a7-ffa0ecda7c1b admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:29.207330 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 803/1590] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:51:29.208522 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567ddc3-954d-411f-b5e3-c0bffe7a891d None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:29.208999 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 788/1591] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:51:29.209641 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567ddc3-954d-411f-b5e3-c0bffe7a891d None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:29.209971 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36760ce-bc63-4a85-89a7-ffa0ecda7c1b admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:29.210327 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567ddc3-954d-411f-b5e3-c0bffe7a891d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.231582 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-8567ddc3-954d-411f-b5e3-c0bffe7a891d None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:29.232824 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-8567ddc3-954d-411f-b5e3-c0bffe7a891d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:29.240751 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 804/1592] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:29.241545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567ddc3-954d-411f-b5e3-c0bffe7a891d None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:29.251950 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567ddc3-954d-411f-b5e3-c0bffe7a891d None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:29.256811 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f320b1c-e86d-48d2-9530-55cdce9a434c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:29.257426 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f320b1c-e86d-48d2-9530-55cdce9a434c admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:29.257742 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f320b1c-e86d-48d2-9530-55cdce9a434c admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:29.258491 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f320b1c-e86d-48d2-9530-55cdce9a434c admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.259244 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f320b1c-e86d-48d2-9530-55cdce9a434c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:29.260855 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f320b1c-e86d-48d2-9530-55cdce9a434c admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:29.277444 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 805/1593] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:51:29.277444 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f320b1c-e86d-48d2-9530-55cdce9a434c admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:29.277726 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36760ce-bc63-4a85-89a7-ffa0ecda7c1b admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:29.280575 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42eae2-bcb5-4516-8d48-04481144e3eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:29.281252 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42eae2-bcb5-4516-8d48-04481144e3eb service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:29.281581 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42eae2-bcb5-4516-8d48-04481144e3eb service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:29.281854 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42eae2-bcb5-4516-8d48-04481144e3eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.285407 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f320b1c-e86d-48d2-9530-55cdce9a434c admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:29.290685 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10521e9-e9e7-4321-aeca-7f08b2e3081d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:29.291281 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10521e9-e9e7-4321-aeca-7f08b2e3081d admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:29.291558 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10521e9-e9e7-4321-aeca-7f08b2e3081d admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:29.291828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10521e9-e9e7-4321-aeca-7f08b2e3081d admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.292512 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10521e9-e9e7-4321-aeca-7f08b2e3081d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:29.292675 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42eae2-bcb5-4516-8d48-04481144e3eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:29.294140 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10521e9-e9e7-4321-aeca-7f08b2e3081d admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:29.294269 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42eae2-bcb5-4516-8d48-04481144e3eb service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:29.299593 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:29.304156 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 806/1594] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:51:29.304886 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 789/1595] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:29.305057 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10521e9-e9e7-4321-aeca-7f08b2e3081d admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:29.306316 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42eae2-bcb5-4516-8d48-04481144e3eb service neutron] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:29.315189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10521e9-e9e7-4321-aeca-7f08b2e3081d admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:29.317792 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42eae2-bcb5-4516-8d48-04481144e3eb service neutron] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:29.320043 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c079c14-0418-4549-a127-73dddbe90176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:29.320651 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c079c14-0418-4549-a127-73dddbe90176 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:29.320933 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c079c14-0418-4549-a127-73dddbe90176 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:29.321247 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c079c14-0418-4549-a127-73dddbe90176 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.322447 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c079c14-0418-4549-a127-73dddbe90176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:29.323632 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c079c14-0418-4549-a127-73dddbe90176 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:29.323784 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192a17e-3fd6-44f5-a6b1-56a05cc0c80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:29.324609 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192a17e-3fd6-44f5-a6b1-56a05cc0c80f admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:29.324929 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192a17e-3fd6-44f5-a6b1-56a05cc0c80f admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:29.325269 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192a17e-3fd6-44f5-a6b1-56a05cc0c80f admin admin] PATH_INFO: `/v3/projects/21a63ad619b644089c218675b219b734/users/7a109db9f7754b5a8f5b53fa7030691c/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.335565 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 807/1596] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:51:29.336463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c079c14-0418-4549-a127-73dddbe90176 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:29.347785 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c192a17e-3fd6-44f5-a6b1-56a05cc0c80f admin admin] RBAC: Authorizing `identity:create_grant(project_id=21a63ad619b644089c218675b219b734, user_id=7a109db9f7754b5a8f5b53fa7030691c, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:29.349034 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c079c14-0418-4549-a127-73dddbe90176 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:29.350874 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c192a17e-3fd6-44f5-a6b1-56a05cc0c80f admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:29.354712 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81b765-6cd9-46b5-96c3-1d9d516d79e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:29.355335 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81b765-6cd9-46b5-96c3-1d9d516d79e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:29.355618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81b765-6cd9-46b5-96c3-1d9d516d79e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:29.355899 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81b765-6cd9-46b5-96c3-1d9d516d79e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.357026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81b765-6cd9-46b5-96c3-1d9d516d79e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:29.359047 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81b765-6cd9-46b5-96c3-1d9d516d79e7 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:29.366674 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 790/1597] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:51:29 2022] PUT /identity/v3/projects/21a63ad619b644089c218675b219b734/users/7a109db9f7754b5a8f5b53fa7030691c/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:29.367508 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192a17e-3fd6-44f5-a6b1-56a05cc0c80f admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:29.373728 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 808/1598] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:51:29.375168 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81b765-6cd9-46b5-96c3-1d9d516d79e7 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:29.386996 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81b765-6cd9-46b5-96c3-1d9d516d79e7 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:29.441015 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192a17e-3fd6-44f5-a6b1-56a05cc0c80f admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:29.446171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b8754-2b74-46b2-8531-6577b573e325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:29.446875 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b8754-2b74-46b2-8531-6577b573e325 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:29.447526 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b8754-2b74-46b2-8531-6577b573e325 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:29.447526 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b8754-2b74-46b2-8531-6577b573e325 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.448535 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b8754-2b74-46b2-8531-6577b573e325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:29.450534 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b8754-2b74-46b2-8531-6577b573e325 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:29.450680 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148a648-dfa5-47ac-8f25-ab38adb32a4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:29.451145 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148a648-dfa5-47ac-8f25-ab38adb32a4d service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:29.451565 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148a648-dfa5-47ac-8f25-ab38adb32a4d service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:29.452207 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148a648-dfa5-47ac-8f25-ab38adb32a4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.462617 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 791/1599] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:51:29.463473 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b8754-2b74-46b2-8531-6577b573e325 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:29.467895 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148a648-dfa5-47ac-8f25-ab38adb32a4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:29.469678 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148a648-dfa5-47ac-8f25-ab38adb32a4d service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:29.474693 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b8754-2b74-46b2-8531-6577b573e325 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:29.480755 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251bd06-a6bf-4c49-b61b-386690b42957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:29.481579 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251bd06-a6bf-4c49-b61b-386690b42957 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:29.482115 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 809/1600] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:29.482237 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251bd06-a6bf-4c49-b61b-386690b42957 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:29.482539 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251bd06-a6bf-4c49-b61b-386690b42957 admin admin] PATH_INFO: `/v3/projects/0bab88361acf4566b1bc3ab503c29540/users/e3eba8e63be14907a364797a0189290c/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.482956 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148a648-dfa5-47ac-8f25-ab38adb32a4d service neutron] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:29.495096 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148a648-dfa5-47ac-8f25-ab38adb32a4d service neutron] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:29.501122 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79371ac-5cdb-4fe7-82e7-b9c6f816b663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:29.501860 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79371ac-5cdb-4fe7-82e7-b9c6f816b663 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:29.502160 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79371ac-5cdb-4fe7-82e7-b9c6f816b663 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:29.502435 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79371ac-5cdb-4fe7-82e7-b9c6f816b663 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.503345 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79371ac-5cdb-4fe7-82e7-b9c6f816b663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:29.504134 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251bd06-a6bf-4c49-b61b-386690b42957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bab88361acf4566b1bc3ab503c29540, user_id=e3eba8e63be14907a364797a0189290c, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:29.505133 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79371ac-5cdb-4fe7-82e7-b9c6f816b663 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:29.506671 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:29.510090 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251bd06-a6bf-4c49-b61b-386690b42957 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:29.530585 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 810/1601] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:51:29.531005 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 792/1602] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:51:29 2022] PUT /identity/v3/projects/0bab88361acf4566b1bc3ab503c29540/users/e3eba8e63be14907a364797a0189290c/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:29.531961 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79371ac-5cdb-4fe7-82e7-b9c6f816b663 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:29.536036 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75db162-a6b4-46f2-890e-7697cb6a38b9 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:29.536324 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75db162-a6b4-46f2-890e-7697cb6a38b9 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:29.536596 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75db162-a6b4-46f2-890e-7697cb6a38b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.543966 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79371ac-5cdb-4fe7-82e7-b9c6f816b663 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:29.559658 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-f75db162-a6b4-46f2-890e-7697cb6a38b9 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:29.561412 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-f75db162-a6b4-46f2-890e-7697cb6a38b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:29.620590 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a45a2-938e-4cec-993c-cfce6da0ddea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:29.621141 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a45a2-938e-4cec-993c-cfce6da0ddea admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:29.621456 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a45a2-938e-4cec-993c-cfce6da0ddea admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:29.621910 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a45a2-938e-4cec-993c-cfce6da0ddea admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.622706 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a45a2-938e-4cec-993c-cfce6da0ddea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:29.624868 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a45a2-938e-4cec-993c-cfce6da0ddea admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:29.632707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 793/1603] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:29.634404 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75db162-a6b4-46f2-890e-7697cb6a38b9 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:29.637616 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 811/1604] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:51:29.637616 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a45a2-938e-4cec-993c-cfce6da0ddea admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:29.647550 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75db162-a6b4-46f2-890e-7697cb6a38b9 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:29.648898 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a45a2-938e-4cec-993c-cfce6da0ddea admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:29.654057 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95980d49-9df0-44e9-8efc-067595d96f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:29.654664 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070f313-28ee-4a6b-b8f0-392bd1ba7ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:29.655343 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070f313-28ee-4a6b-b8f0-392bd1ba7ea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:29.655623 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070f313-28ee-4a6b-b8f0-392bd1ba7ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:29.655820 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95980d49-9df0-44e9-8efc-067595d96f0c admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:29.655923 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070f313-28ee-4a6b-b8f0-392bd1ba7ea3 admin admin] PATH_INFO: `/v3/projects/1e769eec7d784321a1fcf7896983d022/users/29005524946d44308e4f7e8f783f504e/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.656369 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95980d49-9df0-44e9-8efc-067595d96f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:29.656835 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95980d49-9df0-44e9-8efc-067595d96f0c admin admin] PATH_INFO: `/v3/projects/6fbbc1d3d2634250bfd7f7b27c4b4245/users/831d8776102847efbdae901f2b863226/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.674117 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070f313-28ee-4a6b-b8f0-392bd1ba7ea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e769eec7d784321a1fcf7896983d022, user_id=29005524946d44308e4f7e8f783f504e, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:29.675253 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95980d49-9df0-44e9-8efc-067595d96f0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fbbc1d3d2634250bfd7f7b27c4b4245, user_id=831d8776102847efbdae901f2b863226, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:29.676892 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070f313-28ee-4a6b-b8f0-392bd1ba7ea3 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:29.679634 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95980d49-9df0-44e9-8efc-067595d96f0c admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:29.697091 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 812/1605] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:51:29 2022] PUT /identity/v3/projects/1e769eec7d784321a1fcf7896983d022/users/29005524946d44308e4f7e8f783f504e/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:29.701658 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070f313-28ee-4a6b-b8f0-392bd1ba7ea3 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:29.706833 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 794/1606] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:51:29 2022] PUT /identity/v3/projects/6fbbc1d3d2634250bfd7f7b27c4b4245/users/831d8776102847efbdae901f2b863226/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:29.710507 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79f3ec-2365-4cd3-92c0-a20ed5c9ae23 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:29.710507 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79f3ec-2365-4cd3-92c0-a20ed5c9ae23 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:29.710507 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79f3ec-2365-4cd3-92c0-a20ed5c9ae23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.740830 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-1b79f3ec-2365-4cd3-92c0-a20ed5c9ae23 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:29.742594 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-1b79f3ec-2365-4cd3-92c0-a20ed5c9ae23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:29.773579 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:29.786444 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070f313-28ee-4a6b-b8f0-392bd1ba7ea3 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:29.876354 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 795/1607] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:29.878932 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79f3ec-2365-4cd3-92c0-a20ed5c9ae23 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:29.885441 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9caf2c7-94db-4e70-90a2-b64be12a7f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:29.887894 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9caf2c7-94db-4e70-90a2-b64be12a7f35 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:29.888716 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9caf2c7-94db-4e70-90a2-b64be12a7f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:29.889994 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9caf2c7-94db-4e70-90a2-b64be12a7f35 admin admin] PATH_INFO: `/v3/projects/0f8ddc1bd0514596b6a9ae2c061435dc/users/e88959015b01417ba105edc60e417b4f/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.911434 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79f3ec-2365-4cd3-92c0-a20ed5c9ae23 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:29.926091 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d803fde-f779-4086-a89b-f3fd6b595b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:29.927455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d803fde-f779-4086-a89b-f3fd6b595b34 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:29.928482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d803fde-f779-4086-a89b-f3fd6b595b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:29.930297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d803fde-f779-4086-a89b-f3fd6b595b34 admin admin] PATH_INFO: `/v3/projects/b5015316fc864e8587b890b03dd7990e/users/62705e0bd6d64a8eb00ce0cf37a5376e/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:29.937757 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9caf2c7-94db-4e70-90a2-b64be12a7f35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f8ddc1bd0514596b6a9ae2c061435dc, user_id=e88959015b01417ba105edc60e417b4f, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:29.945925 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9caf2c7-94db-4e70-90a2-b64be12a7f35 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:29.960068 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:29.971738 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d803fde-f779-4086-a89b-f3fd6b595b34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5015316fc864e8587b890b03dd7990e, user_id=62705e0bd6d64a8eb00ce0cf37a5376e, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:29.973484 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 813/1608] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:51:29 2022] PUT /identity/v3/projects/0f8ddc1bd0514596b6a9ae2c061435dc/users/e88959015b01417ba105edc60e417b4f/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:29.983524 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9caf2c7-94db-4e70-90a2-b64be12a7f35 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:29.987594 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d803fde-f779-4086-a89b-f3fd6b595b34 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:29.989311 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-a9caf2c7-94db-4e70-90a2-b64be12a7f35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:30.022665 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 796/1609] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:51:29 2022] PUT /identity/v3/projects/b5015316fc864e8587b890b03dd7990e/users/62705e0bd6d64a8eb00ce0cf37a5376e/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:30.024579 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11982e11-6b13-4c07-859f-163b86d4c669 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:30.025253 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11982e11-6b13-4c07-859f-163b86d4c669 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:30.025573 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11982e11-6b13-4c07-859f-163b86d4c669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:30.057603 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-11982e11-6b13-4c07-859f-163b86d4c669 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:30.077271 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-11982e11-6b13-4c07-859f-163b86d4c669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:30.126459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9caf2c7-94db-4e70-90a2-b64be12a7f35 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:30.191906 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 797/1610] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:30.194614 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7690696-750a-499f-b8f5-a23924e865d3 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:30.195803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7690696-750a-499f-b8f5-a23924e865d3 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:30.197383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7690696-750a-499f-b8f5-a23924e865d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:30.223537 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41210adb-bbab-4421-9117-5759abbd8721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:30.224762 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41210adb-bbab-4421-9117-5759abbd8721 service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:30.225307 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41210adb-bbab-4421-9117-5759abbd8721 service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:30.225678 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41210adb-bbab-4421-9117-5759abbd8721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:30.226705 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-c7690696-750a-499f-b8f5-a23924e865d3 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:30.229832 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-c7690696-750a-499f-b8f5-a23924e865d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:30.239599 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41210adb-bbab-4421-9117-5759abbd8721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:30.241060 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41210adb-bbab-4421-9117-5759abbd8721 service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:30.243781 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 798/1611] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:30.244791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7690696-750a-499f-b8f5-a23924e865d3 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:30.256883 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7690696-750a-499f-b8f5-a23924e865d3 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:30.268191 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0469f-1dbb-4b5b-be97-877df36e9679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:30.269171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0469f-1dbb-4b5b-be97-877df36e9679 service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:30.269463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0469f-1dbb-4b5b-be97-877df36e9679 service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:30.269756 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0469f-1dbb-4b5b-be97-877df36e9679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:30.286186 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 814/1612] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:30.287807 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9edca-27bf-48ec-a2d6-e74db3c4b575 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:30.287928 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0469f-1dbb-4b5b-be97-877df36e9679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:30.288036 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9edca-27bf-48ec-a2d6-e74db3c4b575 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:30.290583 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0469f-1dbb-4b5b-be97-877df36e9679 service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:30.290742 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9edca-27bf-48ec-a2d6-e74db3c4b575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:30.308260 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 799/1613] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:30.310296 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a8a4c-add6-4446-b971-3aae3746ea1b None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:30.310588 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a8a4c-add6-4446-b971-3aae3746ea1b None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:30.310864 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a8a4c-add6-4446-b971-3aae3746ea1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:30.359905 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-626a8a4c-add6-4446-b971-3aae3746ea1b None None] MFA Rules not processed for user `62705e0bd6d64a8eb00ce0cf37a5376e`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:30.364208 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-626a8a4c-add6-4446-b971-3aae3746ea1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:30.365057 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-04d9edca-27bf-48ec-a2d6-e74db3c4b575 None None] MFA Rules not processed for user `e88959015b01417ba105edc60e417b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:30.366313 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-04d9edca-27bf-48ec-a2d6-e74db3c4b575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:30.458856 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 800/1614] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:30 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:30.460915 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698aa1fc-3abd-48bc-8e24-3ec28195bf11 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:30.461209 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698aa1fc-3abd-48bc-8e24-3ec28195bf11 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:30.461468 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698aa1fc-3abd-48bc-8e24-3ec28195bf11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:30.473375 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 815/1615] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:30.479094 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9edca-27bf-48ec-a2d6-e74db3c4b575 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:30.492728 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:30.508119 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9edca-27bf-48ec-a2d6-e74db3c4b575 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:30.513133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-698aa1fc-3abd-48bc-8e24-3ec28195bf11 None None] MFA Rules not processed for user `8015b56c5cc5480f9f0276201529a96a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:30.514571 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-698aa1fc-3abd-48bc-8e24-3ec28195bf11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:30.516490 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1fcf84-0e89-44b9-abc4-706d4056fb92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:30.517606 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fcf84-0e89-44b9-abc4-706d4056fb92 service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:30.518098 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fcf84-0e89-44b9-abc4-706d4056fb92 service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:30.518556 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1fcf84-0e89-44b9-abc4-706d4056fb92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:30.534651 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1fcf84-0e89-44b9-abc4-706d4056fb92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:30.537168 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1fcf84-0e89-44b9-abc4-706d4056fb92 service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:30.551786 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 816/1616] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:30.552898 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1fcf84-0e89-44b9-abc4-706d4056fb92 service neutron] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:30.563490 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1fcf84-0e89-44b9-abc4-706d4056fb92 service neutron] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:30.567950 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61825942-2e09-4b20-a7e9-4640073a011d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:30.569322 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61825942-2e09-4b20-a7e9-4640073a011d service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:30.569839 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61825942-2e09-4b20-a7e9-4640073a011d service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:30.570318 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61825942-2e09-4b20-a7e9-4640073a011d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:30.584419 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61825942-2e09-4b20-a7e9-4640073a011d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:30.586429 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61825942-2e09-4b20-a7e9-4640073a011d service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:30.599746 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 817/1617] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:30.601273 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61825942-2e09-4b20-a7e9-4640073a011d service neutron] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:30.615024 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61825942-2e09-4b20-a7e9-4640073a011d service neutron] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:30.621818 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeedf2c-eb06-4c93-9ae2-5d1f451a348e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:30.622993 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeedf2c-eb06-4c93-9ae2-5d1f451a348e admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:30.624080 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeedf2c-eb06-4c93-9ae2-5d1f451a348e admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:30.624477 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeedf2c-eb06-4c93-9ae2-5d1f451a348e admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:30.625312 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeedf2c-eb06-4c93-9ae2-5d1f451a348e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:30.627816 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeedf2c-eb06-4c93-9ae2-5d1f451a348e admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:30.655890 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:30.668329 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 818/1618] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:51:30 2022] POST /identity/v3/projects => generated 403 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:30.669700 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeedf2c-eb06-4c93-9ae2-5d1f451a348e admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:30.679235 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 801/1619] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:30 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:30.679235 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698aa1fc-3abd-48bc-8e24-3ec28195bf11 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:30.694377 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698aa1fc-3abd-48bc-8e24-3ec28195bf11 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:30.749186 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeedf2c-eb06-4c93-9ae2-5d1f451a348e admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:30.754566 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7e2a0-5d1b-432b-8069-6ef347f881c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:30.755467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7e2a0-5d1b-432b-8069-6ef347f881c1 service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:30.755751 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7e2a0-5d1b-432b-8069-6ef347f881c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:30.756036 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7e2a0-5d1b-432b-8069-6ef347f881c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:30.774929 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5e40e-b02d-45c3-a3ab-77ab8650c498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:30.776412 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5e40e-b02d-45c3-a3ab-77ab8650c498 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:30.777546 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5e40e-b02d-45c3-a3ab-77ab8650c498 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:30.778117 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5e40e-b02d-45c3-a3ab-77ab8650c498 admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:30.779014 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5e40e-b02d-45c3-a3ab-77ab8650c498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:30.783480 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5e40e-b02d-45c3-a3ab-77ab8650c498 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:30.828007 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 802/1620] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:51:30 2022] POST /identity/v3/users => generated 308 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:30.829083 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5e40e-b02d-45c3-a3ab-77ab8650c498 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:30.845337 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5e40e-b02d-45c3-a3ab-77ab8650c498 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:30.849581 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7e2a0-5d1b-432b-8069-6ef347f881c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:30.851752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7e2a0-5d1b-432b-8069-6ef347f881c1 service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:30.854198 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc71b7-ea55-4714-b98a-58232f14fa99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:30.855244 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc71b7-ea55-4714-b98a-58232f14fa99 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:30.855662 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc71b7-ea55-4714-b98a-58232f14fa99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:30.856218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc71b7-ea55-4714-b98a-58232f14fa99 admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:30.858262 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc71b7-ea55-4714-b98a-58232f14fa99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:30.861988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc71b7-ea55-4714-b98a-58232f14fa99 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:30.865775 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 819/1621] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:30.866675 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7e2a0-5d1b-432b-8069-6ef347f881c1 service cinder] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:30.881662 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7e2a0-5d1b-432b-8069-6ef347f881c1 service cinder] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:30.894606 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c98bc-78cc-4017-9dfb-77fdf52955fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:30.895270 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c98bc-78cc-4017-9dfb-77fdf52955fe admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:30.895974 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c98bc-78cc-4017-9dfb-77fdf52955fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:30.896340 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c98bc-78cc-4017-9dfb-77fdf52955fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:30.897856 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c98bc-78cc-4017-9dfb-77fdf52955fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:30.905967 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c98bc-78cc-4017-9dfb-77fdf52955fe admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:30.932198 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 820/1622] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:51:30.933207 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c98bc-78cc-4017-9dfb-77fdf52955fe admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:30.943801 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 803/1623] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:51:30 2022] POST /identity/v3/projects => generated 405 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:30.947978 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc71b7-ea55-4714-b98a-58232f14fa99 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:30.956404 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c98bc-78cc-4017-9dfb-77fdf52955fe admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:31.064951 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04ef7c-d2f6-41bd-8942-8d6b08576bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:31.066379 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04ef7c-d2f6-41bd-8942-8d6b08576bfd admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:31.067234 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04ef7c-d2f6-41bd-8942-8d6b08576bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:31.067834 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04ef7c-d2f6-41bd-8942-8d6b08576bfd admin admin] PATH_INFO: `/v3/projects/7c549af6ad1647dfb54f3f2e7de2886b/users/adaeadec88144a31b2916c087a31f636/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:31.101022 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04ef7c-d2f6-41bd-8942-8d6b08576bfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c549af6ad1647dfb54f3f2e7de2886b, user_id=adaeadec88144a31b2916c087a31f636, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:31.107348 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04ef7c-d2f6-41bd-8942-8d6b08576bfd admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:31.125169 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc71b7-ea55-4714-b98a-58232f14fa99 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:31.142215 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 821/1624] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:51:30 2022] PUT /identity/v3/projects/7c549af6ad1647dfb54f3f2e7de2886b/users/adaeadec88144a31b2916c087a31f636/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:31.146512 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04ef7c-d2f6-41bd-8942-8d6b08576bfd admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:31.160121 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:31.200716 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:31.300565 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be87280-e1e6-43c1-802a-3e846020d248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:31.302518 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be87280-e1e6-43c1-802a-3e846020d248 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:31.303804 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be87280-e1e6-43c1-802a-3e846020d248 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:31.304225 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be87280-e1e6-43c1-802a-3e846020d248 admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:31.306387 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04ef7c-d2f6-41bd-8942-8d6b08576bfd admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:31.307734 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be87280-e1e6-43c1-802a-3e846020d248 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:31.313609 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be87280-e1e6-43c1-802a-3e846020d248 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:31.319564 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3cfdcf-1a79-40a5-a19d-fd0d8ac5bb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:31.322814 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cfdcf-1a79-40a5-a19d-fd0d8ac5bb6c admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:31.323216 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cfdcf-1a79-40a5-a19d-fd0d8ac5bb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:31.324520 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cfdcf-1a79-40a5-a19d-fd0d8ac5bb6c admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:31.327415 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3cfdcf-1a79-40a5-a19d-fd0d8ac5bb6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:31.331527 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3cfdcf-1a79-40a5-a19d-fd0d8ac5bb6c admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:31.367205 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 822/1625] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:51:31.370089 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3cfdcf-1a79-40a5-a19d-fd0d8ac5bb6c admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:31.370801 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 804/1626] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:51:30 2022] POST /identity/v3/users => generated 309 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:31.373682 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be87280-e1e6-43c1-802a-3e846020d248 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:31.393344 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3cfdcf-1a79-40a5-a19d-fd0d8ac5bb6c admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:31.403880 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b776a62-41e5-4028-ae85-cc217ca7988d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:31.405445 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b776a62-41e5-4028-ae85-cc217ca7988d admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:31.406309 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b776a62-41e5-4028-ae85-cc217ca7988d admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:31.407375 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b776a62-41e5-4028-ae85-cc217ca7988d admin admin] PATH_INFO: `/v3/projects/7c549af6ad1647dfb54f3f2e7de2886b/users/adaeadec88144a31b2916c087a31f636/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:31.413929 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b776a62-41e5-4028-ae85-cc217ca7988d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c549af6ad1647dfb54f3f2e7de2886b, user_id=adaeadec88144a31b2916c087a31f636, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:31.420507 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b776a62-41e5-4028-ae85-cc217ca7988d admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:31.421804 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be87280-e1e6-43c1-802a-3e846020d248 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:31.444159 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493ac76-a855-4eb4-8534-d0db02cdc58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:31.445834 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493ac76-a855-4eb4-8534-d0db02cdc58d admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:31.448934 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493ac76-a855-4eb4-8534-d0db02cdc58d admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:31.449320 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493ac76-a855-4eb4-8534-d0db02cdc58d admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:31.450118 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493ac76-a855-4eb4-8534-d0db02cdc58d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:31.451745 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493ac76-a855-4eb4-8534-d0db02cdc58d admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:31.463585 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 823/1627] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:51:31 2022] PUT /identity/v3/projects/7c549af6ad1647dfb54f3f2e7de2886b/users/adaeadec88144a31b2916c087a31f636/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:31.467701 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1b1b1-d9b9-49ad-bf97-11658d1c0567 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:31.468115 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1b1b1-d9b9-49ad-bf97-11658d1c0567 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:31.468497 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1b1b1-d9b9-49ad-bf97-11658d1c0567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:31.483673 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 805/1628] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:51:31.487484 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493ac76-a855-4eb4-8534-d0db02cdc58d admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:31.503641 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493ac76-a855-4eb4-8534-d0db02cdc58d admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:31.540528 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-96a1b1b1-d9b9-49ad-bf97-11658d1c0567 None None] MFA Rules not processed for user `adaeadec88144a31b2916c087a31f636`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:31.542346 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-96a1b1b1-d9b9-49ad-bf97-11658d1c0567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:31.677958 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d5ae4-8776-491c-acc8-db337a999c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:31.679001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d5ae4-8776-491c-acc8-db337a999c87 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:31.679483 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d5ae4-8776-491c-acc8-db337a999c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:31.680964 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d5ae4-8776-491c-acc8-db337a999c87 admin admin] PATH_INFO: `/v3/projects/b791ad2749cd450fbb2603866598388f/users/83535d3167c34432badbcf72c274f4d7/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:31.691907 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 824/1629] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:31 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:31.705421 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1b1b1-d9b9-49ad-bf97-11658d1c0567 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:31.708671 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d5ae4-8776-491c-acc8-db337a999c87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b791ad2749cd450fbb2603866598388f, user_id=83535d3167c34432badbcf72c274f4d7, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:31.713372 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d5ae4-8776-491c-acc8-db337a999c87 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:31.738905 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 806/1630] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:51:31 2022] PUT /identity/v3/projects/b791ad2749cd450fbb2603866598388f/users/83535d3167c34432badbcf72c274f4d7/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:51:31.744909 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d5ae4-8776-491c-acc8-db337a999c87 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:31.839546 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1b1b1-d9b9-49ad-bf97-11658d1c0567 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:31.851498 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d5ae4-8776-491c-acc8-db337a999c87 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:31.857692 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e879ac-7ec4-4dbc-aa09-8c7a3b8e8778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:31.858962 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e879ac-7ec4-4dbc-aa09-8c7a3b8e8778 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:31.859465 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e879ac-7ec4-4dbc-aa09-8c7a3b8e8778 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:31.859898 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e879ac-7ec4-4dbc-aa09-8c7a3b8e8778 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:31.861244 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e879ac-7ec4-4dbc-aa09-8c7a3b8e8778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:31.897465 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e879ac-7ec4-4dbc-aa09-8c7a3b8e8778 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:31.956720 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 807/1631] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:51:32.039585 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e879ac-7ec4-4dbc-aa09-8c7a3b8e8778 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:32.040839 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:32.040839 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f7005-9f73-4efa-b693-1e4b775f02af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:32.040839 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f7005-9f73-4efa-b693-1e4b775f02af service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:32.040839 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f7005-9f73-4efa-b693-1e4b775f02af service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:32.041367 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f7005-9f73-4efa-b693-1e4b775f02af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:32.041461 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e879ac-7ec4-4dbc-aa09-8c7a3b8e8778 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:32.061047 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45cda92-e340-4190-a054-4d191479d38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:32.063209 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45cda92-e340-4190-a054-4d191479d38a admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:32.063671 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45cda92-e340-4190-a054-4d191479d38a admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:32.065837 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45cda92-e340-4190-a054-4d191479d38a admin admin] PATH_INFO: `/v3/projects/b791ad2749cd450fbb2603866598388f/users/83535d3167c34432badbcf72c274f4d7/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:32.072865 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45cda92-e340-4190-a054-4d191479d38a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b791ad2749cd450fbb2603866598388f, user_id=83535d3167c34432badbcf72c274f4d7, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:32.090359 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45cda92-e340-4190-a054-4d191479d38a admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:32.115057 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:32.135610 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 808/1632] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:51:31 2022] PUT /identity/v3/projects/b791ad2749cd450fbb2603866598388f/users/83535d3167c34432badbcf72c274f4d7/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:32.165699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f7005-9f73-4efa-b693-1e4b775f02af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:32.167501 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f7005-9f73-4efa-b693-1e4b775f02af service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:32.179806 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 825/1633] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:31 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:51:32.747512 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45cda92-e340-4190-a054-4d191479d38a admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:32.870676 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45cda92-e340-4190-a054-4d191479d38a admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:32.878345 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3d394-d289-4ea3-bc65-4a3170ae4667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:32.879331 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3d394-d289-4ea3-bc65-4a3170ae4667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:32.879864 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3d394-d289-4ea3-bc65-4a3170ae4667 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:32.880400 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3d394-d289-4ea3-bc65-4a3170ae4667 admin admin] PATH_INFO: `/v3/users/62705e0bd6d64a8eb00ce0cf37a5376e` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:32.881931 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3d394-d289-4ea3-bc65-4a3170ae4667 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62705e0bd6d64a8eb00ce0cf37a5376e)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:32.883505 dv-cinder-850836-4-smb devstack@keystone.service[91788]: WARNING py.warnings [None req-16d3d394-d289-4ea3-bc65-4a3170ae4667 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:51:32.883505 dv-cinder-850836-4-smb devstack@keystone.service[91788]: warnings.warn(msg) Aug 03 12:51:32.883505 dv-cinder-850836-4-smb devstack@keystone.service[91788]: Aug 03 12:51:32.886539 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3d394-d289-4ea3-bc65-4a3170ae4667 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:33.055458 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-16d3d394-d289-4ea3-bc65-4a3170ae4667 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62705e0bd6d64a8eb00ce0cf37a5376e'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:33.100257 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-16d3d394-d289-4ea3-bc65-4a3170ae4667 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62705e0bd6d64a8eb00ce0cf37a5376e'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:33.101207 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-16d3d394-d289-4ea3-bc65-4a3170ae4667 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62705e0bd6d64a8eb00ce0cf37a5376e'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:33.103561 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-16d3d394-d289-4ea3-bc65-4a3170ae4667 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62705e0bd6d64a8eb00ce0cf37a5376e'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:33.146318 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-16d3d394-d289-4ea3-bc65-4a3170ae4667 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62705e0bd6d64a8eb00ce0cf37a5376e'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:33.181180 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 809/1634] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:51:32 2022] DELETE /identity/v3/users/62705e0bd6d64a8eb00ce0cf37a5376e => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:33.185404 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc5061-5b91-4b7e-8f4e-ad463393b087 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:33.185975 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc5061-5b91-4b7e-8f4e-ad463393b087 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:33.185975 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc5061-5b91-4b7e-8f4e-ad463393b087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:33.233149 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-ddbc5061-5b91-4b7e-8f4e-ad463393b087 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:33.237975 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-ddbc5061-5b91-4b7e-8f4e-ad463393b087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:33.451178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 826/1635] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:33.562608 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3d394-d289-4ea3-bc65-4a3170ae4667 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:33.563818 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-16d3d394-d289-4ea3-bc65-4a3170ae4667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:33.717001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3d394-d289-4ea3-bc65-4a3170ae4667 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:33.734833 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ab46f-9232-48d8-89c3-d2977c5c6591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:33.735494 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ab46f-9232-48d8-89c3-d2977c5c6591 service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:33.735781 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ab46f-9232-48d8-89c3-d2977c5c6591 service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:33.736057 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ab46f-9232-48d8-89c3-d2977c5c6591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:33.755446 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ab46f-9232-48d8-89c3-d2977c5c6591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:33.758551 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ab46f-9232-48d8-89c3-d2977c5c6591 service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:33.790840 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 810/1636] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:33.828716 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db84f33-bb28-4991-b6ed-49d1fe66fc42 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:33.829244 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db84f33-bb28-4991-b6ed-49d1fe66fc42 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:33.829698 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db84f33-bb28-4991-b6ed-49d1fe66fc42 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:33.838330 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 827/1637] 10.222.0.46 () {54 vars in 962 bytes} [Wed Aug 3 12:51:33 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:33.845941 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536854a0-497c-424f-b4f3-64aa777319a9 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:33.846765 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536854a0-497c-424f-b4f3-64aa777319a9 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:33.847361 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536854a0-497c-424f-b4f3-64aa777319a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:33.928385 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-536854a0-497c-424f-b4f3-64aa777319a9 None None] MFA Rules not processed for user `dcf670ff4f62486dbf70cf6ea0f08bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:33.930526 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-536854a0-497c-424f-b4f3-64aa777319a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:33.943890 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:34.112899 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 811/1638] 10.222.0.46 () {58 vars in 1059 bytes} [Wed Aug 3 12:51:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:51:34.123332 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0795a-a88e-489d-b31f-0911410d0b86 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:34.123621 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0795a-a88e-489d-b31f-0911410d0b86 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:34.124152 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0795a-a88e-489d-b31f-0911410d0b86 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:34.129651 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 828/1639] 10.222.0.46 () {54 vars in 912 bytes} [Wed Aug 3 12:51:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:34.132720 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6496234-3222-44d3-b0df-0d9f852368a9 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:34.134063 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6496234-3222-44d3-b0df-0d9f852368a9 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:34.134749 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6496234-3222-44d3-b0df-0d9f852368a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:34.183267 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-d6496234-3222-44d3-b0df-0d9f852368a9 None None] MFA Rules not processed for user `dcf670ff4f62486dbf70cf6ea0f08bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:34.185185 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-d6496234-3222-44d3-b0df-0d9f852368a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:34.203777 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 812/1640] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Aug 3 12:51:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:51:34.217480 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0795a-a88e-489d-b31f-0911410d0b86 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:34.219324 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-d2f0795a-a88e-489d-b31f-0911410d0b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:34.312347 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0795a-a88e-489d-b31f-0911410d0b86 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:34.316619 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c30884-98c2-4631-a2a1-437e0cc4325d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:34.317266 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c30884-98c2-4631-a2a1-437e0cc4325d service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:34.317593 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c30884-98c2-4631-a2a1-437e0cc4325d service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:34.317872 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c30884-98c2-4631-a2a1-437e0cc4325d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:34.334857 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c30884-98c2-4631-a2a1-437e0cc4325d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:34.336388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c30884-98c2-4631-a2a1-437e0cc4325d service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:34.350113 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 829/1641] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:35.451518 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef780ba7-c8a2-4138-95a1-6ca7d94ee289 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:35.452151 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef780ba7-c8a2-4138-95a1-6ca7d94ee289 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:35.452151 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef780ba7-c8a2-4138-95a1-6ca7d94ee289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:35.496977 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-ef780ba7-c8a2-4138-95a1-6ca7d94ee289 None None] MFA Rules not processed for user `83535d3167c34432badbcf72c274f4d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:35.499293 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-ef780ba7-c8a2-4138-95a1-6ca7d94ee289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:35.562333 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c30884-98c2-4631-a2a1-437e0cc4325d service cinder] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:35.564587 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-61c30884-98c2-4631-a2a1-437e0cc4325d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:35.586775 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 813/1642] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:35 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:35.593541 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c30884-98c2-4631-a2a1-437e0cc4325d service cinder] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:35.601155 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b0775-ba97-4652-ba12-831c9f1f48cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:35.602039 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b0775-ba97-4652-ba12-831c9f1f48cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:35.603637 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b0775-ba97-4652-ba12-831c9f1f48cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:35.604050 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b0775-ba97-4652-ba12-831c9f1f48cd admin admin] PATH_INFO: `/v3/projects/b5015316fc864e8587b890b03dd7990e` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:35.605944 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b0775-ba97-4652-ba12-831c9f1f48cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5015316fc864e8587b890b03dd7990e)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:35.607118 dv-cinder-850836-4-smb devstack@keystone.service[91789]: WARNING py.warnings [None req-047b0775-ba97-4652-ba12-831c9f1f48cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 03 12:51:35.607118 dv-cinder-850836-4-smb devstack@keystone.service[91789]: warnings.warn(msg) Aug 03 12:51:35.607118 dv-cinder-850836-4-smb devstack@keystone.service[91789]: Aug 03 12:51:35.608618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b0775-ba97-4652-ba12-831c9f1f48cd admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:35.669425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:35.701199 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-047b0775-ba97-4652-ba12-831c9f1f48cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5015316fc864e8587b890b03dd7990e', 'request_id': 'req-047b0775-ba97-4652-ba12-831c9f1f48cd'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:35.726101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-047b0775-ba97-4652-ba12-831c9f1f48cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5015316fc864e8587b890b03dd7990e', 'request_id': 'req-047b0775-ba97-4652-ba12-831c9f1f48cd'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:35.742762 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-047b0775-ba97-4652-ba12-831c9f1f48cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5015316fc864e8587b890b03dd7990e', 'request_id': 'req-047b0775-ba97-4652-ba12-831c9f1f48cd'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:35.769877 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-047b0775-ba97-4652-ba12-831c9f1f48cd admin admin] The token cache is being invalidate because project b5015316fc864e8587b890b03dd7990e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:51:35.770435 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-047b0775-ba97-4652-ba12-831c9f1f48cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:35.771845 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-047b0775-ba97-4652-ba12-831c9f1f48cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:35.774315 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 830/1643] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:51:35 2022] DELETE /identity/v3/projects/b5015316fc864e8587b890b03dd7990e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:35.778368 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef780ba7-c8a2-4138-95a1-6ca7d94ee289 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:35.793276 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef780ba7-c8a2-4138-95a1-6ca7d94ee289 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:35.887004 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7545c8-8961-4f36-98af-1c54bda4a5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:35.888238 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7545c8-8961-4f36-98af-1c54bda4a5ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:35.888723 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7545c8-8961-4f36-98af-1c54bda4a5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:35.889199 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7545c8-8961-4f36-98af-1c54bda4a5ce admin admin] PATH_INFO: `/v3/users/adaeadec88144a31b2916c087a31f636` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:35.890803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7545c8-8961-4f36-98af-1c54bda4a5ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=adaeadec88144a31b2916c087a31f636)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:35.893583 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7545c8-8961-4f36-98af-1c54bda4a5ce admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:35.927103 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:35.990082 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-5d7545c8-8961-4f36-98af-1c54bda4a5ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adaeadec88144a31b2916c087a31f636'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:36.006523 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-5d7545c8-8961-4f36-98af-1c54bda4a5ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adaeadec88144a31b2916c087a31f636'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:36.007663 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-5d7545c8-8961-4f36-98af-1c54bda4a5ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adaeadec88144a31b2916c087a31f636'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:36.008404 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-5d7545c8-8961-4f36-98af-1c54bda4a5ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adaeadec88144a31b2916c087a31f636'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:36.041742 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-5d7545c8-8961-4f36-98af-1c54bda4a5ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adaeadec88144a31b2916c087a31f636'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:36.077185 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 814/1644] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:51:35 2022] DELETE /identity/v3/users/adaeadec88144a31b2916c087a31f636 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:36.487644 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b0775-ba97-4652-ba12-831c9f1f48cd admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:36.489105 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-047b0775-ba97-4652-ba12-831c9f1f48cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:36.511862 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b0775-ba97-4652-ba12-831c9f1f48cd admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:36.591009 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78fbab7-57b1-47c6-b14d-3c844e66b09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:36.592853 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fbab7-57b1-47c6-b14d-3c844e66b09d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:36.593301 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fbab7-57b1-47c6-b14d-3c844e66b09d admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:36.593831 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fbab7-57b1-47c6-b14d-3c844e66b09d admin admin] PATH_INFO: `/v3/projects/7c549af6ad1647dfb54f3f2e7de2886b` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:36.595449 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78fbab7-57b1-47c6-b14d-3c844e66b09d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c549af6ad1647dfb54f3f2e7de2886b)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:36.598173 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78fbab7-57b1-47c6-b14d-3c844e66b09d admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:36.675619 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-a78fbab7-57b1-47c6-b14d-3c844e66b09d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c549af6ad1647dfb54f3f2e7de2886b', 'request_id': 'req-a78fbab7-57b1-47c6-b14d-3c844e66b09d'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:36.684514 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-a78fbab7-57b1-47c6-b14d-3c844e66b09d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c549af6ad1647dfb54f3f2e7de2886b', 'request_id': 'req-a78fbab7-57b1-47c6-b14d-3c844e66b09d'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:36.690593 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856f91f-81e5-4624-a217-bdb0979992de None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:36.691672 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856f91f-81e5-4624-a217-bdb0979992de None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:36.692090 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856f91f-81e5-4624-a217-bdb0979992de None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:36.694700 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 815/1645] 10.222.0.46 () {54 vars in 962 bytes} [Wed Aug 3 12:51:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:36.696841 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-a78fbab7-57b1-47c6-b14d-3c844e66b09d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c549af6ad1647dfb54f3f2e7de2886b', 'request_id': 'req-a78fbab7-57b1-47c6-b14d-3c844e66b09d'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:36.709763 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ba6c5-918d-4fe5-bd04-8ce78dcf93d1 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:36.710235 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ba6c5-918d-4fe5-bd04-8ce78dcf93d1 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:36.710684 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ba6c5-918d-4fe5-bd04-8ce78dcf93d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:36.718919 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-a78fbab7-57b1-47c6-b14d-3c844e66b09d admin admin] The token cache is being invalidate because project 7c549af6ad1647dfb54f3f2e7de2886b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:51:36.719212 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-a78fbab7-57b1-47c6-b14d-3c844e66b09d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:36.720852 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-a78fbab7-57b1-47c6-b14d-3c844e66b09d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:36.722665 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 831/1646] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:51:36 2022] DELETE /identity/v3/projects/7c549af6ad1647dfb54f3f2e7de2886b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:36.727603 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acfb8a-70a9-4a2a-a7bb-2e1251840408 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:36.728746 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acfb8a-70a9-4a2a-a7bb-2e1251840408 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:36.729282 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acfb8a-70a9-4a2a-a7bb-2e1251840408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:36.746946 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-278ba6c5-918d-4fe5-bd04-8ce78dcf93d1 None None] MFA Rules not processed for user `dcf670ff4f62486dbf70cf6ea0f08bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:36.752234 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-278ba6c5-918d-4fe5-bd04-8ce78dcf93d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:36.759331 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-70acfb8a-70a9-4a2a-a7bb-2e1251840408 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:36.761816 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-70acfb8a-70a9-4a2a-a7bb-2e1251840408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:36.861818 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:36.913719 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 832/1647] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:36.915263 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c789bf-c628-4a3a-9169-6504de425d99 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:36.916897 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 816/1648] 10.222.0.46 () {58 vars in 1059 bytes} [Wed Aug 3 12:51:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:51:36.917122 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c789bf-c628-4a3a-9169-6504de425d99 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:36.917422 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c789bf-c628-4a3a-9169-6504de425d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:36.924266 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45648b83-2077-4e26-b077-4a8051cbae29 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:36.924563 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45648b83-2077-4e26-b077-4a8051cbae29 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:36.924846 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45648b83-2077-4e26-b077-4a8051cbae29 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:36.928459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 817/1649] 10.222.0.46 () {54 vars in 912 bytes} [Wed Aug 3 12:51:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:36.935351 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d120f6f-7082-4f6e-9539-92f30b51de0f None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:36.936016 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d120f6f-7082-4f6e-9539-92f30b51de0f None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:36.936313 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d120f6f-7082-4f6e-9539-92f30b51de0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:36.974588 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-48c789bf-c628-4a3a-9169-6504de425d99 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:36.978775 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-48c789bf-c628-4a3a-9169-6504de425d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:36.988055 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-3d120f6f-7082-4f6e-9539-92f30b51de0f None None] MFA Rules not processed for user `dcf670ff4f62486dbf70cf6ea0f08bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:36.992688 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-3d120f6f-7082-4f6e-9539-92f30b51de0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:37.002844 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 833/1650] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:37.003789 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c789bf-c628-4a3a-9169-6504de425d99 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:37.018516 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c789bf-c628-4a3a-9169-6504de425d99 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:37.022920 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 818/1651] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Aug 3 12:51:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:37.025636 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fdbcb-5081-47d7-8075-53e647d9cd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:37.027317 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fdbcb-5081-47d7-8075-53e647d9cd43 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:37.027611 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fdbcb-5081-47d7-8075-53e647d9cd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:37.027924 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fdbcb-5081-47d7-8075-53e647d9cd43 admin admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:37.028904 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71fdbcb-5081-47d7-8075-53e647d9cd43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:37.029219 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71fdbcb-5081-47d7-8075-53e647d9cd43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:37.031806 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71fdbcb-5081-47d7-8075-53e647d9cd43 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:37.038481 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d120f6f-7082-4f6e-9539-92f30b51de0f None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:37.042147 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-3d120f6f-7082-4f6e-9539-92f30b51de0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:37.049620 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 834/1652] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:37.054877 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fdbcb-5081-47d7-8075-53e647d9cd43 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:37.071210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fdbcb-5081-47d7-8075-53e647d9cd43 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:37.077955 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bee482-2ae1-43d0-b2f5-070413b296ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:37.079090 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bee482-2ae1-43d0-b2f5-070413b296ba admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:37.081970 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bee482-2ae1-43d0-b2f5-070413b296ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:37.084256 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bee482-2ae1-43d0-b2f5-070413b296ba admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:37.085134 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bee482-2ae1-43d0-b2f5-070413b296ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:37.089162 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bee482-2ae1-43d0-b2f5-070413b296ba admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:37.154549 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 835/1653] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:51:37 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:37.156804 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bee482-2ae1-43d0-b2f5-070413b296ba admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:37.166932 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d120f6f-7082-4f6e-9539-92f30b51de0f None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:37.229785 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:37.253812 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b3248c-acbe-491b-b325-d040bf959b64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:37.254455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3248c-acbe-491b-b325-d040bf959b64 service cinder] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:37.254736 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3248c-acbe-491b-b325-d040bf959b64 service cinder] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:37.255009 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3248c-acbe-491b-b325-d040bf959b64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:37.272349 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bee482-2ae1-43d0-b2f5-070413b296ba admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:37.278573 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbd7da-8697-4d87-95d8-807545b89d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:37.279555 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbd7da-8697-4d87-95d8-807545b89d47 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:37.280591 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbd7da-8697-4d87-95d8-807545b89d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:37.282888 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbd7da-8697-4d87-95d8-807545b89d47 admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:37.284156 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dbd7da-8697-4d87-95d8-807545b89d47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:37.287842 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dbd7da-8697-4d87-95d8-807545b89d47 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:37.348871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b3248c-acbe-491b-b325-d040bf959b64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:37.350357 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b3248c-acbe-491b-b325-d040bf959b64 service cinder] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:37.356989 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 836/1654] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:51:37 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:37.358497 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbd7da-8697-4d87-95d8-807545b89d47 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:37.363735 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 819/1655] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:37.436470 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbd7da-8697-4d87-95d8-807545b89d47 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:37.453815 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5526d-73aa-43dc-805b-aea275887196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:37.454639 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5526d-73aa-43dc-805b-aea275887196 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:37.454926 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5526d-73aa-43dc-805b-aea275887196 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:37.456100 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5526d-73aa-43dc-805b-aea275887196 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:37.456833 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5526d-73aa-43dc-805b-aea275887196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:37.460890 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5526d-73aa-43dc-805b-aea275887196 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:37.509928 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 837/1656] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:51:37.512755 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b3248c-acbe-491b-b325-d040bf959b64 service cinder] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:37.554677 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b3248c-acbe-491b-b325-d040bf959b64 service cinder] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:37.568240 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e48192-82f2-434f-9acb-c37630a87634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:37.569022 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e48192-82f2-434f-9acb-c37630a87634 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:37.573996 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e48192-82f2-434f-9acb-c37630a87634 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:37.573996 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e48192-82f2-434f-9acb-c37630a87634 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:37.574941 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e48192-82f2-434f-9acb-c37630a87634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:37.586228 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e48192-82f2-434f-9acb-c37630a87634 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:37.609016 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 820/1657] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:51:37.613159 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5526d-73aa-43dc-805b-aea275887196 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:37.630943 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5526d-73aa-43dc-805b-aea275887196 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:37.651882 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c0177-02ae-44a2-8ab1-3ce0d1c625a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:37.654127 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c0177-02ae-44a2-8ab1-3ce0d1c625a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:37.655032 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c0177-02ae-44a2-8ab1-3ce0d1c625a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:37.656635 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c0177-02ae-44a2-8ab1-3ce0d1c625a5 admin admin] PATH_INFO: `/v3/projects/4c97e1920ad84c8ca03d327f8ffaf648/users/789b9dc1343c47c591643aa6dba42e80/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:37.704684 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c0177-02ae-44a2-8ab1-3ce0d1c625a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c97e1920ad84c8ca03d327f8ffaf648, user_id=789b9dc1343c47c591643aa6dba42e80, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:37.718569 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c0177-02ae-44a2-8ab1-3ce0d1c625a5 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:37.762758 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 838/1658] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:51:37 2022] PUT /identity/v3/projects/4c97e1920ad84c8ca03d327f8ffaf648/users/789b9dc1343c47c591643aa6dba42e80/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:37.775487 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10358806-5bed-4f20-938c-41d5ddab00c7 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:37.776109 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10358806-5bed-4f20-938c-41d5ddab00c7 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:37.776579 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10358806-5bed-4f20-938c-41d5ddab00c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:37.840757 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-10358806-5bed-4f20-938c-41d5ddab00c7 None None] MFA Rules not processed for user `789b9dc1343c47c591643aa6dba42e80`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:37.846283 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-10358806-5bed-4f20-938c-41d5ddab00c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:38.098232 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 821/1659] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:38.113370 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c0177-02ae-44a2-8ab1-3ce0d1c625a5 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:38.342322 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c0177-02ae-44a2-8ab1-3ce0d1c625a5 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:38.357864 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f00fd-0c7f-4946-b184-b091e65da966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:38.358580 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f00fd-0c7f-4946-b184-b091e65da966 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:38.358833 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f00fd-0c7f-4946-b184-b091e65da966 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:38.359121 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f00fd-0c7f-4946-b184-b091e65da966 admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:38.359823 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f00fd-0c7f-4946-b184-b091e65da966 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:38.364005 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f00fd-0c7f-4946-b184-b091e65da966 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:38.402395 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:38.437785 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10358806-5bed-4f20-938c-41d5ddab00c7 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:38.438176 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 839/1660] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:51:38 2022] POST /identity/v3/projects => generated 371 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:51:38.453516 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10358806-5bed-4f20-938c-41d5ddab00c7 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:38.566871 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee3742-b66a-4fdb-a3d8-ded5fa61e16a None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:38.568437 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee3742-b66a-4fdb-a3d8-ded5fa61e16a None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:38.568899 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee3742-b66a-4fdb-a3d8-ded5fa61e16a None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:38.570531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 840/1661] 10.222.0.46 () {54 vars in 921 bytes} [Wed Aug 3 12:51:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:51:38.584271 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b764f57-7edb-4940-8682-c42e33ca4989 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:38.584583 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b764f57-7edb-4940-8682-c42e33ca4989 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:38.584862 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b764f57-7edb-4940-8682-c42e33ca4989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:38.653034 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-6b764f57-7edb-4940-8682-c42e33ca4989 None None] MFA Rules not processed for user `a56847173abb48d39c0ee6fb9cdbbbaa`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:38.658837 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-6b764f57-7edb-4940-8682-c42e33ca4989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:38.688119 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c2c4c-30d5-403a-935d-39d8867e10b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:38.695200 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c2c4c-30d5-403a-935d-39d8867e10b0 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:38.696311 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c2c4c-30d5-403a-935d-39d8867e10b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:38.698050 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c2c4c-30d5-403a-935d-39d8867e10b0 admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:38.698956 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c2c4c-30d5-403a-935d-39d8867e10b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:38.703993 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c2c4c-30d5-403a-935d-39d8867e10b0 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:38.734326 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:38.766637 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 822/1662] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:51:38 2022] POST /identity/v3/users => generated 292 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:51:38.770779 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c2c4c-30d5-403a-935d-39d8867e10b0 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:38.798092 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c2c4c-30d5-403a-935d-39d8867e10b0 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:38.810561 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401063b8-459b-42f0-b6c5-5d56764f4dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:38.812539 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401063b8-459b-42f0-b6c5-5d56764f4dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:38.812973 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401063b8-459b-42f0-b6c5-5d56764f4dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:38.813403 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401063b8-459b-42f0-b6c5-5d56764f4dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:38.814491 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401063b8-459b-42f0-b6c5-5d56764f4dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:38.816478 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401063b8-459b-42f0-b6c5-5d56764f4dd4 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:38.848905 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 823/1663] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:51:38.853441 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401063b8-459b-42f0-b6c5-5d56764f4dd4 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:38.859982 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 841/1664] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Aug 3 12:51:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:51:38.869208 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401063b8-459b-42f0-b6c5-5d56764f4dd4 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:38.915871 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf9472-6e3e-4ba6-bf3b-85b8cfb5ea86 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:38.915871 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf9472-6e3e-4ba6-bf3b-85b8cfb5ea86 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:38.915871 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf9472-6e3e-4ba6-bf3b-85b8cfb5ea86 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:38.917267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 842/1665] 10.222.0.46 () {54 vars in 961 bytes} [Wed Aug 3 12:51:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:38.919411 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d9f4b-73f3-4fce-a0fd-023931d5be80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:38.920267 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d9f4b-73f3-4fce-a0fd-023931d5be80 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:38.924516 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca9e9f-c104-4a2d-800c-eb033a86083b None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:38.924933 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca9e9f-c104-4a2d-800c-eb033a86083b None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:38.925317 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca9e9f-c104-4a2d-800c-eb033a86083b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:38.928223 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d9f4b-73f3-4fce-a0fd-023931d5be80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:38.929398 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d9f4b-73f3-4fce-a0fd-023931d5be80 admin admin] PATH_INFO: `/v3/projects/038019be3ea24a9bba43d772f0619a80/users/0b2e81cd8c194c3ba0e83ddc7a447ff1/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:39.021830 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d9f4b-73f3-4fce-a0fd-023931d5be80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=038019be3ea24a9bba43d772f0619a80, user_id=0b2e81cd8c194c3ba0e83ddc7a447ff1, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:39.025895 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d9f4b-73f3-4fce-a0fd-023931d5be80 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:39.026377 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-39ca9e9f-c104-4a2d-800c-eb033a86083b None None] MFA Rules not processed for user `a56847173abb48d39c0ee6fb9cdbbbaa`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:39.027791 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-39ca9e9f-c104-4a2d-800c-eb033a86083b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:39.055963 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 824/1666] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:51:38 2022] PUT /identity/v3/projects/038019be3ea24a9bba43d772f0619a80/users/0b2e81cd8c194c3ba0e83ddc7a447ff1/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:39.057721 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d9f4b-73f3-4fce-a0fd-023931d5be80 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:39.062973 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 843/1667] 10.222.0.46 () {58 vars in 1058 bytes} [Wed Aug 3 12:51:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:39.072654 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca9e9f-c104-4a2d-800c-eb033a86083b None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:39.096993 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca9e9f-c104-4a2d-800c-eb033a86083b None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:39.259102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d9f4b-73f3-4fce-a0fd-023931d5be80 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:39.283721 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085a14a-5a01-4aa2-816c-ccbb5cc07170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:39.283908 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085a14a-5a01-4aa2-816c-ccbb5cc07170 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:39.284172 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085a14a-5a01-4aa2-816c-ccbb5cc07170 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:39.284737 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085a14a-5a01-4aa2-816c-ccbb5cc07170 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:39.285157 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085a14a-5a01-4aa2-816c-ccbb5cc07170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:39.286818 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085a14a-5a01-4aa2-816c-ccbb5cc07170 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:39.301916 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 825/1668] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:51:39.302902 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085a14a-5a01-4aa2-816c-ccbb5cc07170 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:39.329931 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085a14a-5a01-4aa2-816c-ccbb5cc07170 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:39.331018 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47ebcd-c227-488c-8afc-9c6f3beac8df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56847173abb48d39c0ee6fb9cdbbbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:39.332340 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47ebcd-c227-488c-8afc-9c6f3beac8df service placement] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:39.332648 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47ebcd-c227-488c-8afc-9c6f3beac8df service placement] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:39.333412 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47ebcd-c227-488c-8afc-9c6f3beac8df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:39.342017 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168105bb-0cf1-48a5-b9e6-f32710694ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:39.342723 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168105bb-0cf1-48a5-b9e6-f32710694ce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:39.343013 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168105bb-0cf1-48a5-b9e6-f32710694ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:39.343293 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168105bb-0cf1-48a5-b9e6-f32710694ce3 admin admin] PATH_INFO: `/v3/projects/038019be3ea24a9bba43d772f0619a80/users/0b2e81cd8c194c3ba0e83ddc7a447ff1/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:39.345296 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168105bb-0cf1-48a5-b9e6-f32710694ce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=038019be3ea24a9bba43d772f0619a80, user_id=0b2e81cd8c194c3ba0e83ddc7a447ff1, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:39.348066 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168105bb-0cf1-48a5-b9e6-f32710694ce3 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:39.356427 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa47ebcd-c227-488c-8afc-9c6f3beac8df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:39.358487 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa47ebcd-c227-488c-8afc-9c6f3beac8df service placement] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:39.386493 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 826/1669] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:51:39 2022] PUT /identity/v3/projects/038019be3ea24a9bba43d772f0619a80/users/0b2e81cd8c194c3ba0e83ddc7a447ff1/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:39.388461 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 844/1670] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:39.396906 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35439ae-af1a-41da-8ab3-46584a594456 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:39.397122 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35439ae-af1a-41da-8ab3-46584a594456 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:39.397567 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35439ae-af1a-41da-8ab3-46584a594456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:39.478097 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-b35439ae-af1a-41da-8ab3-46584a594456 None None] MFA Rules not processed for user `0b2e81cd8c194c3ba0e83ddc7a447ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:39.480289 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-b35439ae-af1a-41da-8ab3-46584a594456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:39.693886 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 827/1671] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:39.706934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47ebcd-c227-488c-8afc-9c6f3beac8df service placement] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:39.907848 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47ebcd-c227-488c-8afc-9c6f3beac8df service placement] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:39.998347 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:40.093028 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c267f-34c4-4e10-87a0-d58d4883204b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:40.093733 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c267f-34c4-4e10-87a0-d58d4883204b service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:40.094063 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c267f-34c4-4e10-87a0-d58d4883204b service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:40.094346 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c267f-34c4-4e10-87a0-d58d4883204b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:40.107686 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c267f-34c4-4e10-87a0-d58d4883204b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:40.109332 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c267f-34c4-4e10-87a0-d58d4883204b service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:40.124862 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 845/1672] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:41.045897 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35439ae-af1a-41da-8ab3-46584a594456 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:41.123103 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:41.204330 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35439ae-af1a-41da-8ab3-46584a594456 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:41.213049 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dba7f0-f678-4e46-89c9-c3553cc2c4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:41.213896 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dba7f0-f678-4e46-89c9-c3553cc2c4a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:41.214286 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dba7f0-f678-4e46-89c9-c3553cc2c4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:41.214696 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dba7f0-f678-4e46-89c9-c3553cc2c4a8 admin admin] PATH_INFO: `/v3/users/789b9dc1343c47c591643aa6dba42e80` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:41.216517 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dba7f0-f678-4e46-89c9-c3553cc2c4a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=789b9dc1343c47c591643aa6dba42e80)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:41.218867 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dba7f0-f678-4e46-89c9-c3553cc2c4a8 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:41.296284 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-57dba7f0-f678-4e46-89c9-c3553cc2c4a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '789b9dc1343c47c591643aa6dba42e80'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:41.312499 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-57dba7f0-f678-4e46-89c9-c3553cc2c4a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '789b9dc1343c47c591643aa6dba42e80'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:41.313182 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-57dba7f0-f678-4e46-89c9-c3553cc2c4a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '789b9dc1343c47c591643aa6dba42e80'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:41.314047 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-57dba7f0-f678-4e46-89c9-c3553cc2c4a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '789b9dc1343c47c591643aa6dba42e80'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:41.336243 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-57dba7f0-f678-4e46-89c9-c3553cc2c4a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '789b9dc1343c47c591643aa6dba42e80'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:41.367131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 828/1673] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:51:41 2022] DELETE /identity/v3/users/789b9dc1343c47c591643aa6dba42e80 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:41.371851 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4287e-0002-4b8f-8d41-f76965bc1835 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:41.372332 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4287e-0002-4b8f-8d41-f76965bc1835 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:41.372403 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4287e-0002-4b8f-8d41-f76965bc1835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:41.407812 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-2ea4287e-0002-4b8f-8d41-f76965bc1835 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:41.409352 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-2ea4287e-0002-4b8f-8d41-f76965bc1835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:41.591184 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 846/1674] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:41.695362 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dba7f0-f678-4e46-89c9-c3553cc2c4a8 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:41.697645 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-57dba7f0-f678-4e46-89c9-c3553cc2c4a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:41.823163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dba7f0-f678-4e46-89c9-c3553cc2c4a8 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:41.836589 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa172e-5695-4f18-a7ee-6157c81faa5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:41.837244 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa172e-5695-4f18-a7ee-6157c81faa5e service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:41.837580 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa172e-5695-4f18-a7ee-6157c81faa5e service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:41.837933 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa172e-5695-4f18-a7ee-6157c81faa5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:41.876789 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa172e-5695-4f18-a7ee-6157c81faa5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:41.878341 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa172e-5695-4f18-a7ee-6157c81faa5e service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:41.923680 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 829/1675] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:42.222022 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4287e-0002-4b8f-8d41-f76965bc1835 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:42.223624 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-2ea4287e-0002-4b8f-8d41-f76965bc1835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:42.248239 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4287e-0002-4b8f-8d41-f76965bc1835 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:42.263093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504c2fc-fa2a-4d24-b3bd-b394cc012843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:42.263764 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504c2fc-fa2a-4d24-b3bd-b394cc012843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:42.264079 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504c2fc-fa2a-4d24-b3bd-b394cc012843 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:42.264366 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504c2fc-fa2a-4d24-b3bd-b394cc012843 admin admin] PATH_INFO: `/v3/users/8015b56c5cc5480f9f0276201529a96a` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:42.266241 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504c2fc-fa2a-4d24-b3bd-b394cc012843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8015b56c5cc5480f9f0276201529a96a)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:42.273557 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504c2fc-fa2a-4d24-b3bd-b394cc012843 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:42.372512 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-3504c2fc-fa2a-4d24-b3bd-b394cc012843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8015b56c5cc5480f9f0276201529a96a'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:42.373407 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-3504c2fc-fa2a-4d24-b3bd-b394cc012843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8015b56c5cc5480f9f0276201529a96a'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:42.376518 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-3504c2fc-fa2a-4d24-b3bd-b394cc012843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8015b56c5cc5480f9f0276201529a96a'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:42.424659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-3504c2fc-fa2a-4d24-b3bd-b394cc012843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8015b56c5cc5480f9f0276201529a96a'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:42.452161 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-3504c2fc-fa2a-4d24-b3bd-b394cc012843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8015b56c5cc5480f9f0276201529a96a'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:42.500399 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 847/1676] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:51:42 2022] DELETE /identity/v3/users/8015b56c5cc5480f9f0276201529a96a => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:51:43.763678 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa172e-5695-4f18-a7ee-6157c81faa5e service neutron] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:43.780348 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa172e-5695-4f18-a7ee-6157c81faa5e service neutron] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:43.908323 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:43.940970 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd57be-7354-4173-b08d-9204595d4fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:43.941674 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd57be-7354-4173-b08d-9204595d4fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:43.941964 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd57be-7354-4173-b08d-9204595d4fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:43.942239 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd57be-7354-4173-b08d-9204595d4fa0 admin admin] PATH_INFO: `/v3/projects/d2235c29f1294ba7ab1a4e7f1434a447` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:43.943446 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd57be-7354-4173-b08d-9204595d4fa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2235c29f1294ba7ab1a4e7f1434a447)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:43.945392 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd57be-7354-4173-b08d-9204595d4fa0 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:44.074495 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-1bfd57be-7354-4173-b08d-9204595d4fa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2235c29f1294ba7ab1a4e7f1434a447', 'request_id': 'req-1bfd57be-7354-4173-b08d-9204595d4fa0'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:44.095288 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-1bfd57be-7354-4173-b08d-9204595d4fa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2235c29f1294ba7ab1a4e7f1434a447', 'request_id': 'req-1bfd57be-7354-4173-b08d-9204595d4fa0'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:44.112949 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-1bfd57be-7354-4173-b08d-9204595d4fa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2235c29f1294ba7ab1a4e7f1434a447', 'request_id': 'req-1bfd57be-7354-4173-b08d-9204595d4fa0'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:44.184386 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-1bfd57be-7354-4173-b08d-9204595d4fa0 admin admin] The token cache is being invalidate because project d2235c29f1294ba7ab1a4e7f1434a447 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:51:44.184670 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-1bfd57be-7354-4173-b08d-9204595d4fa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:44.185350 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-1bfd57be-7354-4173-b08d-9204595d4fa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:44.187250 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 830/1677] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:51:43 2022] DELETE /identity/v3/projects/d2235c29f1294ba7ab1a4e7f1434a447 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:44.191729 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504c2fc-fa2a-4d24-b3bd-b394cc012843 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:44.193902 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-3504c2fc-fa2a-4d24-b3bd-b394cc012843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:44.265289 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504c2fc-fa2a-4d24-b3bd-b394cc012843 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:44.463633 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:44.558422 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8111a-3c55-444e-9398-4eb3b6a98dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:44.559085 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8111a-3c55-444e-9398-4eb3b6a98dff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:44.559373 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8111a-3c55-444e-9398-4eb3b6a98dff admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:44.559664 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8111a-3c55-444e-9398-4eb3b6a98dff admin admin] PATH_INFO: `/v3/users/83535d3167c34432badbcf72c274f4d7` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:44.564713 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8111a-3c55-444e-9398-4eb3b6a98dff admin admin] RBAC: Authorizing `identity:delete_user(user_id=83535d3167c34432badbcf72c274f4d7)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:44.569924 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8111a-3c55-444e-9398-4eb3b6a98dff admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:44.802585 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-53d8111a-3c55-444e-9398-4eb3b6a98dff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83535d3167c34432badbcf72c274f4d7'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:44.807048 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-53d8111a-3c55-444e-9398-4eb3b6a98dff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83535d3167c34432badbcf72c274f4d7'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:44.809908 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-53d8111a-3c55-444e-9398-4eb3b6a98dff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83535d3167c34432badbcf72c274f4d7'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:44.943473 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-53d8111a-3c55-444e-9398-4eb3b6a98dff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83535d3167c34432badbcf72c274f4d7'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:44.959354 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-53d8111a-3c55-444e-9398-4eb3b6a98dff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83535d3167c34432badbcf72c274f4d7'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:45.003403 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 848/1678] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:51:44 2022] DELETE /identity/v3/users/83535d3167c34432badbcf72c274f4d7 => generated 0 bytes in 812 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:45.225580 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd57be-7354-4173-b08d-9204595d4fa0 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:45.230734 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-1bfd57be-7354-4173-b08d-9204595d4fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:45.249750 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd57be-7354-4173-b08d-9204595d4fa0 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:45.376476 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16a173-9eb9-4f11-96aa-cffda422c9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:45.378192 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16a173-9eb9-4f11-96aa-cffda422c9c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:45.379080 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16a173-9eb9-4f11-96aa-cffda422c9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:45.379988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16a173-9eb9-4f11-96aa-cffda422c9c6 admin admin] PATH_INFO: `/v3/projects/4c97e1920ad84c8ca03d327f8ffaf648` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:45.381473 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16a173-9eb9-4f11-96aa-cffda422c9c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c97e1920ad84c8ca03d327f8ffaf648)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:45.384319 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16a173-9eb9-4f11-96aa-cffda422c9c6 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:45.537675 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-5b16a173-9eb9-4f11-96aa-cffda422c9c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c97e1920ad84c8ca03d327f8ffaf648', 'request_id': 'req-5b16a173-9eb9-4f11-96aa-cffda422c9c6'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:45.552508 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-5b16a173-9eb9-4f11-96aa-cffda422c9c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c97e1920ad84c8ca03d327f8ffaf648', 'request_id': 'req-5b16a173-9eb9-4f11-96aa-cffda422c9c6'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:45.568592 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-5b16a173-9eb9-4f11-96aa-cffda422c9c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c97e1920ad84c8ca03d327f8ffaf648', 'request_id': 'req-5b16a173-9eb9-4f11-96aa-cffda422c9c6'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:45.610093 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-5b16a173-9eb9-4f11-96aa-cffda422c9c6 admin admin] The token cache is being invalidate because project 4c97e1920ad84c8ca03d327f8ffaf648 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:51:45.610394 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-5b16a173-9eb9-4f11-96aa-cffda422c9c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:45.615198 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-5b16a173-9eb9-4f11-96aa-cffda422c9c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:45.619762 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 831/1679] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:51:45 2022] DELETE /identity/v3/projects/4c97e1920ad84c8ca03d327f8ffaf648 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:45.623482 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8111a-3c55-444e-9398-4eb3b6a98dff admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:45.625202 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-53d8111a-3c55-444e-9398-4eb3b6a98dff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:45.647926 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8111a-3c55-444e-9398-4eb3b6a98dff admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:45.673784 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16a173-9eb9-4f11-96aa-cffda422c9c6 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:45.675229 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-5b16a173-9eb9-4f11-96aa-cffda422c9c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:45.687754 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:45.837904 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f3fe4-7724-4893-927b-14e1fd8c2fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:45.841035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f3fe4-7724-4893-927b-14e1fd8c2fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:45.841537 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f3fe4-7724-4893-927b-14e1fd8c2fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:45.841943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16a173-9eb9-4f11-96aa-cffda422c9c6 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:45.842507 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f3fe4-7724-4893-927b-14e1fd8c2fd2 admin admin] PATH_INFO: `/v3/users/0b2e81cd8c194c3ba0e83ddc7a447ff1` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:45.847666 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f3fe4-7724-4893-927b-14e1fd8c2fd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b2e81cd8c194c3ba0e83ddc7a447ff1)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:45.851519 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f0f68-834e-477f-a7e0-aeda059f2870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:45.851660 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f3fe4-7724-4893-927b-14e1fd8c2fd2 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:45.851746 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f0f68-834e-477f-a7e0-aeda059f2870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:45.851746 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f0f68-834e-477f-a7e0-aeda059f2870 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:45.851924 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f0f68-834e-477f-a7e0-aeda059f2870 admin admin] PATH_INFO: `/v3/users/e88959015b01417ba105edc60e417b4f` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:45.853882 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f0f68-834e-477f-a7e0-aeda059f2870 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e88959015b01417ba105edc60e417b4f)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:45.855644 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f0f68-834e-477f-a7e0-aeda059f2870 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:45.958964 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-a94f3fe4-7724-4893-927b-14e1fd8c2fd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b2e81cd8c194c3ba0e83ddc7a447ff1'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:45.959735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-a94f3fe4-7724-4893-927b-14e1fd8c2fd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b2e81cd8c194c3ba0e83ddc7a447ff1'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:45.961304 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-a94f3fe4-7724-4893-927b-14e1fd8c2fd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b2e81cd8c194c3ba0e83ddc7a447ff1'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:46.003283 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-a94f3fe4-7724-4893-927b-14e1fd8c2fd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b2e81cd8c194c3ba0e83ddc7a447ff1'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:46.006000 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-0f9f0f68-834e-477f-a7e0-aeda059f2870 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e88959015b01417ba105edc60e417b4f'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:46.006348 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:46.030427 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-a94f3fe4-7724-4893-927b-14e1fd8c2fd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b2e81cd8c194c3ba0e83ddc7a447ff1'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:46.033859 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-0f9f0f68-834e-477f-a7e0-aeda059f2870 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e88959015b01417ba105edc60e417b4f'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:46.034801 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-0f9f0f68-834e-477f-a7e0-aeda059f2870 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e88959015b01417ba105edc60e417b4f'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:46.036259 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-0f9f0f68-834e-477f-a7e0-aeda059f2870 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e88959015b01417ba105edc60e417b4f'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:46.069984 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 849/1680] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:51:45 2022] DELETE /identity/v3/users/0b2e81cd8c194c3ba0e83ddc7a447ff1 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:46.070187 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-0f9f0f68-834e-477f-a7e0-aeda059f2870 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e88959015b01417ba105edc60e417b4f'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:46.107736 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c587722-cca0-438b-b2d3-05d243634d27 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:46.107920 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c587722-cca0-438b-b2d3-05d243634d27 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:46.108188 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c587722-cca0-438b-b2d3-05d243634d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:46.112236 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 832/1681] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:51:45 2022] DELETE /identity/v3/users/e88959015b01417ba105edc60e417b4f => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:46.132238 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-8c587722-cca0-438b-b2d3-05d243634d27 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:46.134111 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-8c587722-cca0-438b-b2d3-05d243634d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:46.300555 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 850/1682] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:46.325662 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f0f68-834e-477f-a7e0-aeda059f2870 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:46.327189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-0f9f0f68-834e-477f-a7e0-aeda059f2870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:46.455290 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f0f68-834e-477f-a7e0-aeda059f2870 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:46.459512 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e8a66-29dd-471f-8135-8b211311d068 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:46.460130 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e8a66-29dd-471f-8135-8b211311d068 service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:46.460406 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e8a66-29dd-471f-8135-8b211311d068 service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:46.460680 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e8a66-29dd-471f-8135-8b211311d068 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:46.483281 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e8a66-29dd-471f-8135-8b211311d068 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:46.484743 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e8a66-29dd-471f-8135-8b211311d068 service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:46.500862 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 833/1683] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:46.676933 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c587722-cca0-438b-b2d3-05d243634d27 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:46.678117 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-8c587722-cca0-438b-b2d3-05d243634d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:46.695360 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c587722-cca0-438b-b2d3-05d243634d27 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:46.712230 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83a6f2-cec1-4079-b9ab-941d38ef0ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:46.713214 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83a6f2-cec1-4079-b9ab-941d38ef0ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:46.713521 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83a6f2-cec1-4079-b9ab-941d38ef0ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:46.713958 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83a6f2-cec1-4079-b9ab-941d38ef0ff3 admin admin] PATH_INFO: `/v3/projects/b791ad2749cd450fbb2603866598388f` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:46.717344 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83a6f2-cec1-4079-b9ab-941d38ef0ff3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b791ad2749cd450fbb2603866598388f)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:46.718726 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83a6f2-cec1-4079-b9ab-941d38ef0ff3 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:46.845589 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-aa83a6f2-cec1-4079-b9ab-941d38ef0ff3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b791ad2749cd450fbb2603866598388f', 'request_id': 'req-aa83a6f2-cec1-4079-b9ab-941d38ef0ff3'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:46.868718 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-aa83a6f2-cec1-4079-b9ab-941d38ef0ff3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b791ad2749cd450fbb2603866598388f', 'request_id': 'req-aa83a6f2-cec1-4079-b9ab-941d38ef0ff3'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:46.886703 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-aa83a6f2-cec1-4079-b9ab-941d38ef0ff3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b791ad2749cd450fbb2603866598388f', 'request_id': 'req-aa83a6f2-cec1-4079-b9ab-941d38ef0ff3'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:46.907502 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-aa83a6f2-cec1-4079-b9ab-941d38ef0ff3 admin admin] The token cache is being invalidate because project b791ad2749cd450fbb2603866598388f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:51:46.907796 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-aa83a6f2-cec1-4079-b9ab-941d38ef0ff3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:46.911236 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-aa83a6f2-cec1-4079-b9ab-941d38ef0ff3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:46.920339 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4de8cc-92c0-4fb6-b455-06a566a827ef None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:46.921564 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4de8cc-92c0-4fb6-b455-06a566a827ef None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:46.921820 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4de8cc-92c0-4fb6-b455-06a566a827ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:46.925353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 851/1684] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:51:46 2022] DELETE /identity/v3/projects/b791ad2749cd450fbb2603866598388f => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:46.962827 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-3d4de8cc-92c0-4fb6-b455-06a566a827ef None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:46.964099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-3d4de8cc-92c0-4fb6-b455-06a566a827ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:47.026725 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:47.105211 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 834/1685] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:47.108692 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b289f-4439-413f-a82a-36b6839a071f None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:47.109096 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b289f-4439-413f-a82a-36b6839a071f None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:47.109467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b289f-4439-413f-a82a-36b6839a071f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:47.133824 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-f36b289f-4439-413f-a82a-36b6839a071f None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:47.135531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-f36b289f-4439-413f-a82a-36b6839a071f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:47.156865 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 852/1686] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:47.157618 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4de8cc-92c0-4fb6-b455-06a566a827ef None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:47.174215 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4de8cc-92c0-4fb6-b455-06a566a827ef None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:47.187725 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e09a1-f7c0-430f-a55d-6a1a2040054c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:47.189243 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e09a1-f7c0-430f-a55d-6a1a2040054c admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:47.189243 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e09a1-f7c0-430f-a55d-6a1a2040054c admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:47.189243 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e09a1-f7c0-430f-a55d-6a1a2040054c admin admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:47.189659 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e09a1-f7c0-430f-a55d-6a1a2040054c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:47.189977 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e09a1-f7c0-430f-a55d-6a1a2040054c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:47.198117 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e09a1-f7c0-430f-a55d-6a1a2040054c admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:47.229663 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 835/1687] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:51:47.234661 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b289f-4439-413f-a82a-36b6839a071f None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:47.245980 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b289f-4439-413f-a82a-36b6839a071f None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:47.253921 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc091591-902e-4a09-b065-1c3d2025a7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:47.255157 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc091591-902e-4a09-b065-1c3d2025a7d2 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:47.255644 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc091591-902e-4a09-b065-1c3d2025a7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:47.256346 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc091591-902e-4a09-b065-1c3d2025a7d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:47.257234 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc091591-902e-4a09-b065-1c3d2025a7d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:47.260664 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc091591-902e-4a09-b065-1c3d2025a7d2 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:47.321545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 853/1688] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:51:47 2022] POST /identity/v3/projects => generated 387 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:47.322341 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e09a1-f7c0-430f-a55d-6a1a2040054c admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:47.340265 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e09a1-f7c0-430f-a55d-6a1a2040054c admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:47.448917 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446971f-6ad0-4f1e-85ba-08e2a5edefdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:47.450373 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446971f-6ad0-4f1e-85ba-08e2a5edefdd admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:47.450731 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446971f-6ad0-4f1e-85ba-08e2a5edefdd admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:47.451332 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446971f-6ad0-4f1e-85ba-08e2a5edefdd admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:47.452379 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446971f-6ad0-4f1e-85ba-08e2a5edefdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:47.454986 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446971f-6ad0-4f1e-85ba-08e2a5edefdd admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:47.495489 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc091591-902e-4a09-b065-1c3d2025a7d2 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:47.512024 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 836/1689] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:51:47 2022] POST /identity/v3/users => generated 294 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:47.545180 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc091591-902e-4a09-b065-1c3d2025a7d2 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:47.554957 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673d5c6-c098-45d0-be08-75ce396f240d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:47.558043 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673d5c6-c098-45d0-be08-75ce396f240d admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:47.558647 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673d5c6-c098-45d0-be08-75ce396f240d admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:47.558980 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673d5c6-c098-45d0-be08-75ce396f240d admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:47.559855 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673d5c6-c098-45d0-be08-75ce396f240d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:47.561656 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673d5c6-c098-45d0-be08-75ce396f240d admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:47.580204 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446971f-6ad0-4f1e-85ba-08e2a5edefdd admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:47.592149 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 854/1690] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:51:47.595153 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446971f-6ad0-4f1e-85ba-08e2a5edefdd admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:47.605844 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d555308-c157-431c-a1b5-571b92be770d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:47.606555 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d555308-c157-431c-a1b5-571b92be770d admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:47.607529 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d555308-c157-431c-a1b5-571b92be770d admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:47.607819 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d555308-c157-431c-a1b5-571b92be770d admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:47.608640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d555308-c157-431c-a1b5-571b92be770d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:47.611155 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d555308-c157-431c-a1b5-571b92be770d admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:47.631970 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673d5c6-c098-45d0-be08-75ce396f240d admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:47.643507 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 837/1691] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:51:47.645359 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673d5c6-c098-45d0-be08-75ce396f240d admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:47.653533 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0b1b0-a818-49ba-9895-aaed51b5605e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:47.654269 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0b1b0-a818-49ba-9895-aaed51b5605e admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:47.655329 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0b1b0-a818-49ba-9895-aaed51b5605e admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:47.655626 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0b1b0-a818-49ba-9895-aaed51b5605e admin admin] PATH_INFO: `/v3/projects/b98480f0da34499a97c9982e3f9f3973/users/dd2127589b6d4553952d1562372f1384/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:47.686298 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0b1b0-a818-49ba-9895-aaed51b5605e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b98480f0da34499a97c9982e3f9f3973, user_id=dd2127589b6d4553952d1562372f1384, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:47.700786 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0b1b0-a818-49ba-9895-aaed51b5605e admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:47.745661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8767e3-d7a1-41b7-bc08-89436a873baf None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:47.751819 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8767e3-d7a1-41b7-bc08-89436a873baf None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:47.752909 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8767e3-d7a1-41b7-bc08-89436a873baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:47.759679 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 855/1692] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:51:47 2022] PUT /identity/v3/projects/b98480f0da34499a97c9982e3f9f3973/users/dd2127589b6d4553952d1562372f1384/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:47.796960 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0b1b0-a818-49ba-9895-aaed51b5605e admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:47.807784 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-84a0b1b0-a818-49ba-9895-aaed51b5605e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:47.817386 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:47.826659 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-7e8767e3-d7a1-41b7-bc08-89436a873baf None None] MFA Rules not processed for user `dd2127589b6d4553952d1562372f1384`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:47.840089 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-7e8767e3-d7a1-41b7-bc08-89436a873baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:47.965310 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 838/1693] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:47.966744 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8767e3-d7a1-41b7-bc08-89436a873baf None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:48.073045 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0b1b0-a818-49ba-9895-aaed51b5605e admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:48.090992 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:48.096485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a5c2b-d682-4a29-80a3-2e39358cb2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:48.097539 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a5c2b-d682-4a29-80a3-2e39358cb2a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:48.098277 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a5c2b-d682-4a29-80a3-2e39358cb2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:48.098861 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a5c2b-d682-4a29-80a3-2e39358cb2a4 admin admin] PATH_INFO: `/v3/projects/038019be3ea24a9bba43d772f0619a80` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:48.103948 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a5c2b-d682-4a29-80a3-2e39358cb2a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=038019be3ea24a9bba43d772f0619a80)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:48.111586 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a5c2b-d682-4a29-80a3-2e39358cb2a4 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:48.191940 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8767e3-d7a1-41b7-bc08-89436a873baf None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:48.218136 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1addb2ba-6f9a-4d58-9cd3-3034931d934e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:48.218136 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1addb2ba-6f9a-4d58-9cd3-3034931d934e admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:48.218136 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1addb2ba-6f9a-4d58-9cd3-3034931d934e admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:48.218136 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1addb2ba-6f9a-4d58-9cd3-3034931d934e admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:48.218601 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1addb2ba-6f9a-4d58-9cd3-3034931d934e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:48.223368 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1addb2ba-6f9a-4d58-9cd3-3034931d934e admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:48.284226 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-176a5c2b-d682-4a29-80a3-2e39358cb2a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '038019be3ea24a9bba43d772f0619a80', 'request_id': 'req-176a5c2b-d682-4a29-80a3-2e39358cb2a4'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:48.311768 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-176a5c2b-d682-4a29-80a3-2e39358cb2a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '038019be3ea24a9bba43d772f0619a80', 'request_id': 'req-176a5c2b-d682-4a29-80a3-2e39358cb2a4'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:48.316634 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 839/1694] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:51:47 2022] POST /identity/v3/projects => generated 385 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:51:48.321343 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1addb2ba-6f9a-4d58-9cd3-3034931d934e admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:48.338031 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-176a5c2b-d682-4a29-80a3-2e39358cb2a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '038019be3ea24a9bba43d772f0619a80', 'request_id': 'req-176a5c2b-d682-4a29-80a3-2e39358cb2a4'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:48.391365 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-176a5c2b-d682-4a29-80a3-2e39358cb2a4 admin admin] The token cache is being invalidate because project 038019be3ea24a9bba43d772f0619a80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:51:48.391707 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-176a5c2b-d682-4a29-80a3-2e39358cb2a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:48.395355 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-176a5c2b-d682-4a29-80a3-2e39358cb2a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:48.397207 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 856/1695] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:51:47 2022] DELETE /identity/v3/projects/038019be3ea24a9bba43d772f0619a80 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:51:48.419334 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0babefc-8652-49f3-88b8-49f186d5ac28 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:48.420092 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0babefc-8652-49f3-88b8-49f186d5ac28 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:48.420583 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0babefc-8652-49f3-88b8-49f186d5ac28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:48.492974 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-c0babefc-8652-49f3-88b8-49f186d5ac28 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:48.494560 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-c0babefc-8652-49f3-88b8-49f186d5ac28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:48.515646 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 857/1696] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:48.525415 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ead96d-2b37-493f-a665-bb11e5b1e47d None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:48.528201 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ead96d-2b37-493f-a665-bb11e5b1e47d None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:48.528486 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ead96d-2b37-493f-a665-bb11e5b1e47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:48.531139 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1addb2ba-6f9a-4d58-9cd3-3034931d934e admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:48.541486 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8feaf2-92cf-4a80-a2c0-24e17b0928a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:48.543974 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8feaf2-92cf-4a80-a2c0-24e17b0928a5 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:48.544385 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8feaf2-92cf-4a80-a2c0-24e17b0928a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:48.545437 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8feaf2-92cf-4a80-a2c0-24e17b0928a5 admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:48.547991 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8feaf2-92cf-4a80-a2c0-24e17b0928a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:48.555559 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8feaf2-92cf-4a80-a2c0-24e17b0928a5 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:48.617334 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-e3ead96d-2b37-493f-a665-bb11e5b1e47d None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:48.619072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-e3ead96d-2b37-493f-a665-bb11e5b1e47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:48.621792 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 840/1697] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:51:48 2022] POST /identity/v3/users => generated 299 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:48.626693 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8feaf2-92cf-4a80-a2c0-24e17b0928a5 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:48.629367 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-9f8feaf2-92cf-4a80-a2c0-24e17b0928a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:48.655997 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 858/1698] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:48.657727 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ead96d-2b37-493f-a665-bb11e5b1e47d None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:48.676729 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8feaf2-92cf-4a80-a2c0-24e17b0928a5 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:48.708689 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0dba0-c59b-433f-9e76-5c6baf8bfb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:48.709364 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0dba0-c59b-433f-9e76-5c6baf8bfb56 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:48.709684 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0dba0-c59b-433f-9e76-5c6baf8bfb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:48.709968 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0dba0-c59b-433f-9e76-5c6baf8bfb56 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:48.710695 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0dba0-c59b-433f-9e76-5c6baf8bfb56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:48.721036 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0dba0-c59b-433f-9e76-5c6baf8bfb56 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:48.734874 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ead96d-2b37-493f-a665-bb11e5b1e47d None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:48.743471 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93849d5-a1ca-46a6-9254-d9911123d49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:48.760713 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 841/1699] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:51:48.761228 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93849d5-a1ca-46a6-9254-d9911123d49a admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:48.761564 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93849d5-a1ca-46a6-9254-d9911123d49a admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:48.761850 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93849d5-a1ca-46a6-9254-d9911123d49a admin admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:48.762086 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0dba0-c59b-433f-9e76-5c6baf8bfb56 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:48.762627 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93849d5-a1ca-46a6-9254-d9911123d49a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:48.763050 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93849d5-a1ca-46a6-9254-d9911123d49a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:48.764716 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93849d5-a1ca-46a6-9254-d9911123d49a admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:48.785177 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0dba0-c59b-433f-9e76-5c6baf8bfb56 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:48.804213 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d075f2-fb1c-4b69-9011-9c05b4ece9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:48.805476 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d075f2-fb1c-4b69-9011-9c05b4ece9df admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:48.805873 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d075f2-fb1c-4b69-9011-9c05b4ece9df admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:48.806156 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d075f2-fb1c-4b69-9011-9c05b4ece9df admin admin] PATH_INFO: `/v3/projects/e72b4b23edfb4302a45cb48a8b1dd771/users/eaf38f83460146b182a42dff498fa269/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:48.825393 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 859/1700] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:48.827973 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93849d5-a1ca-46a6-9254-d9911123d49a admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:48.852429 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93849d5-a1ca-46a6-9254-d9911123d49a admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:48.865808 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bcbd3e-0ec4-4dde-98b4-dc820ca82834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:48.866606 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcbd3e-0ec4-4dde-98b4-dc820ca82834 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:48.866891 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcbd3e-0ec4-4dde-98b4-dc820ca82834 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:48.867164 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcbd3e-0ec4-4dde-98b4-dc820ca82834 admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:48.868398 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bcbd3e-0ec4-4dde-98b4-dc820ca82834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:48.872740 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bcbd3e-0ec4-4dde-98b4-dc820ca82834 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:48.885978 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d075f2-fb1c-4b69-9011-9c05b4ece9df admin admin] RBAC: Authorizing `identity:create_grant(project_id=e72b4b23edfb4302a45cb48a8b1dd771, user_id=eaf38f83460146b182a42dff498fa269, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:48.888747 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d075f2-fb1c-4b69-9011-9c05b4ece9df admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:48.928631 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 842/1701] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:51:48 2022] PUT /identity/v3/projects/e72b4b23edfb4302a45cb48a8b1dd771/users/eaf38f83460146b182a42dff498fa269/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:51:48.934659 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d075f2-fb1c-4b69-9011-9c05b4ece9df admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:48.944471 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 860/1702] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:51:48 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:48.949344 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bcbd3e-0ec4-4dde-98b4-dc820ca82834 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:49.075481 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d075f2-fb1c-4b69-9011-9c05b4ece9df admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:49.081846 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:49.109872 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:49.144813 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bcbd3e-0ec4-4dde-98b4-dc820ca82834 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:49.150711 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ac21e-2837-4ea9-91cf-e8edda0a815b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:49.151352 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ac21e-2837-4ea9-91cf-e8edda0a815b admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:49.151631 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ac21e-2837-4ea9-91cf-e8edda0a815b admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:49.151904 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ac21e-2837-4ea9-91cf-e8edda0a815b admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:49.152583 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ac21e-2837-4ea9-91cf-e8edda0a815b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:49.154600 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ac21e-2837-4ea9-91cf-e8edda0a815b admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:49.191949 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c795f-a5e9-4420-9dc3-0066d0700df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:49.193428 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c795f-a5e9-4420-9dc3-0066d0700df7 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:49.196882 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c795f-a5e9-4420-9dc3-0066d0700df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:49.196882 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c795f-a5e9-4420-9dc3-0066d0700df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:49.200001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c795f-a5e9-4420-9dc3-0066d0700df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:49.208834 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c795f-a5e9-4420-9dc3-0066d0700df7 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:49.209158 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 861/1703] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:51:48 2022] POST /identity/v3/users => generated 294 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:51:49.211860 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ac21e-2837-4ea9-91cf-e8edda0a815b admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:49.250283 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ac21e-2837-4ea9-91cf-e8edda0a815b admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:49.250476 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 843/1704] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:51:49.251445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c795f-a5e9-4420-9dc3-0066d0700df7 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:49.268598 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8712b4-4820-43fc-a15a-4573a996388c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:49.269985 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8712b4-4820-43fc-a15a-4573a996388c admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:49.270747 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8712b4-4820-43fc-a15a-4573a996388c admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:49.278689 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8712b4-4820-43fc-a15a-4573a996388c admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:49.283549 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8712b4-4820-43fc-a15a-4573a996388c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:49.285856 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8712b4-4820-43fc-a15a-4573a996388c admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:49.298951 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c795f-a5e9-4420-9dc3-0066d0700df7 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:49.315204 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 862/1705] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:51:49.316276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8712b4-4820-43fc-a15a-4573a996388c admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:49.318507 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-4a8712b4-4820-43fc-a15a-4573a996388c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:49.322609 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca766559-e6bb-47f2-9edf-63096b73dbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:49.323983 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca766559-e6bb-47f2-9edf-63096b73dbef admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:49.324775 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca766559-e6bb-47f2-9edf-63096b73dbef admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:49.325244 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca766559-e6bb-47f2-9edf-63096b73dbef admin admin] PATH_INFO: `/v3/projects/e72b4b23edfb4302a45cb48a8b1dd771/users/eaf38f83460146b182a42dff498fa269/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:49.328829 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca766559-e6bb-47f2-9edf-63096b73dbef admin admin] RBAC: Authorizing `identity:create_grant(project_id=e72b4b23edfb4302a45cb48a8b1dd771, user_id=eaf38f83460146b182a42dff498fa269, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:49.332810 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca766559-e6bb-47f2-9edf-63096b73dbef admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:49.350905 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8712b4-4820-43fc-a15a-4573a996388c admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:49.404564 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 844/1706] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:51:49 2022] PUT /identity/v3/projects/e72b4b23edfb4302a45cb48a8b1dd771/users/eaf38f83460146b182a42dff498fa269/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:49.405793 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca766559-e6bb-47f2-9edf-63096b73dbef admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:49.501327 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c64dc-d75b-4a49-881b-e2e6fa7f1eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:49.502029 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c64dc-d75b-4a49-881b-e2e6fa7f1eeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:49.502313 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c64dc-d75b-4a49-881b-e2e6fa7f1eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:49.502595 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c64dc-d75b-4a49-881b-e2e6fa7f1eeb admin admin] PATH_INFO: `/v3/projects/0f8ddc1bd0514596b6a9ae2c061435dc` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:49.504209 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c64dc-d75b-4a49-881b-e2e6fa7f1eeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f8ddc1bd0514596b6a9ae2c061435dc)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:49.506581 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c64dc-d75b-4a49-881b-e2e6fa7f1eeb admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:49.622112 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-560c64dc-d75b-4a49-881b-e2e6fa7f1eeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f8ddc1bd0514596b6a9ae2c061435dc', 'request_id': 'req-560c64dc-d75b-4a49-881b-e2e6fa7f1eeb'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:49.640570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-560c64dc-d75b-4a49-881b-e2e6fa7f1eeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f8ddc1bd0514596b6a9ae2c061435dc', 'request_id': 'req-560c64dc-d75b-4a49-881b-e2e6fa7f1eeb'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:49.654465 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca766559-e6bb-47f2-9edf-63096b73dbef admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:49.657125 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-560c64dc-d75b-4a49-881b-e2e6fa7f1eeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f8ddc1bd0514596b6a9ae2c061435dc', 'request_id': 'req-560c64dc-d75b-4a49-881b-e2e6fa7f1eeb'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:49.678977 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-560c64dc-d75b-4a49-881b-e2e6fa7f1eeb admin admin] The token cache is being invalidate because project 0f8ddc1bd0514596b6a9ae2c061435dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:51:49.679280 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-560c64dc-d75b-4a49-881b-e2e6fa7f1eeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:49.684017 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-560c64dc-d75b-4a49-881b-e2e6fa7f1eeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:49.690381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 863/1707] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:51:49 2022] DELETE /identity/v3/projects/0f8ddc1bd0514596b6a9ae2c061435dc => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:49.691824 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c808f7f-e122-4bce-94aa-6fdf73c2502f None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:49.692116 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c808f7f-e122-4bce-94aa-6fdf73c2502f None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:49.692395 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c808f7f-e122-4bce-94aa-6fdf73c2502f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:49.766782 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-6c808f7f-e122-4bce-94aa-6fdf73c2502f None None] MFA Rules not processed for user `eaf38f83460146b182a42dff498fa269`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:49.768294 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-6c808f7f-e122-4bce-94aa-6fdf73c2502f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:49.869784 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:49.894175 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4852f-203f-48fd-8413-cd4f29d61374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:49.895811 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4852f-203f-48fd-8413-cd4f29d61374 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:49.896992 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4852f-203f-48fd-8413-cd4f29d61374 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:49.898282 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4852f-203f-48fd-8413-cd4f29d61374 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:49.916325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4852f-203f-48fd-8413-cd4f29d61374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:49.921794 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4852f-203f-48fd-8413-cd4f29d61374 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:49.949665 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 845/1708] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 544 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:51:49.951711 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b67b11-a27f-4b1b-a2af-ab1b1bf90759 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:49.952632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b67b11-a27f-4b1b-a2af-ab1b1bf90759 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:49.953177 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b67b11-a27f-4b1b-a2af-ab1b1bf90759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:49.954358 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 864/1709] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:49.960367 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab05f4-6ea6-46b7-8ad9-5e734aed4f6d None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:49.960367 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab05f4-6ea6-46b7-8ad9-5e734aed4f6d None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:49.960499 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab05f4-6ea6-46b7-8ad9-5e734aed4f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:50.004653 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-16b67b11-a27f-4b1b-a2af-ab1b1bf90759 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:50.018550 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-16b67b11-a27f-4b1b-a2af-ab1b1bf90759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:50.036632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 846/1710] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:50.038296 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b67b11-a27f-4b1b-a2af-ab1b1bf90759 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:50.049434 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-16b67b11-a27f-4b1b-a2af-ab1b1bf90759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:50.050467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-bbab05f4-6ea6-46b7-8ad9-5e734aed4f6d None None] MFA Rules not processed for user `539502db204e415c85520d9b7fe77d99`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:50.056034 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-bbab05f4-6ea6-46b7-8ad9-5e734aed4f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:50.076161 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b67b11-a27f-4b1b-a2af-ab1b1bf90759 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:50.084335 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94831433-9e3b-42b5-9eb0-95aafa1fbb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:50.085076 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94831433-9e3b-42b5-9eb0-95aafa1fbb1e admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:50.085480 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94831433-9e3b-42b5-9eb0-95aafa1fbb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:50.088051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94831433-9e3b-42b5-9eb0-95aafa1fbb1e admin admin] PATH_INFO: `/v3/projects/9063a76dc4604b6eb138e822ff34cd56/users/cf4ea3db48a14fefb8fb75cb1590fe38/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:50.113690 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94831433-9e3b-42b5-9eb0-95aafa1fbb1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9063a76dc4604b6eb138e822ff34cd56, user_id=cf4ea3db48a14fefb8fb75cb1590fe38, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:50.117730 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94831433-9e3b-42b5-9eb0-95aafa1fbb1e admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:50.155374 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 847/1711] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:51:50 2022] PUT /identity/v3/projects/9063a76dc4604b6eb138e822ff34cd56/users/cf4ea3db48a14fefb8fb75cb1590fe38/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:50.156398 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94831433-9e3b-42b5-9eb0-95aafa1fbb1e admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:50.162297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-94831433-9e3b-42b5-9eb0-95aafa1fbb1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:50.173044 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:50.177879 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 865/1712] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:50.182399 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95413c-2de4-4979-897c-25896e402bd5 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:50.182937 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95413c-2de4-4979-897c-25896e402bd5 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:50.183524 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95413c-2de4-4979-897c-25896e402bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:50.253022 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-fb95413c-2de4-4979-897c-25896e402bd5 None None] MFA Rules not processed for user `e3eba8e63be14907a364797a0189290c`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:50.254714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-fb95413c-2de4-4979-897c-25896e402bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:50.283457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94831433-9e3b-42b5-9eb0-95aafa1fbb1e admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:50.287216 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702e864-1dbd-4327-a216-9f5fee201ac5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:50.287883 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702e864-1dbd-4327-a216-9f5fee201ac5 service cinder] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:50.289367 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702e864-1dbd-4327-a216-9f5fee201ac5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:50.289367 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702e864-1dbd-4327-a216-9f5fee201ac5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:50.378876 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702e864-1dbd-4327-a216-9f5fee201ac5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:50.380849 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702e864-1dbd-4327-a216-9f5fee201ac5 service cinder] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:50.398821 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 866/1713] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:50.400933 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e8cb6-e696-47c4-8745-6435bc47a1b1 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:50.401465 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e8cb6-e696-47c4-8745-6435bc47a1b1 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:50.401964 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e8cb6-e696-47c4-8745-6435bc47a1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:50.416593 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 848/1714] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:50 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:50.418807 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33c417-8809-4aac-b2ed-c4272454fb2b None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:50.419091 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33c417-8809-4aac-b2ed-c4272454fb2b None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:50.419366 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33c417-8809-4aac-b2ed-c4272454fb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:50.458578 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-bd33c417-8809-4aac-b2ed-c4272454fb2b None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:50.460127 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-bd33c417-8809-4aac-b2ed-c4272454fb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:50.478506 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-3e9e8cb6-e696-47c4-8745-6435bc47a1b1 None None] MFA Rules not processed for user `831d8776102847efbdae901f2b863226`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:50.483141 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-3e9e8cb6-e696-47c4-8745-6435bc47a1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:50.566163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 849/1715] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:50.566163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a30ff-528f-4016-ada7-3344dd2ca2c2 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:50.566163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a30ff-528f-4016-ada7-3344dd2ca2c2 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:50.566163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a30ff-528f-4016-ada7-3344dd2ca2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:50.601516 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:50.608503 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-870a30ff-528f-4016-ada7-3344dd2ca2c2 None None] MFA Rules not processed for user `cf4ea3db48a14fefb8fb75cb1590fe38`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:50.609927 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-870a30ff-528f-4016-ada7-3344dd2ca2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:50.639700 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 867/1716] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:50.640202 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c38236-f474-4a03-9cf8-62b74be15d8c None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:50.640490 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c38236-f474-4a03-9cf8-62b74be15d8c None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:50.640771 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c38236-f474-4a03-9cf8-62b74be15d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:50.665617 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-63c38236-f474-4a03-9cf8-62b74be15d8c None None] MFA Rules not processed for user `539502db204e415c85520d9b7fe77d99`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:50.669144 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-63c38236-f474-4a03-9cf8-62b74be15d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:50.715181 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:50.761137 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 868/1717] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:50.762340 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c38236-f474-4a03-9cf8-62b74be15d8c None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:50.763871 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-63c38236-f474-4a03-9cf8-62b74be15d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:50.777629 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 850/1718] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:50.778614 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a30ff-528f-4016-ada7-3344dd2ca2c2 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:50.782243 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-870a30ff-528f-4016-ada7-3344dd2ca2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:50.816924 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a30ff-528f-4016-ada7-3344dd2ca2c2 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:50.834226 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd6e23-2cc8-47ee-8b85-415d7a7b26cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:50.834445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd6e23-2cc8-47ee-8b85-415d7a7b26cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:50.834768 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd6e23-2cc8-47ee-8b85-415d7a7b26cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:50.835007 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd6e23-2cc8-47ee-8b85-415d7a7b26cf admin admin] PATH_INFO: `/v3/users/dd2127589b6d4553952d1562372f1384` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:50.844365 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd6e23-2cc8-47ee-8b85-415d7a7b26cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd2127589b6d4553952d1562372f1384)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:50.844365 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd6e23-2cc8-47ee-8b85-415d7a7b26cf admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:50.866494 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c38236-f474-4a03-9cf8-62b74be15d8c None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:50.879943 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e66881-8e07-4b20-bd9c-4c9bacf29251 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:50.885149 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e66881-8e07-4b20-bd9c-4c9bacf29251 service nova] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:50.885775 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e66881-8e07-4b20-bd9c-4c9bacf29251 service nova] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:50.886205 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e66881-8e07-4b20-bd9c-4c9bacf29251 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:50.900728 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e66881-8e07-4b20-bd9c-4c9bacf29251 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:50.902634 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e66881-8e07-4b20-bd9c-4c9bacf29251 service nova] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:50.917982 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 869/1719] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:50.919090 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e66881-8e07-4b20-bd9c-4c9bacf29251 service nova] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:50.935239 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e66881-8e07-4b20-bd9c-4c9bacf29251 service nova] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:50.943778 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf68af-f1e0-4511-a7f7-90caf6b2ff33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:50.945110 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf68af-f1e0-4511-a7f7-90caf6b2ff33 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:50.945110 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf68af-f1e0-4511-a7f7-90caf6b2ff33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:50.945372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf68af-f1e0-4511-a7f7-90caf6b2ff33 admin admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:50.947274 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf68af-f1e0-4511-a7f7-90caf6b2ff33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:50.947889 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf68af-f1e0-4511-a7f7-90caf6b2ff33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:50.952072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf68af-f1e0-4511-a7f7-90caf6b2ff33 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:50.968461 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 870/1720] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:50.969220 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf68af-f1e0-4511-a7f7-90caf6b2ff33 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:50.970985 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-f2cf68af-f1e0-4511-a7f7-90caf6b2ff33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:50.977993 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-21fd6e23-2cc8-47ee-8b85-415d7a7b26cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd2127589b6d4553952d1562372f1384'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:50.993152 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-21fd6e23-2cc8-47ee-8b85-415d7a7b26cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd2127589b6d4553952d1562372f1384'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:50.994514 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-21fd6e23-2cc8-47ee-8b85-415d7a7b26cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd2127589b6d4553952d1562372f1384'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:50.995741 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf68af-f1e0-4511-a7f7-90caf6b2ff33 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:50.996120 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-21fd6e23-2cc8-47ee-8b85-415d7a7b26cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd2127589b6d4553952d1562372f1384'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:51.003594 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb49ae-624b-4313-aa32-e03f31955f92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:51.004383 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb49ae-624b-4313-aa32-e03f31955f92 service nova] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:51.004799 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb49ae-624b-4313-aa32-e03f31955f92 service nova] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:51.005119 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb49ae-624b-4313-aa32-e03f31955f92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:51.007074 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-b6eb49ae-624b-4313-aa32-e03f31955f92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:51.031669 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb49ae-624b-4313-aa32-e03f31955f92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:51.033894 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb49ae-624b-4313-aa32-e03f31955f92 service nova] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:51.041328 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-21fd6e23-2cc8-47ee-8b85-415d7a7b26cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd2127589b6d4553952d1562372f1384'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:51.047778 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 871/1721] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:51.048767 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb49ae-624b-4313-aa32-e03f31955f92 service nova] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:51.051034 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-b6eb49ae-624b-4313-aa32-e03f31955f92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:51.067673 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb49ae-624b-4313-aa32-e03f31955f92 service nova] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:51.073813 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eeacce-2ea9-4a1a-be3e-3c0b77a4f8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:51.074440 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eeacce-2ea9-4a1a-be3e-3c0b77a4f8ab admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:51.074723 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eeacce-2ea9-4a1a-be3e-3c0b77a4f8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:51.074993 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eeacce-2ea9-4a1a-be3e-3c0b77a4f8ab admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:51.075670 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eeacce-2ea9-4a1a-be3e-3c0b77a4f8ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:51.077773 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eeacce-2ea9-4a1a-be3e-3c0b77a4f8ab admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:51.110643 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 851/1722] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:51:50 2022] DELETE /identity/v3/users/dd2127589b6d4553952d1562372f1384 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:51.113545 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd6e23-2cc8-47ee-8b85-415d7a7b26cf admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:51.115041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 872/1723] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:51:51 2022] POST /identity/v3/projects => generated 387 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:51.116365 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a37c33-b8bd-4726-b975-593640ef59fe None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:51.116697 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a37c33-b8bd-4726-b975-593640ef59fe None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:51.116985 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a37c33-b8bd-4726-b975-593640ef59fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:51.125059 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-21fd6e23-2cc8-47ee-8b85-415d7a7b26cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:51.142885 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-52a37c33-b8bd-4726-b975-593640ef59fe None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:51.144168 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-52a37c33-b8bd-4726-b975-593640ef59fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:51.192644 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:51.311609 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 873/1724] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:51.312504 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a37c33-b8bd-4726-b975-593640ef59fe None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:51.334595 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a37c33-b8bd-4726-b975-593640ef59fe None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:51.341720 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ee44b-3fe2-4dcc-8419-e0273266fa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:51.342364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ee44b-3fe2-4dcc-8419-e0273266fa8d admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:51.342651 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ee44b-3fe2-4dcc-8419-e0273266fa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:51.342928 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ee44b-3fe2-4dcc-8419-e0273266fa8d admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:51.343714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ee44b-3fe2-4dcc-8419-e0273266fa8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:51.345761 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ee44b-3fe2-4dcc-8419-e0273266fa8d admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:51.389145 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 874/1725] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:51:51 2022] POST /identity/v3/users => generated 300 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:51.389145 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119dbe6-fe8a-46cd-80f8-91479ff9eb34 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:51.389145 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119dbe6-fe8a-46cd-80f8-91479ff9eb34 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:51.389145 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119dbe6-fe8a-46cd-80f8-91479ff9eb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:51.391614 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd6e23-2cc8-47ee-8b85-415d7a7b26cf admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:51.418325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53bc822-653b-43e5-8e1f-34f5c5370ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:51.419068 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bc822-653b-43e5-8e1f-34f5c5370ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:51.427453 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bc822-653b-43e5-8e1f-34f5c5370ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:51.427778 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bc822-653b-43e5-8e1f-34f5c5370ff0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:51.428520 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53bc822-653b-43e5-8e1f-34f5c5370ff0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:51.431085 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53bc822-653b-43e5-8e1f-34f5c5370ff0 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:51.472111 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-7119dbe6-fe8a-46cd-80f8-91479ff9eb34 None None] MFA Rules not processed for user `7a109db9f7754b5a8f5b53fa7030691c`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:51.473375 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-7119dbe6-fe8a-46cd-80f8-91479ff9eb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:51.489391 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 852/1726] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:51:51 2022] POST /identity/v3/projects => generated 387 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:51.497445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53bc822-653b-43e5-8e1f-34f5c5370ff0 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:51.500735 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-f53bc822-653b-43e5-8e1f-34f5c5370ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:51.610905 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:51.648409 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 875/1727] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:51.650292 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119dbe6-fe8a-46cd-80f8-91479ff9eb34 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:51.652288 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-7119dbe6-fe8a-46cd-80f8-91479ff9eb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:51.704821 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53bc822-653b-43e5-8e1f-34f5c5370ff0 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:51.719389 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfd721-7ba0-4878-b8ee-d7f51436be67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:51.721424 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfd721-7ba0-4878-b8ee-d7f51436be67 service nova] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:51.722123 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfd721-7ba0-4878-b8ee-d7f51436be67 service nova] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:51.722639 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfd721-7ba0-4878-b8ee-d7f51436be67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:51.728880 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-a2bfd721-7ba0-4878-b8ee-d7f51436be67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:51.840927 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119dbe6-fe8a-46cd-80f8-91479ff9eb34 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:51.934205 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bfd721-7ba0-4878-b8ee-d7f51436be67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:51.939270 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bfd721-7ba0-4878-b8ee-d7f51436be67 service nova] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:51.980612 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 853/1728] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:51 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:51.981839 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfd721-7ba0-4878-b8ee-d7f51436be67 service nova] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:52.038388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c405b-64ea-40fd-b54f-ca51b5c65019 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:52.039907 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c405b-64ea-40fd-b54f-ca51b5c65019 service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:52.040682 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c405b-64ea-40fd-b54f-ca51b5c65019 service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:52.045599 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c405b-64ea-40fd-b54f-ca51b5c65019 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:52.084327 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:52.202974 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfd721-7ba0-4878-b8ee-d7f51436be67 service nova] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:52.212403 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48961067-d93e-45cf-b119-cfdd4f066c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:52.213744 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48961067-d93e-45cf-b119-cfdd4f066c94 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:52.214337 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48961067-d93e-45cf-b119-cfdd4f066c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:52.214870 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48961067-d93e-45cf-b119-cfdd4f066c94 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:52.216109 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48961067-d93e-45cf-b119-cfdd4f066c94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:52.218618 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48961067-d93e-45cf-b119-cfdd4f066c94 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:52.236766 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c405b-64ea-40fd-b54f-ca51b5c65019 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:52.239538 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c405b-64ea-40fd-b54f-ca51b5c65019 service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:52.243960 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 854/1729] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:51:52.254850 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48961067-d93e-45cf-b119-cfdd4f066c94 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:52.287353 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48961067-d93e-45cf-b119-cfdd4f066c94 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:52.293738 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 876/1730] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:52.298741 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c405b-64ea-40fd-b54f-ca51b5c65019 service neutron] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:52.301109 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-4e5c405b-64ea-40fd-b54f-ca51b5c65019 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:52.304392 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaebf10-562a-4695-b984-5ab27f564883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:52.305721 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaebf10-562a-4695-b984-5ab27f564883 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:52.306322 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaebf10-562a-4695-b984-5ab27f564883 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:52.306840 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaebf10-562a-4695-b984-5ab27f564883 admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:52.307878 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaebf10-562a-4695-b984-5ab27f564883 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:52.312080 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaebf10-562a-4695-b984-5ab27f564883 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:52.350967 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c405b-64ea-40fd-b54f-ca51b5c65019 service neutron] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:52.358840 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 855/1731] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:51:52 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:52.359801 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaebf10-562a-4695-b984-5ab27f564883 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:52.368905 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7708c-d241-4a3e-afda-4234e1f22557 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:52.369694 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7708c-d241-4a3e-afda-4234e1f22557 service nova] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:52.370045 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7708c-d241-4a3e-afda-4234e1f22557 service nova] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:52.370334 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7708c-d241-4a3e-afda-4234e1f22557 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:52.389659 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaebf10-562a-4695-b984-5ab27f564883 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:52.402763 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dec851-b3a0-4002-9052-25af96ec642c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:52.406141 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dec851-b3a0-4002-9052-25af96ec642c admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:52.406428 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dec851-b3a0-4002-9052-25af96ec642c admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:52.406713 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dec851-b3a0-4002-9052-25af96ec642c admin admin] PATH_INFO: `/v3/projects/b29a0c2e7a064f8aa33d4d6487b69292/users/e7c61f82ae554225a2570eecb5e61b9f/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:52.458366 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dec851-b3a0-4002-9052-25af96ec642c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b29a0c2e7a064f8aa33d4d6487b69292, user_id=e7c61f82ae554225a2570eecb5e61b9f, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:52.467510 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dec851-b3a0-4002-9052-25af96ec642c admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:52.497989 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 856/1732] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:51:52 2022] PUT /identity/v3/projects/b29a0c2e7a064f8aa33d4d6487b69292/users/e7c61f82ae554225a2570eecb5e61b9f/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:52.497989 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dec851-b3a0-4002-9052-25af96ec642c admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:52.552963 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:52.595206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7708c-d241-4a3e-afda-4234e1f22557 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:52.597109 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7708c-d241-4a3e-afda-4234e1f22557 service nova] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:52.636247 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dec851-b3a0-4002-9052-25af96ec642c admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:52.657125 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17983c55-90d3-47a4-9dc5-5e829c45e268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:52.658774 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17983c55-90d3-47a4-9dc5-5e829c45e268 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:52.659217 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17983c55-90d3-47a4-9dc5-5e829c45e268 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:52.659504 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17983c55-90d3-47a4-9dc5-5e829c45e268 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:52.662738 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17983c55-90d3-47a4-9dc5-5e829c45e268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:52.668412 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17983c55-90d3-47a4-9dc5-5e829c45e268 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:52.670812 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 877/1733] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:52 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:52.671771 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7708c-d241-4a3e-afda-4234e1f22557 service nova] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:52.697840 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 857/1734] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:51:52.700120 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a6ab6-ce67-4f3e-8ff5-4f20c462352c None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:52.700417 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a6ab6-ce67-4f3e-8ff5-4f20c462352c None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:52.700698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a6ab6-ce67-4f3e-8ff5-4f20c462352c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:52.710540 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7708c-d241-4a3e-afda-4234e1f22557 service nova] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:52.728128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef433e90-bc63-4f70-8836-2a1462951c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:52.730004 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef433e90-bc63-4f70-8836-2a1462951c04 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:52.730510 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef433e90-bc63-4f70-8836-2a1462951c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:52.732546 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef433e90-bc63-4f70-8836-2a1462951c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:52.735470 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef433e90-bc63-4f70-8836-2a1462951c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:52.745412 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef433e90-bc63-4f70-8836-2a1462951c04 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:52.775232 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-663a6ab6-ce67-4f3e-8ff5-4f20c462352c None None] MFA Rules not processed for user `29005524946d44308e4f7e8f783f504e`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:52.778233 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-663a6ab6-ce67-4f3e-8ff5-4f20c462352c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:52.799629 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 878/1735] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:51:52.800961 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef433e90-bc63-4f70-8836-2a1462951c04 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:52.849436 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef433e90-bc63-4f70-8836-2a1462951c04 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:52.869948 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da24dfa-0882-48dc-b3bb-4ac471fa6cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:52.870792 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da24dfa-0882-48dc-b3bb-4ac471fa6cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:52.871242 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da24dfa-0882-48dc-b3bb-4ac471fa6cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:52.871653 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da24dfa-0882-48dc-b3bb-4ac471fa6cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:52.873760 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da24dfa-0882-48dc-b3bb-4ac471fa6cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:52.878145 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da24dfa-0882-48dc-b3bb-4ac471fa6cb9 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:52.911965 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 879/1736] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:51:52.912948 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da24dfa-0882-48dc-b3bb-4ac471fa6cb9 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:52.946684 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da24dfa-0882-48dc-b3bb-4ac471fa6cb9 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:52.956425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e8a04-2374-4ff2-8f88-0ae303c94089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:52.958354 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e8a04-2374-4ff2-8f88-0ae303c94089 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:52.958354 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e8a04-2374-4ff2-8f88-0ae303c94089 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:52.958673 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e8a04-2374-4ff2-8f88-0ae303c94089 admin admin] PATH_INFO: `/v3/projects/b29a0c2e7a064f8aa33d4d6487b69292/users/e7c61f82ae554225a2570eecb5e61b9f/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:52.966234 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e8a04-2374-4ff2-8f88-0ae303c94089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b29a0c2e7a064f8aa33d4d6487b69292, user_id=e7c61f82ae554225a2570eecb5e61b9f, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:52.972083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e8a04-2374-4ff2-8f88-0ae303c94089 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:52.996316 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 858/1737] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:52.996316 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a6ab6-ce67-4f3e-8ff5-4f20c462352c None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:53.016184 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a6ab6-ce67-4f3e-8ff5-4f20c462352c None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:53.023297 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 880/1738] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:51:52 2022] PUT /identity/v3/projects/b29a0c2e7a064f8aa33d4d6487b69292/users/e7c61f82ae554225a2570eecb5e61b9f/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:53.024924 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d480a-2c08-49f3-a523-b1fb2e54845c None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:53.025222 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d480a-2c08-49f3-a523-b1fb2e54845c None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:53.025545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d480a-2c08-49f3-a523-b1fb2e54845c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:53.063130 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-5e8d480a-2c08-49f3-a523-b1fb2e54845c None None] MFA Rules not processed for user `29005524946d44308e4f7e8f783f504e`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:53.066143 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-5e8d480a-2c08-49f3-a523-b1fb2e54845c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:53.177344 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a9a79-8fe1-45d3-87d3-8b6c48382c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:53.178090 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a9a79-8fe1-45d3-87d3-8b6c48382c53 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:53.178377 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a9a79-8fe1-45d3-87d3-8b6c48382c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:53.178678 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a9a79-8fe1-45d3-87d3-8b6c48382c53 admin admin] PATH_INFO: `/v3/projects/d4a6ec1658da4f0e84ac5677759e1298/users/a295b8bcc2e947bc94fc6f721edfd7ab/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:53.213685 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 881/1739] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:53.219866 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e6e82-3011-4dbb-aa95-6651bed30c03 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:53.220420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e6e82-3011-4dbb-aa95-6651bed30c03 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:53.220909 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e6e82-3011-4dbb-aa95-6651bed30c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:53.221486 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a9a79-8fe1-45d3-87d3-8b6c48382c53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4a6ec1658da4f0e84ac5677759e1298, user_id=a295b8bcc2e947bc94fc6f721edfd7ab, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:53.224221 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a9a79-8fe1-45d3-87d3-8b6c48382c53 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:53.251106 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 859/1740] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:51:52 2022] PUT /identity/v3/projects/d4a6ec1658da4f0e84ac5677759e1298/users/a295b8bcc2e947bc94fc6f721edfd7ab/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:53.252017 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a9a79-8fe1-45d3-87d3-8b6c48382c53 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:53.299122 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-a82e6e82-3011-4dbb-aa95-6651bed30c03 None None] MFA Rules not processed for user `e7c61f82ae554225a2570eecb5e61b9f`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:53.301260 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-a82e6e82-3011-4dbb-aa95-6651bed30c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:53.306947 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:53.366726 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:53.438265 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a9a79-8fe1-45d3-87d3-8b6c48382c53 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:53.456852 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8fe9e-8f95-4bc4-950a-bf83909d3cb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:53.458376 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8fe9e-8f95-4bc4-950a-bf83909d3cb3 service nova] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:53.458668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8fe9e-8f95-4bc4-950a-bf83909d3cb3 service nova] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:53.459082 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8fe9e-8f95-4bc4-950a-bf83909d3cb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:53.466083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 882/1741] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:53 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:53.472954 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3058c8d-7039-4732-b3d2-fd4603064825 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:53.473363 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3058c8d-7039-4732-b3d2-fd4603064825 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:53.481661 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3058c8d-7039-4732-b3d2-fd4603064825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:53.526652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-c3058c8d-7039-4732-b3d2-fd4603064825 None None] MFA Rules not processed for user `a295b8bcc2e947bc94fc6f721edfd7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:53.530547 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-c3058c8d-7039-4732-b3d2-fd4603064825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:53.606490 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a8fe9e-8f95-4bc4-950a-bf83909d3cb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:53.608708 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a8fe9e-8f95-4bc4-950a-bf83909d3cb3 service nova] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:53.624391 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 860/1742] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:53.626294 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8fe9e-8f95-4bc4-950a-bf83909d3cb3 service nova] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:53.628076 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-05a8fe9e-8f95-4bc4-950a-bf83909d3cb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:53.737778 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 883/1743] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:53.739645 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3058c8d-7039-4732-b3d2-fd4603064825 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:53.831618 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8fe9e-8f95-4bc4-950a-bf83909d3cb3 service nova] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:53.841833 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aff49d-f3d6-437b-884b-532a8821b733 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:53.843242 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aff49d-f3d6-437b-884b-532a8821b733 service cinder] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:53.843536 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aff49d-f3d6-437b-884b-532a8821b733 service cinder] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:53.845451 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aff49d-f3d6-437b-884b-532a8821b733 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:53.878907 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aff49d-f3d6-437b-884b-532a8821b733 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:53.881696 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aff49d-f3d6-437b-884b-532a8821b733 service cinder] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:53.924150 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 861/1744] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:53 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:53.926465 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aff49d-f3d6-437b-884b-532a8821b733 service cinder] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:53.930573 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-72aff49d-f3d6-437b-884b-532a8821b733 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:53.942997 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3058c8d-7039-4732-b3d2-fd4603064825 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:53.957553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624b057-d0b6-486c-a3fc-e580544192f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:53.959412 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624b057-d0b6-486c-a3fc-e580544192f6 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:53.959705 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624b057-d0b6-486c-a3fc-e580544192f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:53.960020 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624b057-d0b6-486c-a3fc-e580544192f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:53.960796 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624b057-d0b6-486c-a3fc-e580544192f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:53.966950 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624b057-d0b6-486c-a3fc-e580544192f6 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:53.978285 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aff49d-f3d6-437b-884b-532a8821b733 service cinder] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:53.994753 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ede0e9-528a-4864-89d8-b2e8287ad9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:53.997000 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ede0e9-528a-4864-89d8-b2e8287ad9b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:53.997581 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ede0e9-528a-4864-89d8-b2e8287ad9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:54.000456 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ede0e9-528a-4864-89d8-b2e8287ad9b3 admin admin] PATH_INFO: `/v3/projects/b98480f0da34499a97c9982e3f9f3973` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:54.003009 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ede0e9-528a-4864-89d8-b2e8287ad9b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b98480f0da34499a97c9982e3f9f3973)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:54.008448 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ede0e9-528a-4864-89d8-b2e8287ad9b3 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:54.067442 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 884/1745] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:51:53 2022] POST /identity/v3/projects => generated 385 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:54.072083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841f94c-f097-4205-8da8-ff5e1c5e45e9 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:54.073871 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841f94c-f097-4205-8da8-ff5e1c5e45e9 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:54.074499 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841f94c-f097-4205-8da8-ff5e1c5e45e9 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:54.076208 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 885/1746] 10.222.0.46 () {54 vars in 912 bytes} [Wed Aug 3 12:51:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:54.085736 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841f94c-f097-4205-8da8-ff5e1c5e45e9 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:54.137408 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:54.151976 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-83ede0e9-528a-4864-89d8-b2e8287ad9b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b98480f0da34499a97c9982e3f9f3973', 'request_id': 'req-83ede0e9-528a-4864-89d8-b2e8287ad9b3'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:54.166319 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-83ede0e9-528a-4864-89d8-b2e8287ad9b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b98480f0da34499a97c9982e3f9f3973', 'request_id': 'req-83ede0e9-528a-4864-89d8-b2e8287ad9b3'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:54.179181 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-83ede0e9-528a-4864-89d8-b2e8287ad9b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b98480f0da34499a97c9982e3f9f3973', 'request_id': 'req-83ede0e9-528a-4864-89d8-b2e8287ad9b3'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:54.204643 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-83ede0e9-528a-4864-89d8-b2e8287ad9b3 admin admin] The token cache is being invalidate because project b98480f0da34499a97c9982e3f9f3973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:51:54.204968 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-83ede0e9-528a-4864-89d8-b2e8287ad9b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:54.207269 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-83ede0e9-528a-4864-89d8-b2e8287ad9b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:54.210114 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 862/1747] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:51:53 2022] DELETE /identity/v3/projects/b98480f0da34499a97c9982e3f9f3973 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:54.215377 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ede0e9-528a-4864-89d8-b2e8287ad9b3 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:54.219548 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-83ede0e9-528a-4864-89d8-b2e8287ad9b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:54.243666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:54.280679 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841f94c-f097-4205-8da8-ff5e1c5e45e9 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:54.466997 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ede0e9-528a-4864-89d8-b2e8287ad9b3 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:54.479034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b46e0d-e5ca-40a1-bd79-8d36ca1c8ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:54.480991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e3e1c-44b5-4989-8738-72f74ab8db06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:54.482058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b46e0d-e5ca-40a1-bd79-8d36ca1c8ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:54.482674 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e3e1c-44b5-4989-8738-72f74ab8db06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:54.483531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e3e1c-44b5-4989-8738-72f74ab8db06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:54.483782 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b46e0d-e5ca-40a1-bd79-8d36ca1c8ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:54.484235 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b46e0d-e5ca-40a1-bd79-8d36ca1c8ab2 admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:54.484654 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e3e1c-44b5-4989-8738-72f74ab8db06 admin admin] PATH_INFO: `/v3/users/cf4ea3db48a14fefb8fb75cb1590fe38` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:54.485513 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b46e0d-e5ca-40a1-bd79-8d36ca1c8ab2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:54.487664 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e3e1c-44b5-4989-8738-72f74ab8db06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf4ea3db48a14fefb8fb75cb1590fe38)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:54.491850 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b46e0d-e5ca-40a1-bd79-8d36ca1c8ab2 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:54.495544 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e3e1c-44b5-4989-8738-72f74ab8db06 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:54.541684 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 863/1748] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:51:54 2022] POST /identity/v3/users => generated 293 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:54.543442 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2b1ea-3f08-4c14-82b2-2049f3434725 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:54.543754 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2b1ea-3f08-4c14-82b2-2049f3434725 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:54.544068 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2b1ea-3f08-4c14-82b2-2049f3434725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:54.576941 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-b06e3e1c-44b5-4989-8738-72f74ab8db06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf4ea3db48a14fefb8fb75cb1590fe38'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:54.578069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-b06e3e1c-44b5-4989-8738-72f74ab8db06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf4ea3db48a14fefb8fb75cb1590fe38'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:54.578986 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-b06e3e1c-44b5-4989-8738-72f74ab8db06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf4ea3db48a14fefb8fb75cb1590fe38'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:54.591889 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-a6b2b1ea-3f08-4c14-82b2-2049f3434725 None None] MFA Rules not processed for user `e0cd747cb5f64ff7b5f8d67d3d640fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:54.592970 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-a6b2b1ea-3f08-4c14-82b2-2049f3434725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:54.597822 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-b06e3e1c-44b5-4989-8738-72f74ab8db06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf4ea3db48a14fefb8fb75cb1590fe38'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:54.607653 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-b06e3e1c-44b5-4989-8738-72f74ab8db06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf4ea3db48a14fefb8fb75cb1590fe38'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:54.627123 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 886/1749] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:51:54 2022] DELETE /identity/v3/users/cf4ea3db48a14fefb8fb75cb1590fe38 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:54.628560 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e3e1c-44b5-4989-8738-72f74ab8db06 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:54.631192 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-b06e3e1c-44b5-4989-8738-72f74ab8db06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:54.663332 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 864/1750] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Aug 3 12:51:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:54.664258 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2b1ea-3f08-4c14-82b2-2049f3434725 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:54.665848 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-a6b2b1ea-3f08-4c14-82b2-2049f3434725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:54.682939 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2b1ea-3f08-4c14-82b2-2049f3434725 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:54.712872 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:54.747507 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e3e1c-44b5-4989-8738-72f74ab8db06 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:54.756319 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436e655-9817-4550-97d3-7526e7f0cf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:54.757455 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436e655-9817-4550-97d3-7526e7f0cf68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:54.759014 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436e655-9817-4550-97d3-7526e7f0cf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:54.759449 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436e655-9817-4550-97d3-7526e7f0cf68 admin admin] PATH_INFO: `/v3/users/eaf38f83460146b182a42dff498fa269` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:54.761228 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5436e655-9817-4550-97d3-7526e7f0cf68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaf38f83460146b182a42dff498fa269)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:54.764335 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5436e655-9817-4550-97d3-7526e7f0cf68 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:54.765353 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df2c61-9b67-4257-aec4-6fb7ba620ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:54.766515 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df2c61-9b67-4257-aec4-6fb7ba620ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:54.766864 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df2c61-9b67-4257-aec4-6fb7ba620ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:54.767147 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df2c61-9b67-4257-aec4-6fb7ba620ff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:54.767858 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df2c61-9b67-4257-aec4-6fb7ba620ff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:54.772206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df2c61-9b67-4257-aec4-6fb7ba620ff3 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:54.805895 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 865/1751] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:51:54.807719 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d0821-6b0d-4e7b-8dbf-1e8a89b443f4 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:54.808308 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d0821-6b0d-4e7b-8dbf-1e8a89b443f4 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:54.808669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d0821-6b0d-4e7b-8dbf-1e8a89b443f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:54.832605 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-5436e655-9817-4550-97d3-7526e7f0cf68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaf38f83460146b182a42dff498fa269'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:54.834126 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-5436e655-9817-4550-97d3-7526e7f0cf68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaf38f83460146b182a42dff498fa269'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:54.834974 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-5436e655-9817-4550-97d3-7526e7f0cf68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaf38f83460146b182a42dff498fa269'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:54.861869 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-5436e655-9817-4550-97d3-7526e7f0cf68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaf38f83460146b182a42dff498fa269'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:54.873817 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-5436e655-9817-4550-97d3-7526e7f0cf68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaf38f83460146b182a42dff498fa269'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:54.878828 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-190d0821-6b0d-4e7b-8dbf-1e8a89b443f4 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:54.880130 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-190d0821-6b0d-4e7b-8dbf-1e8a89b443f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:54.906048 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 866/1752] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:54.907011 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d0821-6b0d-4e7b-8dbf-1e8a89b443f4 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:54.907348 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 887/1753] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:51:54 2022] DELETE /identity/v3/users/eaf38f83460146b182a42dff498fa269 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:54.920215 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-190d0821-6b0d-4e7b-8dbf-1e8a89b443f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:54.927885 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436e655-9817-4550-97d3-7526e7f0cf68 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:54.931577 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-5436e655-9817-4550-97d3-7526e7f0cf68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:54.973728 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:55.046043 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436e655-9817-4550-97d3-7526e7f0cf68 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:55.053976 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01b61d-fa1b-4865-9d23-71a7af941a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:55.055665 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01b61d-fa1b-4865-9d23-71a7af941a70 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:55.056694 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01b61d-fa1b-4865-9d23-71a7af941a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:55.057891 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01b61d-fa1b-4865-9d23-71a7af941a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:55.058915 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01b61d-fa1b-4865-9d23-71a7af941a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:55.059781 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d0821-6b0d-4e7b-8dbf-1e8a89b443f4 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:55.061423 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01b61d-fa1b-4865-9d23-71a7af941a70 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:55.078096 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 888/1754] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:51:55.078981 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01b61d-fa1b-4865-9d23-71a7af941a70 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:55.083659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-cb01b61d-fa1b-4865-9d23-71a7af941a70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:55.186103 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01b61d-fa1b-4865-9d23-71a7af941a70 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:55.187922 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b14c6b-ef2e-46e6-bf4b-c1b6fe9efa0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:55.188562 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b14c6b-ef2e-46e6-bf4b-c1b6fe9efa0a service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:55.188850 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b14c6b-ef2e-46e6-bf4b-c1b6fe9efa0a service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:55.189128 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b14c6b-ef2e-46e6-bf4b-c1b6fe9efa0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:55.190838 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966436a1-f0e5-413a-9d31-1ccc7203720c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:55.191921 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966436a1-f0e5-413a-9d31-1ccc7203720c service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:55.192336 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966436a1-f0e5-413a-9d31-1ccc7203720c service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:55.192764 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966436a1-f0e5-413a-9d31-1ccc7203720c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:55.193044 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-49b14c6b-ef2e-46e6-bf4b-c1b6fe9efa0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:55.205711 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966436a1-f0e5-413a-9d31-1ccc7203720c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:55.207861 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966436a1-f0e5-413a-9d31-1ccc7203720c service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:55.215923 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:55.217233 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b14c6b-ef2e-46e6-bf4b-c1b6fe9efa0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:55.222241 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b14c6b-ef2e-46e6-bf4b-c1b6fe9efa0a service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:55.225212 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 889/1755] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:55.227662 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cdd88-2005-4239-8d03-b02b7d871164 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:55.228352 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cdd88-2005-4239-8d03-b02b7d871164 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:55.228939 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cdd88-2005-4239-8d03-b02b7d871164 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:55.232698 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 890/1756] 10.222.0.46 () {54 vars in 912 bytes} [Wed Aug 3 12:51:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:51:55.233960 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cdd88-2005-4239-8d03-b02b7d871164 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:55.244979 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 867/1757] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:55.246918 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef88ff-e0e5-4f3d-9a7b-44a0263a2318 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:55.247754 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef88ff-e0e5-4f3d-9a7b-44a0263a2318 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:55.247754 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef88ff-e0e5-4f3d-9a7b-44a0263a2318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:55.259760 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cdd88-2005-4239-8d03-b02b7d871164 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:55.267001 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b7967-6db7-410d-acf4-45cb3e848066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:55.267973 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b7967-6db7-410d-acf4-45cb3e848066 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:55.268368 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b7967-6db7-410d-acf4-45cb3e848066 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:55.268899 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b7967-6db7-410d-acf4-45cb3e848066 admin admin] PATH_INFO: `/v3/projects/e62e93b8221b4dc790b892463d000b60/users/071043198a34465b9673127491beb914/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:55.295182 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-cbef88ff-e0e5-4f3d-9a7b-44a0263a2318 None None] MFA Rules not processed for user `e0cd747cb5f64ff7b5f8d67d3d640fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:55.296374 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-cbef88ff-e0e5-4f3d-9a7b-44a0263a2318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:55.304136 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b7967-6db7-410d-acf4-45cb3e848066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e62e93b8221b4dc790b892463d000b60, user_id=071043198a34465b9673127491beb914, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:55.309931 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b7967-6db7-410d-acf4-45cb3e848066 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:55.313451 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 868/1758] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Aug 3 12:51:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:55.333132 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 891/1759] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:51:55 2022] PUT /identity/v3/projects/e62e93b8221b4dc790b892463d000b60/users/071043198a34465b9673127491beb914/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:55.343422 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06e785-ddc1-44fb-8860-1a5acffb5a3c None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:55.343734 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06e785-ddc1-44fb-8860-1a5acffb5a3c None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:55.343973 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06e785-ddc1-44fb-8860-1a5acffb5a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:55.393860 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-9a06e785-ddc1-44fb-8860-1a5acffb5a3c None None] MFA Rules not processed for user `071043198a34465b9673127491beb914`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:55.395366 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-9a06e785-ddc1-44fb-8860-1a5acffb5a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:55.502724 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b7967-6db7-410d-acf4-45cb3e848066 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:55.512521 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 869/1760] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:55.516789 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06e785-ddc1-44fb-8860-1a5acffb5a3c None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:55.667197 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06e785-ddc1-44fb-8860-1a5acffb5a3c None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:55.677454 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4f2f4-a289-429d-8065-ed6b0020e998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:55.678976 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b7967-6db7-410d-acf4-45cb3e848066 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:55.680436 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4f2f4-a289-429d-8065-ed6b0020e998 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:55.680763 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4f2f4-a289-429d-8065-ed6b0020e998 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:55.681041 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4f2f4-a289-429d-8065-ed6b0020e998 admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:55.682528 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4f2f4-a289-429d-8065-ed6b0020e998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:55.686560 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4f2f4-a289-429d-8065-ed6b0020e998 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:55.692346 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9107f-972f-4e7d-ba17-b7c63d65a1a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:55.692990 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9107f-972f-4e7d-ba17-b7c63d65a1a3 service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:55.693273 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9107f-972f-4e7d-ba17-b7c63d65a1a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:55.693640 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9107f-972f-4e7d-ba17-b7c63d65a1a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:55.701242 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:55.715496 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9107f-972f-4e7d-ba17-b7c63d65a1a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:55.719245 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9107f-972f-4e7d-ba17-b7c63d65a1a3 service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:55.738984 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 892/1761] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:55.759327 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 870/1762] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:51:55 2022] POST /identity/v3/projects => generated 387 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:51:55.760294 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9107f-972f-4e7d-ba17-b7c63d65a1a3 service neutron] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:55.791825 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9107f-972f-4e7d-ba17-b7c63d65a1a3 service neutron] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:55.970298 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ae206-3665-4c7e-b48f-15534a0bbab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:55.972183 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ae206-3665-4c7e-b48f-15534a0bbab9 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:55.972481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ae206-3665-4c7e-b48f-15534a0bbab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:55.972765 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ae206-3665-4c7e-b48f-15534a0bbab9 admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:55.974954 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ae206-3665-4c7e-b48f-15534a0bbab9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:55.978109 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ae206-3665-4c7e-b48f-15534a0bbab9 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:56.012220 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 893/1763] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:51:55 2022] POST /identity/v3/users => generated 300 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:51:56.015625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4f2f4-a289-429d-8065-ed6b0020e998 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:56.032444 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4f2f4-a289-429d-8065-ed6b0020e998 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:56.046581 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df3a76-e565-4de9-8bdf-8b815fc4ab1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:56.047262 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df3a76-e565-4de9-8bdf-8b815fc4ab1c admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:56.047543 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df3a76-e565-4de9-8bdf-8b815fc4ab1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:56.047821 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df3a76-e565-4de9-8bdf-8b815fc4ab1c admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:56.048527 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df3a76-e565-4de9-8bdf-8b815fc4ab1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:56.050183 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df3a76-e565-4de9-8bdf-8b815fc4ab1c admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:56.070064 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ae206-3665-4c7e-b48f-15534a0bbab9 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:56.070924 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 871/1764] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:51:56.084390 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ae206-3665-4c7e-b48f-15534a0bbab9 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:56.090313 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f988c-69ed-4c6f-8a50-1d2272630dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:56.091228 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f988c-69ed-4c6f-8a50-1d2272630dc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:56.091838 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f988c-69ed-4c6f-8a50-1d2272630dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:56.092223 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f988c-69ed-4c6f-8a50-1d2272630dc1 admin admin] PATH_INFO: `/v3/projects/16ad9f619c904865a35502173eefb39f/users/65589b3fd7204b2ea853bac5817d3140/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:56.120199 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f988c-69ed-4c6f-8a50-1d2272630dc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16ad9f619c904865a35502173eefb39f, user_id=65589b3fd7204b2ea853bac5817d3140, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:56.123687 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f988c-69ed-4c6f-8a50-1d2272630dc1 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:56.144629 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 894/1765] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:51:56 2022] PUT /identity/v3/projects/16ad9f619c904865a35502173eefb39f/users/65589b3fd7204b2ea853bac5817d3140/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:56.145919 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df3a76-e565-4de9-8bdf-8b815fc4ab1c admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:56.168331 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df3a76-e565-4de9-8bdf-8b815fc4ab1c admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:56.286554 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f988c-69ed-4c6f-8a50-1d2272630dc1 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:56.292008 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-453f988c-69ed-4c6f-8a50-1d2272630dc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:56.295783 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adaa7eb-b830-4a41-9c93-6b5737eeac72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:56.300125 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adaa7eb-b830-4a41-9c93-6b5737eeac72 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:56.300494 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adaa7eb-b830-4a41-9c93-6b5737eeac72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:56.303432 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adaa7eb-b830-4a41-9c93-6b5737eeac72 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:56.310131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adaa7eb-b830-4a41-9c93-6b5737eeac72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:56.312372 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adaa7eb-b830-4a41-9c93-6b5737eeac72 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:56.344528 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 872/1766] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:51:56.347883 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adaa7eb-b830-4a41-9c93-6b5737eeac72 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:56.367748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adaa7eb-b830-4a41-9c93-6b5737eeac72 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:56.379465 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4abeb98-aac1-411f-b8fa-26118a51535e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:56.381880 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abeb98-aac1-411f-b8fa-26118a51535e admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:56.382828 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abeb98-aac1-411f-b8fa-26118a51535e admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:56.382828 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abeb98-aac1-411f-b8fa-26118a51535e admin admin] PATH_INFO: `/v3/projects/16ad9f619c904865a35502173eefb39f/users/65589b3fd7204b2ea853bac5817d3140/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:56.389128 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4abeb98-aac1-411f-b8fa-26118a51535e admin admin] RBAC: Authorizing `identity:create_grant(project_id=16ad9f619c904865a35502173eefb39f, user_id=65589b3fd7204b2ea853bac5817d3140, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:56.392042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4abeb98-aac1-411f-b8fa-26118a51535e admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:56.400978 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:56.432167 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 873/1767] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:51:56 2022] PUT /identity/v3/projects/16ad9f619c904865a35502173eefb39f/users/65589b3fd7204b2ea853bac5817d3140/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:56.435047 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91bb02-8e17-432f-af8b-870e8110800f None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:56.435447 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91bb02-8e17-432f-af8b-870e8110800f None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:56.435831 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91bb02-8e17-432f-af8b-870e8110800f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:56.462659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f988c-69ed-4c6f-8a50-1d2272630dc1 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:56.513196 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-5f91bb02-8e17-432f-af8b-870e8110800f None None] MFA Rules not processed for user `65589b3fd7204b2ea853bac5817d3140`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:56.514660 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-5f91bb02-8e17-432f-af8b-870e8110800f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:56.697185 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eef071-a18e-4152-a2d8-bd4054ea020c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56847173abb48d39c0ee6fb9cdbbbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:56.699558 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eef071-a18e-4152-a2d8-bd4054ea020c service placement] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:56.700339 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eef071-a18e-4152-a2d8-bd4054ea020c service placement] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:56.701476 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eef071-a18e-4152-a2d8-bd4054ea020c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:56.705714 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 874/1768] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:56 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:56.710843 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91bb02-8e17-432f-af8b-870e8110800f None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:56.711619 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-e5eef071-a18e-4152-a2d8-bd4054ea020c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:56.718024 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-5f91bb02-8e17-432f-af8b-870e8110800f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:56.732530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eef071-a18e-4152-a2d8-bd4054ea020c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:56.734014 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eef071-a18e-4152-a2d8-bd4054ea020c service placement] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:56.761631 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 895/1769] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:51:56.763131 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aaf7f8-01cf-47ad-94ae-8ef0216a9e30 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:56.763431 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aaf7f8-01cf-47ad-94ae-8ef0216a9e30 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:56.765218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aaf7f8-01cf-47ad-94ae-8ef0216a9e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:56.827378 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:56.832451 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-48aaf7f8-01cf-47ad-94ae-8ef0216a9e30 None None] MFA Rules not processed for user `539502db204e415c85520d9b7fe77d99`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:56.834483 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-48aaf7f8-01cf-47ad-94ae-8ef0216a9e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:56.868253 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91bb02-8e17-432f-af8b-870e8110800f None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:56.874657 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f96d35-0a97-4820-8a3f-db5926756a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:56.876469 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f96d35-0a97-4820-8a3f-db5926756a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:56.876850 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f96d35-0a97-4820-8a3f-db5926756a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:56.877131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f96d35-0a97-4820-8a3f-db5926756a65 admin admin] PATH_INFO: `/v3/projects/e72b4b23edfb4302a45cb48a8b1dd771` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:56.881674 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f96d35-0a97-4820-8a3f-db5926756a65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e72b4b23edfb4302a45cb48a8b1dd771)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:56.891629 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f96d35-0a97-4820-8a3f-db5926756a65 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:56.983444 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-89f96d35-0a97-4820-8a3f-db5926756a65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e72b4b23edfb4302a45cb48a8b1dd771', 'request_id': 'req-89f96d35-0a97-4820-8a3f-db5926756a65'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:56.984589 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 896/1770] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:56.985477 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aaf7f8-01cf-47ad-94ae-8ef0216a9e30 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:56.992200 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-48aaf7f8-01cf-47ad-94ae-8ef0216a9e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:57.001326 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-89f96d35-0a97-4820-8a3f-db5926756a65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e72b4b23edfb4302a45cb48a8b1dd771', 'request_id': 'req-89f96d35-0a97-4820-8a3f-db5926756a65'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:57.032539 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-89f96d35-0a97-4820-8a3f-db5926756a65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e72b4b23edfb4302a45cb48a8b1dd771', 'request_id': 'req-89f96d35-0a97-4820-8a3f-db5926756a65'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:57.067796 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-89f96d35-0a97-4820-8a3f-db5926756a65 admin admin] The token cache is being invalidate because project e72b4b23edfb4302a45cb48a8b1dd771 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:51:57.067936 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-89f96d35-0a97-4820-8a3f-db5926756a65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:57.069880 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-89f96d35-0a97-4820-8a3f-db5926756a65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:57.078705 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 875/1771] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:51:56 2022] DELETE /identity/v3/projects/e72b4b23edfb4302a45cb48a8b1dd771 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:57.082971 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856a666-de7f-4e7f-ae70-376dd0f472d3 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:57.083263 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856a666-de7f-4e7f-ae70-376dd0f472d3 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:57.083548 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856a666-de7f-4e7f-ae70-376dd0f472d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:57.152706 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aaf7f8-01cf-47ad-94ae-8ef0216a9e30 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:57.167999 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-e856a666-de7f-4e7f-ae70-376dd0f472d3 None None] MFA Rules not processed for user `831d8776102847efbdae901f2b863226`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:57.176568 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-e856a666-de7f-4e7f-ae70-376dd0f472d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:57.228997 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:57.271520 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6233d8-5f33-45f4-90af-2d77ab6e7b3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:57.272161 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6233d8-5f33-45f4-90af-2d77ab6e7b3a service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:57.272460 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6233d8-5f33-45f4-90af-2d77ab6e7b3a service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:57.272855 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6233d8-5f33-45f4-90af-2d77ab6e7b3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:57.281578 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-0c6233d8-5f33-45f4-90af-2d77ab6e7b3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:57.350312 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 876/1772] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:57.365021 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad33222-5542-45c5-ba80-d3662df367c2 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:57.365309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad33222-5542-45c5-ba80-d3662df367c2 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:57.365608 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad33222-5542-45c5-ba80-d3662df367c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:57.418860 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-bad33222-5542-45c5-ba80-d3662df367c2 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:57.422333 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-bad33222-5542-45c5-ba80-d3662df367c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:57.484327 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6233d8-5f33-45f4-90af-2d77ab6e7b3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:57.491183 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6233d8-5f33-45f4-90af-2d77ab6e7b3a service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:57.517798 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 897/1773] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:56 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:51:57.518785 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6233d8-5f33-45f4-90af-2d77ab6e7b3a service cinder] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:57.525837 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-0c6233d8-5f33-45f4-90af-2d77ab6e7b3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:57.591716 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 877/1774] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:57.599980 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdc53a-76c8-4fef-8914-ab3c9d1a2a8d None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:57.600304 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdc53a-76c8-4fef-8914-ab3c9d1a2a8d None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:57.600619 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdc53a-76c8-4fef-8914-ab3c9d1a2a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:57.642842 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-76fdc53a-76c8-4fef-8914-ab3c9d1a2a8d None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:57.645745 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-76fdc53a-76c8-4fef-8914-ab3c9d1a2a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:57.663146 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 878/1775] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:51:57.664730 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fdc53a-76c8-4fef-8914-ab3c9d1a2a8d None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:57.687607 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fdc53a-76c8-4fef-8914-ab3c9d1a2a8d None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:57.699796 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6233d8-5f33-45f4-90af-2d77ab6e7b3a service cinder] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:57.700363 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43ad0f-aa2b-4c6f-ac76-305fcb044940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:57.701837 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43ad0f-aa2b-4c6f-ac76-305fcb044940 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:57.702129 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43ad0f-aa2b-4c6f-ac76-305fcb044940 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:57.702557 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43ad0f-aa2b-4c6f-ac76-305fcb044940 admin admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:57.703785 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43ad0f-aa2b-4c6f-ac76-305fcb044940 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:57.703785 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43ad0f-aa2b-4c6f-ac76-305fcb044940 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:57.705657 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43ad0f-aa2b-4c6f-ac76-305fcb044940 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:57.718096 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9192f-218a-410d-beeb-11f0e60f0f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:57.718768 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9192f-218a-410d-beeb-11f0e60f0f85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:57.719046 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9192f-218a-410d-beeb-11f0e60f0f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:57.719660 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9192f-218a-410d-beeb-11f0e60f0f85 admin admin] PATH_INFO: `/v3/projects/9063a76dc4604b6eb138e822ff34cd56` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:57.723343 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe9192f-218a-410d-beeb-11f0e60f0f85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9063a76dc4604b6eb138e822ff34cd56)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:57.728542 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe9192f-218a-410d-beeb-11f0e60f0f85 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:57.732205 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:57.752796 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 879/1776] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:51:57.757096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43ad0f-aa2b-4c6f-ac76-305fcb044940 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:57.780267 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43ad0f-aa2b-4c6f-ac76-305fcb044940 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:57.794742 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da030983-f5ce-4e18-91e5-5e648e71f7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:57.795942 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da030983-f5ce-4e18-91e5-5e648e71f7e7 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:57.796225 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da030983-f5ce-4e18-91e5-5e648e71f7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:57.796500 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da030983-f5ce-4e18-91e5-5e648e71f7e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:57.797186 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da030983-f5ce-4e18-91e5-5e648e71f7e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:57.801633 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da030983-f5ce-4e18-91e5-5e648e71f7e7 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:57.860649 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-1fe9192f-218a-410d-beeb-11f0e60f0f85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9063a76dc4604b6eb138e822ff34cd56', 'request_id': 'req-1fe9192f-218a-410d-beeb-11f0e60f0f85'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:57.876918 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-1fe9192f-218a-410d-beeb-11f0e60f0f85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9063a76dc4604b6eb138e822ff34cd56', 'request_id': 'req-1fe9192f-218a-410d-beeb-11f0e60f0f85'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:57.878454 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 880/1777] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:51:57 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:57.880528 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da030983-f5ce-4e18-91e5-5e648e71f7e7 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:57.894153 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-1fe9192f-218a-410d-beeb-11f0e60f0f85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9063a76dc4604b6eb138e822ff34cd56', 'request_id': 'req-1fe9192f-218a-410d-beeb-11f0e60f0f85'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:57.928026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-1fe9192f-218a-410d-beeb-11f0e60f0f85 admin admin] The token cache is being invalidate because project 9063a76dc4604b6eb138e822ff34cd56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:51:57.928309 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-1fe9192f-218a-410d-beeb-11f0e60f0f85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:57.932830 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-1fe9192f-218a-410d-beeb-11f0e60f0f85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:57.940898 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 898/1778] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:51:57 2022] DELETE /identity/v3/projects/9063a76dc4604b6eb138e822ff34cd56 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:57.943249 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9192f-218a-410d-beeb-11f0e60f0f85 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:57.947791 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-1fe9192f-218a-410d-beeb-11f0e60f0f85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:58.001757 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:58.071152 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da030983-f5ce-4e18-91e5-5e648e71f7e7 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:58.086296 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03a0a3-3ea2-444e-9392-08600bbfa6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:58.086296 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03a0a3-3ea2-444e-9392-08600bbfa6ce admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:58.086713 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03a0a3-3ea2-444e-9392-08600bbfa6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:58.086987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03a0a3-3ea2-444e-9392-08600bbfa6ce admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:58.087657 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03a0a3-3ea2-444e-9392-08600bbfa6ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:58.089606 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03a0a3-3ea2-444e-9392-08600bbfa6ce admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:58.130955 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9192f-218a-410d-beeb-11f0e60f0f85 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:58.147891 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 881/1779] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:51:57 2022] POST /identity/v3/users => generated 289 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:58.148035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524791c1-8789-46b1-9c8a-7db18262d7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:58.148035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524791c1-8789-46b1-9c8a-7db18262d7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:58.148035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524791c1-8789-46b1-9c8a-7db18262d7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:58.148035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524791c1-8789-46b1-9c8a-7db18262d7e7 admin admin] PATH_INFO: `/v3/users/e7c61f82ae554225a2570eecb5e61b9f` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:58.149246 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03a0a3-3ea2-444e-9392-08600bbfa6ce admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:58.150875 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524791c1-8789-46b1-9c8a-7db18262d7e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7c61f82ae554225a2570eecb5e61b9f)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:58.154839 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-2d03a0a3-3ea2-444e-9392-08600bbfa6ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:58.165834 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524791c1-8789-46b1-9c8a-7db18262d7e7 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:58.211582 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03a0a3-3ea2-444e-9392-08600bbfa6ce admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:58.223401 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0918a7-c069-44a0-bd3b-02de8f453219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:58.224051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0918a7-c069-44a0-bd3b-02de8f453219 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:58.225006 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0918a7-c069-44a0-bd3b-02de8f453219 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:58.225287 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0918a7-c069-44a0-bd3b-02de8f453219 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:58.226037 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0918a7-c069-44a0-bd3b-02de8f453219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:58.228214 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0918a7-c069-44a0-bd3b-02de8f453219 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:58.267384 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 882/1780] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:51:58.271543 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0918a7-c069-44a0-bd3b-02de8f453219 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:58.303813 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0918a7-c069-44a0-bd3b-02de8f453219 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:58.311857 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-524791c1-8789-46b1-9c8a-7db18262d7e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7c61f82ae554225a2570eecb5e61b9f'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:58.312979 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-524791c1-8789-46b1-9c8a-7db18262d7e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7c61f82ae554225a2570eecb5e61b9f'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:58.313874 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-524791c1-8789-46b1-9c8a-7db18262d7e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7c61f82ae554225a2570eecb5e61b9f'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:58.325932 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b005e-6cf1-4919-a480-1a120ca327a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:58.326568 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b005e-6cf1-4919-a480-1a120ca327a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:58.327035 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b005e-6cf1-4919-a480-1a120ca327a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:58.327414 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b005e-6cf1-4919-a480-1a120ca327a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:58.328122 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b005e-6cf1-4919-a480-1a120ca327a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:58.329886 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b005e-6cf1-4919-a480-1a120ca327a6 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:58.347002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 883/1781] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:51:58.348106 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b005e-6cf1-4919-a480-1a120ca327a6 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:58.350738 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-f23b005e-6cf1-4919-a480-1a120ca327a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:58.352898 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-524791c1-8789-46b1-9c8a-7db18262d7e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7c61f82ae554225a2570eecb5e61b9f'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:58.373091 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-524791c1-8789-46b1-9c8a-7db18262d7e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7c61f82ae554225a2570eecb5e61b9f'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:58.376340 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b005e-6cf1-4919-a480-1a120ca327a6 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:58.388938 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62da430-877e-4af5-8eca-57cce10b7fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:58.391627 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62da430-877e-4af5-8eca-57cce10b7fef admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:58.391912 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62da430-877e-4af5-8eca-57cce10b7fef admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:58.399960 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62da430-877e-4af5-8eca-57cce10b7fef admin admin] PATH_INFO: `/v3/projects/28045081acc94157aef07d67baf3cb0a/users/88b1d3616ba34955b061d0ed4f3ea498/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:58.413217 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 899/1782] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:51:57 2022] DELETE /identity/v3/users/e7c61f82ae554225a2570eecb5e61b9f => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:58.458948 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62da430-877e-4af5-8eca-57cce10b7fef admin admin] RBAC: Authorizing `identity:create_grant(project_id=28045081acc94157aef07d67baf3cb0a, user_id=88b1d3616ba34955b061d0ed4f3ea498, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:58.465092 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62da430-877e-4af5-8eca-57cce10b7fef admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:58.511407 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 884/1783] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:51:58 2022] PUT /identity/v3/projects/28045081acc94157aef07d67baf3cb0a/users/88b1d3616ba34955b061d0ed4f3ea498/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:58.522301 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623e99d-de5f-423b-bcb5-c0874ef2a7c2 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:58.522857 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623e99d-de5f-423b-bcb5-c0874ef2a7c2 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:58.522857 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623e99d-de5f-423b-bcb5-c0874ef2a7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:58.595525 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-5623e99d-de5f-423b-bcb5-c0874ef2a7c2 None None] MFA Rules not processed for user `88b1d3616ba34955b061d0ed4f3ea498`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:58.596747 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-5623e99d-de5f-423b-bcb5-c0874ef2a7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:58.834093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 900/1784] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:58.839351 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62da430-877e-4af5-8eca-57cce10b7fef admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:59.005540 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62da430-877e-4af5-8eca-57cce10b7fef admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:59.027965 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623e99d-de5f-423b-bcb5-c0874ef2a7c2 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:59.029385 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-5623e99d-de5f-423b-bcb5-c0874ef2a7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:59.033531 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbef9c-8ed9-4523-b319-77292e4eb0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:59.034202 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbef9c-8ed9-4523-b319-77292e4eb0ba admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:59.034631 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbef9c-8ed9-4523-b319-77292e4eb0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:59.034951 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbef9c-8ed9-4523-b319-77292e4eb0ba admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:59.035595 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbef9c-8ed9-4523-b319-77292e4eb0ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:59.037827 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbef9c-8ed9-4523-b319-77292e4eb0ba admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:59.100872 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:59.114653 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 885/1785] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:51:58 2022] POST /identity/v3/projects => generated 377 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:59.115577 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbef9c-8ed9-4523-b319-77292e4eb0ba admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:59.141171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:59.166001 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623e99d-de5f-423b-bcb5-c0874ef2a7c2 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:59.237248 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbef9c-8ed9-4523-b319-77292e4eb0ba admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:59.244346 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83681199-4ea1-41da-a1ab-fe06d165a202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:59.245626 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83681199-4ea1-41da-a1ab-fe06d165a202 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:59.246182 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83681199-4ea1-41da-a1ab-fe06d165a202 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:59.246622 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83681199-4ea1-41da-a1ab-fe06d165a202 admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:59.247513 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83681199-4ea1-41da-a1ab-fe06d165a202 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:59.250571 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83681199-4ea1-41da-a1ab-fe06d165a202 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:59.288471 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3afea0-ddc1-4cd3-80ae-0422e40d6042 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:59.289124 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3afea0-ddc1-4cd3-80ae-0422e40d6042 service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:59.289639 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3afea0-ddc1-4cd3-80ae-0422e40d6042 service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:59.290132 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3afea0-ddc1-4cd3-80ae-0422e40d6042 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:59.298237 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-7d3afea0-ddc1-4cd3-80ae-0422e40d6042 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:59.302914 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 886/1786] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:51:59 2022] POST /identity/v3/users => generated 295 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:51:59.302914 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83681199-4ea1-41da-a1ab-fe06d165a202 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:59.306989 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-83681199-4ea1-41da-a1ab-fe06d165a202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:59.335414 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83681199-4ea1-41da-a1ab-fe06d165a202 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:59.350702 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb129840-a4e6-47c9-a121-2125ed68afad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:59.351356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb129840-a4e6-47c9-a121-2125ed68afad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:59.351672 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb129840-a4e6-47c9-a121-2125ed68afad admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:59.351950 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb129840-a4e6-47c9-a121-2125ed68afad admin admin] PATH_INFO: `/v3/projects/b29a0c2e7a064f8aa33d4d6487b69292` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:59.354156 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb129840-a4e6-47c9-a121-2125ed68afad admin admin] RBAC: Authorizing `identity:delete_project(project_id=b29a0c2e7a064f8aa33d4d6487b69292)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:59.356044 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb129840-a4e6-47c9-a121-2125ed68afad admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:59.440112 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3afea0-ddc1-4cd3-80ae-0422e40d6042 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:59.449321 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3afea0-ddc1-4cd3-80ae-0422e40d6042 service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:59.465553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 901/1787] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:51:59 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:51:59.466471 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3afea0-ddc1-4cd3-80ae-0422e40d6042 service cinder] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:59.490311 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-cb129840-a4e6-47c9-a121-2125ed68afad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b29a0c2e7a064f8aa33d4d6487b69292', 'request_id': 'req-cb129840-a4e6-47c9-a121-2125ed68afad'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:59.490839 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3afea0-ddc1-4cd3-80ae-0422e40d6042 service cinder] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:59.509027 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-cb129840-a4e6-47c9-a121-2125ed68afad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b29a0c2e7a064f8aa33d4d6487b69292', 'request_id': 'req-cb129840-a4e6-47c9-a121-2125ed68afad'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:59.536792 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-cb129840-a4e6-47c9-a121-2125ed68afad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b29a0c2e7a064f8aa33d4d6487b69292', 'request_id': 'req-cb129840-a4e6-47c9-a121-2125ed68afad'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:59.568280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-cb129840-a4e6-47c9-a121-2125ed68afad admin admin] The token cache is being invalidate because project b29a0c2e7a064f8aa33d4d6487b69292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:51:59.571682 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-cb129840-a4e6-47c9-a121-2125ed68afad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:59.574975 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-cb129840-a4e6-47c9-a121-2125ed68afad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:51:59.578544 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 887/1788] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:51:59 2022] DELETE /identity/v3/projects/b29a0c2e7a064f8aa33d4d6487b69292 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:59.587874 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81fa36e-e3ac-47c7-82ed-f7ed1a84b312 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:59.588170 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81fa36e-e3ac-47c7-82ed-f7ed1a84b312 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:59.588453 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81fa36e-e3ac-47c7-82ed-f7ed1a84b312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:59.613201 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc9175-4e6e-4589-8662-dde7a5ed92c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:59.614100 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc9175-4e6e-4589-8662-dde7a5ed92c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:59.614560 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc9175-4e6e-4589-8662-dde7a5ed92c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:59.615009 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc9175-4e6e-4589-8662-dde7a5ed92c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:59.615957 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc9175-4e6e-4589-8662-dde7a5ed92c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:59.618958 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc9175-4e6e-4589-8662-dde7a5ed92c8 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:59.631760 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 902/1789] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:51:59.636014 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc9175-4e6e-4589-8662-dde7a5ed92c8 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:59.639408 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-14dc9175-4e6e-4589-8662-dde7a5ed92c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:59.639621 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-c81fa36e-e3ac-47c7-82ed-f7ed1a84b312 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:59.643261 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-c81fa36e-e3ac-47c7-82ed-f7ed1a84b312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:59.659621 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 888/1790] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:59.661607 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e07d3-707a-432c-9e77-104ffc036cde None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:59.662022 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e07d3-707a-432c-9e77-104ffc036cde None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:59.662408 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e07d3-707a-432c-9e77-104ffc036cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:59.678402 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc9175-4e6e-4589-8662-dde7a5ed92c8 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:59.691189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298de594-dde4-44f1-972a-57d68c0c317d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:59.693185 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298de594-dde4-44f1-972a-57d68c0c317d admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:59.693692 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298de594-dde4-44f1-972a-57d68c0c317d admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:59.696395 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298de594-dde4-44f1-972a-57d68c0c317d admin admin] PATH_INFO: `/v3/projects/468d17d2133b4878a19bf69e11cc8e16/users/6cc6bb3918724dfc87ccebab9ac62a58/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:59.696601 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-4c4e07d3-707a-432c-9e77-104ffc036cde None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:51:59.698528 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-4c4e07d3-707a-432c-9e77-104ffc036cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:51:59.713546 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 889/1791] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:51:59.718856 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e07d3-707a-432c-9e77-104ffc036cde None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:59.725308 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298de594-dde4-44f1-972a-57d68c0c317d admin admin] RBAC: Authorizing `identity:create_grant(project_id=468d17d2133b4878a19bf69e11cc8e16, user_id=6cc6bb3918724dfc87ccebab9ac62a58, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:59.730189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298de594-dde4-44f1-972a-57d68c0c317d admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:59.741859 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e07d3-707a-432c-9e77-104ffc036cde None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:59.754250 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076665e-6d77-4bd3-9ebb-7d95450cb484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:59.755931 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076665e-6d77-4bd3-9ebb-7d95450cb484 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:59.756743 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076665e-6d77-4bd3-9ebb-7d95450cb484 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:59.756743 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076665e-6d77-4bd3-9ebb-7d95450cb484 admin admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:59.759288 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076665e-6d77-4bd3-9ebb-7d95450cb484 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:51:59.759906 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076665e-6d77-4bd3-9ebb-7d95450cb484 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:59.766980 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076665e-6d77-4bd3-9ebb-7d95450cb484 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:51:59.799957 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 890/1792] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:51:59.801380 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076665e-6d77-4bd3-9ebb-7d95450cb484 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:59.810442 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 903/1793] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:51:59 2022] PUT /identity/v3/projects/468d17d2133b4878a19bf69e11cc8e16/users/6cc6bb3918724dfc87ccebab9ac62a58/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:51:59.814269 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298de594-dde4-44f1-972a-57d68c0c317d admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:51:59.828700 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076665e-6d77-4bd3-9ebb-7d95450cb484 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:51:59.840046 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:59.950359 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:51:59.986888 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f3b0a-f17c-40bd-a410-073a294c89cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:51:59.987542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f3b0a-f17c-40bd-a410-073a294c89cf admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:51:59.991773 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f3b0a-f17c-40bd-a410-073a294c89cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:51:59.992246 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f3b0a-f17c-40bd-a410-073a294c89cf admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:51:59.992978 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f3b0a-f17c-40bd-a410-073a294c89cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:51:59.996967 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f3b0a-f17c-40bd-a410-073a294c89cf admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:00.033720 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298de594-dde4-44f1-972a-57d68c0c317d admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:00.036901 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 891/1794] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:51:59 2022] POST /identity/v3/projects => generated 361 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:52:00.042895 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f3b0a-f17c-40bd-a410-073a294c89cf admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:00.251692 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f3b0a-f17c-40bd-a410-073a294c89cf admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:00.284775 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc0f9f-9c24-466f-a283-5d6c7ba6d727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:00.285436 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc0f9f-9c24-466f-a283-5d6c7ba6d727 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:00.285768 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc0f9f-9c24-466f-a283-5d6c7ba6d727 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:00.286074 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc0f9f-9c24-466f-a283-5d6c7ba6d727 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:00.286818 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc0f9f-9c24-466f-a283-5d6c7ba6d727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:00.288403 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc0f9f-9c24-466f-a283-5d6c7ba6d727 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:00.288983 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427b7e2-fbbd-41fa-b454-82c6084a0dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:00.294640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427b7e2-fbbd-41fa-b454-82c6084a0dea admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:00.294933 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427b7e2-fbbd-41fa-b454-82c6084a0dea admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:00.295321 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427b7e2-fbbd-41fa-b454-82c6084a0dea admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:00.296600 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427b7e2-fbbd-41fa-b454-82c6084a0dea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:00.309216 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427b7e2-fbbd-41fa-b454-82c6084a0dea admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:00.348108 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 904/1795] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 534 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:52:00.348487 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc0f9f-9c24-466f-a283-5d6c7ba6d727 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:00.381259 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc0f9f-9c24-466f-a283-5d6c7ba6d727 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:00.391780 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 892/1796] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:52:00 2022] POST /identity/v3/users => generated 281 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:52:00.392866 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427b7e2-fbbd-41fa-b454-82c6084a0dea admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:00.409855 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46e612-0e63-4812-8f75-51286e39236c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:00.410414 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46e612-0e63-4812-8f75-51286e39236c admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:00.410700 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46e612-0e63-4812-8f75-51286e39236c admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:00.410982 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46e612-0e63-4812-8f75-51286e39236c admin admin] PATH_INFO: `/v3/projects/468d17d2133b4878a19bf69e11cc8e16/users/6cc6bb3918724dfc87ccebab9ac62a58/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:00.435695 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427b7e2-fbbd-41fa-b454-82c6084a0dea admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:00.439462 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46e612-0e63-4812-8f75-51286e39236c admin admin] RBAC: Authorizing `identity:create_grant(project_id=468d17d2133b4878a19bf69e11cc8e16, user_id=6cc6bb3918724dfc87ccebab9ac62a58, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:00.441424 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46e612-0e63-4812-8f75-51286e39236c admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:00.451912 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87e95b-9cd7-42b9-b67f-e025da81bcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:00.452571 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87e95b-9cd7-42b9-b67f-e025da81bcb8 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:00.452838 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87e95b-9cd7-42b9-b67f-e025da81bcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:00.453254 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87e95b-9cd7-42b9-b67f-e025da81bcb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:00.454008 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87e95b-9cd7-42b9-b67f-e025da81bcb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:00.459886 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87e95b-9cd7-42b9-b67f-e025da81bcb8 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:00.487023 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 905/1797] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:52:00 2022] PUT /identity/v3/projects/468d17d2133b4878a19bf69e11cc8e16/users/6cc6bb3918724dfc87ccebab9ac62a58/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:00.491768 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 893/1798] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:52:00.498350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46e612-0e63-4812-8f75-51286e39236c admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:00.501536 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933731a-10a7-49cb-b4e8-4258bd54ae33 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:00.502092 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933731a-10a7-49cb-b4e8-4258bd54ae33 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:00.502381 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933731a-10a7-49cb-b4e8-4258bd54ae33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:00.595826 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-9933731a-10a7-49cb-b4e8-4258bd54ae33 None None] MFA Rules not processed for user `6cc6bb3918724dfc87ccebab9ac62a58`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:00.603131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-9933731a-10a7-49cb-b4e8-4258bd54ae33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:00.675461 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46e612-0e63-4812-8f75-51286e39236c admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:00.685024 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eabf94f-9548-4bd7-875d-c2bb55359687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:00.686603 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eabf94f-9548-4bd7-875d-c2bb55359687 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:00.687103 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eabf94f-9548-4bd7-875d-c2bb55359687 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:00.687570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eabf94f-9548-4bd7-875d-c2bb55359687 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:00.688847 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eabf94f-9548-4bd7-875d-c2bb55359687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:00.691025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eabf94f-9548-4bd7-875d-c2bb55359687 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:00.704062 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 906/1799] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:52:00.707914 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eabf94f-9548-4bd7-875d-c2bb55359687 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:00.732186 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eabf94f-9548-4bd7-875d-c2bb55359687 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:00.751268 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabdf255-e268-4f09-b4f6-de94d69b617a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:00.752140 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabdf255-e268-4f09-b4f6-de94d69b617a admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:00.752526 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabdf255-e268-4f09-b4f6-de94d69b617a admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:00.753188 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabdf255-e268-4f09-b4f6-de94d69b617a admin admin] PATH_INFO: `/v3/projects/d3f2cec87ebc44e594129fbfce67fe72/users/64fea0d3a8844f8bbc7ccf6ca748a99a/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:00.791380 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabdf255-e268-4f09-b4f6-de94d69b617a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3f2cec87ebc44e594129fbfce67fe72, user_id=64fea0d3a8844f8bbc7ccf6ca748a99a, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:00.794288 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabdf255-e268-4f09-b4f6-de94d69b617a admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:00.803667 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 894/1800] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:00.825690 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933731a-10a7-49cb-b4e8-4258bd54ae33 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:00.828321 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-9933731a-10a7-49cb-b4e8-4258bd54ae33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:00.835672 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 907/1801] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:52:00 2022] PUT /identity/v3/projects/d3f2cec87ebc44e594129fbfce67fe72/users/64fea0d3a8844f8bbc7ccf6ca748a99a/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:00.843199 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63f01f-7f1d-4e36-87cc-16a5afc40d4b None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:00.846635 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63f01f-7f1d-4e36-87cc-16a5afc40d4b None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:00.846940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63f01f-7f1d-4e36-87cc-16a5afc40d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:00.901931 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:00.946282 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:00.963142 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-3a63f01f-7f1d-4e36-87cc-16a5afc40d4b None None] MFA Rules not processed for user `64fea0d3a8844f8bbc7ccf6ca748a99a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:00.968545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-3a63f01f-7f1d-4e36-87cc-16a5afc40d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:00.999007 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933731a-10a7-49cb-b4e8-4258bd54ae33 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:01.112119 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f79fa9-541c-4916-ab8e-56bdf971b146 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:01.112924 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f79fa9-541c-4916-ab8e-56bdf971b146 service cinder] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:01.113289 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f79fa9-541c-4916-ab8e-56bdf971b146 service cinder] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:01.113645 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f79fa9-541c-4916-ab8e-56bdf971b146 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:01.115503 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-c0f79fa9-541c-4916-ab8e-56bdf971b146 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:01.118179 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 908/1802] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:01.157537 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6620f-72b1-4d8e-83a7-ec4c1ddb44cf None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:01.157936 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6620f-72b1-4d8e-83a7-ec4c1ddb44cf None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:01.159053 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6620f-72b1-4d8e-83a7-ec4c1ddb44cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:01.191765 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-f9a6620f-72b1-4d8e-83a7-ec4c1ddb44cf None None] MFA Rules not processed for user `e3eba8e63be14907a364797a0189290c`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:01.193148 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-f9a6620f-72b1-4d8e-83a7-ec4c1ddb44cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:01.315918 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f79fa9-541c-4916-ab8e-56bdf971b146 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:01.319588 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f79fa9-541c-4916-ab8e-56bdf971b146 service cinder] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:01.362693 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 895/1803] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:52:01.364259 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec44041-1de5-419d-b6b7-fa8099b67539 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:01.377974 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec44041-1de5-419d-b6b7-fa8099b67539 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:01.377974 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec44041-1de5-419d-b6b7-fa8099b67539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:01.440949 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 909/1804] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:01.444558 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6620f-72b1-4d8e-83a7-ec4c1ddb44cf None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:01.450171 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-f9a6620f-72b1-4d8e-83a7-ec4c1ddb44cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:01.509688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6620f-72b1-4d8e-83a7-ec4c1ddb44cf None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:01.516396 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936a49d-d680-4035-9819-7fc2efb3722e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:01.520439 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936a49d-d680-4035-9819-7fc2efb3722e service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:01.522387 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936a49d-d680-4035-9819-7fc2efb3722e service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:01.522583 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936a49d-d680-4035-9819-7fc2efb3722e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:01.548958 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a936a49d-d680-4035-9819-7fc2efb3722e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:01.551432 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a936a49d-d680-4035-9819-7fc2efb3722e service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:01.637265 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 910/1805] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:01.638332 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936a49d-d680-4035-9819-7fc2efb3722e service cinder] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:01.672452 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-eec44041-1de5-419d-b6b7-fa8099b67539 None None] MFA Rules not processed for user `a994c976b95744ed9723bf9c4386bde1`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:01.673740 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-eec44041-1de5-419d-b6b7-fa8099b67539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:01.912118 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936a49d-d680-4035-9819-7fc2efb3722e service cinder] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:01.964127 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803688e6-075a-4a26-8c8b-f4dd892d2f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:01.966922 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803688e6-075a-4a26-8c8b-f4dd892d2f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:01.968061 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803688e6-075a-4a26-8c8b-f4dd892d2f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:01.968354 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803688e6-075a-4a26-8c8b-f4dd892d2f03 admin admin] PATH_INFO: `/v3/users/64fea0d3a8844f8bbc7ccf6ca748a99a` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:01.977373 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803688e6-075a-4a26-8c8b-f4dd892d2f03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64fea0d3a8844f8bbc7ccf6ca748a99a)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:01.983855 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803688e6-075a-4a26-8c8b-f4dd892d2f03 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:02.049214 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 896/1806] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Aug 3 12:52:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 686 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:02.054892 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268370ca-c070-47ff-b554-26cdb1a07226 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:02.055621 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268370ca-c070-47ff-b554-26cdb1a07226 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:02.055621 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268370ca-c070-47ff-b554-26cdb1a07226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:02.110487 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-268370ca-c070-47ff-b554-26cdb1a07226 None None] MFA Rules not processed for user `7a109db9f7754b5a8f5b53fa7030691c`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:02.111724 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-268370ca-c070-47ff-b554-26cdb1a07226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:02.113332 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:02.151767 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-803688e6-075a-4a26-8c8b-f4dd892d2f03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64fea0d3a8844f8bbc7ccf6ca748a99a'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:02.154180 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-803688e6-075a-4a26-8c8b-f4dd892d2f03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64fea0d3a8844f8bbc7ccf6ca748a99a'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:02.156884 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-803688e6-075a-4a26-8c8b-f4dd892d2f03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64fea0d3a8844f8bbc7ccf6ca748a99a'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:02.180501 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:02.220767 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-803688e6-075a-4a26-8c8b-f4dd892d2f03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64fea0d3a8844f8bbc7ccf6ca748a99a'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:02.258591 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-803688e6-075a-4a26-8c8b-f4dd892d2f03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64fea0d3a8844f8bbc7ccf6ca748a99a'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:02.318950 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 911/1807] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:52:01 2022] DELETE /identity/v3/users/64fea0d3a8844f8bbc7ccf6ca748a99a => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:02.343036 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc2f0a-e279-45a4-94a2-94bc6985f5ff None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:02.348210 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 897/1808] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:02 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:02.349002 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc2f0a-e279-45a4-94a2-94bc6985f5ff None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:02.349468 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc2f0a-e279-45a4-94a2-94bc6985f5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:02.439994 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-cbcc2f0a-e279-45a4-94a2-94bc6985f5ff None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:02.455193 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268370ca-c070-47ff-b554-26cdb1a07226 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:02.456893 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-268370ca-c070-47ff-b554-26cdb1a07226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:02.469778 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-cbcc2f0a-e279-45a4-94a2-94bc6985f5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:02.633462 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 912/1809] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:02.662900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc2f0a-e279-45a4-94a2-94bc6985f5ff None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:02.666322 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-cbcc2f0a-e279-45a4-94a2-94bc6985f5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:02.798676 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268370ca-c070-47ff-b554-26cdb1a07226 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:02.826280 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc2f0a-e279-45a4-94a2-94bc6985f5ff None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:02.830504 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95896a79-b7ae-4b95-92df-fea22ecf3555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:02.831154 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95896a79-b7ae-4b95-92df-fea22ecf3555 service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:02.831439 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95896a79-b7ae-4b95-92df-fea22ecf3555 service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:02.831719 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95896a79-b7ae-4b95-92df-fea22ecf3555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:02.844149 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95896a79-b7ae-4b95-92df-fea22ecf3555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:02.846257 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95896a79-b7ae-4b95-92df-fea22ecf3555 service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:02.859237 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 913/1810] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:52:02.986468 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e1bf6-0086-46a2-b904-deda5e5668e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67df369737ea4c83bae134f4bf2de20d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:02.987523 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e1bf6-0086-46a2-b904-deda5e5668e7 service swift] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:02.988025 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e1bf6-0086-46a2-b904-deda5e5668e7 service swift] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:02.989786 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e1bf6-0086-46a2-b904-deda5e5668e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:02.990999 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-da9e1bf6-0086-46a2-b904-deda5e5668e7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:03.112127 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:03.121814 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e1bf6-0086-46a2-b904-deda5e5668e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:03.123530 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e1bf6-0086-46a2-b904-deda5e5668e7 service swift] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:03.146551 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 898/1811] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Aug 3 12:52:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 692 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 12:52:03.644870 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95896a79-b7ae-4b95-92df-fea22ecf3555 service neutron] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:03.647395 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-95896a79-b7ae-4b95-92df-fea22ecf3555 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:03.810221 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95896a79-b7ae-4b95-92df-fea22ecf3555 service neutron] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:03.814095 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5d106-a818-42d8-9321-8ba4ae43943d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:03.814741 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5d106-a818-42d8-9321-8ba4ae43943d service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:03.815025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5d106-a818-42d8-9321-8ba4ae43943d service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:03.815304 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5d106-a818-42d8-9321-8ba4ae43943d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:03.818054 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-0bf5d106-a818-42d8-9321-8ba4ae43943d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:03.836289 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:03.926960 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5d106-a818-42d8-9321-8ba4ae43943d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:03.928707 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5d106-a818-42d8-9321-8ba4ae43943d service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:03.957900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 914/1812] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:05.370554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f921a5-d761-402e-8102-70e2f879cf59 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:05.371101 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f921a5-d761-402e-8102-70e2f879cf59 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:05.371101 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f921a5-d761-402e-8102-70e2f879cf59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:05.391351 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5d106-a818-42d8-9321-8ba4ae43943d service cinder] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:05.393195 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-0bf5d106-a818-42d8-9321-8ba4ae43943d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:05.434137 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-22f921a5-d761-402e-8102-70e2f879cf59 None None] MFA Rules not processed for user `e0cd747cb5f64ff7b5f8d67d3d640fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:05.435624 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-22f921a5-d761-402e-8102-70e2f879cf59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:05.436675 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5d106-a818-42d8-9321-8ba4ae43943d service cinder] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:05.455899 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad425fe-b24d-408c-8255-4099da396c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:05.461004 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad425fe-b24d-408c-8255-4099da396c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:05.461525 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad425fe-b24d-408c-8255-4099da396c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:05.462095 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad425fe-b24d-408c-8255-4099da396c77 admin admin] PATH_INFO: `/v3/projects/d3f2cec87ebc44e594129fbfce67fe72` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:05.468206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad425fe-b24d-408c-8255-4099da396c77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3f2cec87ebc44e594129fbfce67fe72)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:05.470022 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 899/1813] 10.222.0.48 () {58 vars in 1015 bytes} [Wed Aug 3 12:52:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:05.476432 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad425fe-b24d-408c-8255-4099da396c77 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:05.600296 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f921a5-d761-402e-8102-70e2f879cf59 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:05.603193 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-22f921a5-d761-402e-8102-70e2f879cf59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:05.642698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f921a5-d761-402e-8102-70e2f879cf59 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:05.697371 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78bde34-12f0-4787-86e7-825fc1767bed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:05.705977 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bde34-12f0-4787-86e7-825fc1767bed service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:05.706278 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bde34-12f0-4787-86e7-825fc1767bed service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:05.706562 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bde34-12f0-4787-86e7-825fc1767bed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:05.778435 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78bde34-12f0-4787-86e7-825fc1767bed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:05.781839 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78bde34-12f0-4787-86e7-825fc1767bed service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:05.792478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-5ad425fe-b24d-408c-8255-4099da396c77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3f2cec87ebc44e594129fbfce67fe72', 'request_id': 'req-5ad425fe-b24d-408c-8255-4099da396c77'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:05.814773 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-5ad425fe-b24d-408c-8255-4099da396c77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3f2cec87ebc44e594129fbfce67fe72', 'request_id': 'req-5ad425fe-b24d-408c-8255-4099da396c77'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:05.839085 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-5ad425fe-b24d-408c-8255-4099da396c77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3f2cec87ebc44e594129fbfce67fe72', 'request_id': 'req-5ad425fe-b24d-408c-8255-4099da396c77'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:05.857184 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 900/1814] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:52:05.887156 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-5ad425fe-b24d-408c-8255-4099da396c77 admin admin] The token cache is being invalidate because project d3f2cec87ebc44e594129fbfce67fe72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:52:05.887455 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-5ad425fe-b24d-408c-8255-4099da396c77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:05.893956 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-5ad425fe-b24d-408c-8255-4099da396c77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:05.896184 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 915/1815] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:52:05 2022] DELETE /identity/v3/projects/d3f2cec87ebc44e594129fbfce67fe72 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:05.901729 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35e7b9-503d-4e56-a1b2-f03461322afd None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:05.902236 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35e7b9-503d-4e56-a1b2-f03461322afd None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:05.902624 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35e7b9-503d-4e56-a1b2-f03461322afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:05.962366 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad425fe-b24d-408c-8255-4099da396c77 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:05.969918 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-9a35e7b9-503d-4e56-a1b2-f03461322afd None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:05.974642 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-5ad425fe-b24d-408c-8255-4099da396c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:05.975102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-9a35e7b9-503d-4e56-a1b2-f03461322afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:06.197248 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 901/1816] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:06.210277 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028921aa-3a63-4c2a-b217-e9f1e9c0c78d None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:06.210603 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028921aa-3a63-4c2a-b217-e9f1e9c0c78d None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:06.212604 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028921aa-3a63-4c2a-b217-e9f1e9c0c78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:06.280287 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad425fe-b24d-408c-8255-4099da396c77 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:06.301245 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-028921aa-3a63-4c2a-b217-e9f1e9c0c78d None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:06.315257 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a72932-76a1-4e72-bf2e-7c97c0be8a51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:06.316011 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a72932-76a1-4e72-bf2e-7c97c0be8a51 service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:06.316301 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a72932-76a1-4e72-bf2e-7c97c0be8a51 service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:06.316580 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a72932-76a1-4e72-bf2e-7c97c0be8a51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:06.316728 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-028921aa-3a63-4c2a-b217-e9f1e9c0c78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:06.336859 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-d4a72932-76a1-4e72-bf2e-7c97c0be8a51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:06.384020 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 902/1817] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:06.387697 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028921aa-3a63-4c2a-b217-e9f1e9c0c78d None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:06.446235 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028921aa-3a63-4c2a-b217-e9f1e9c0c78d None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:06.470311 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937c803-82d9-4828-b5d0-eea8678eecd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:06.470957 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937c803-82d9-4828-b5d0-eea8678eecd4 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:06.471238 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937c803-82d9-4828-b5d0-eea8678eecd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:06.471512 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937c803-82d9-4828-b5d0-eea8678eecd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:06.480932 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937c803-82d9-4828-b5d0-eea8678eecd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:06.481253 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937c803-82d9-4828-b5d0-eea8678eecd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:06.489754 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937c803-82d9-4828-b5d0-eea8678eecd4 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:06.541449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 903/1818] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:06.543807 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937c803-82d9-4828-b5d0-eea8678eecd4 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:06.584797 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:06.588965 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937c803-82d9-4828-b5d0-eea8678eecd4 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:06.607714 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a493a47-ae8b-4f3d-887b-3e58d7b778bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:06.611982 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a493a47-ae8b-4f3d-887b-3e58d7b778bc admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:06.613410 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a493a47-ae8b-4f3d-887b-3e58d7b778bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:06.613875 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a493a47-ae8b-4f3d-887b-3e58d7b778bc admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:06.617361 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a493a47-ae8b-4f3d-887b-3e58d7b778bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:06.622697 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a72932-76a1-4e72-bf2e-7c97c0be8a51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:06.625932 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a72932-76a1-4e72-bf2e-7c97c0be8a51 service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:06.626981 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a493a47-ae8b-4f3d-887b-3e58d7b778bc admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:06.686526 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 916/1819] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 724 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:06.725328 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 904/1820] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:52:06 2022] POST /identity/v3/projects => generated 371 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:52:06.730677 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a72932-76a1-4e72-bf2e-7c97c0be8a51 service cinder] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:06.778704 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a72932-76a1-4e72-bf2e-7c97c0be8a51 service cinder] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:07.113817 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d6afa-384a-4c56-916b-4e20f09902c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:07.113817 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d6afa-384a-4c56-916b-4e20f09902c7 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:07.113817 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d6afa-384a-4c56-916b-4e20f09902c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:07.113817 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d6afa-384a-4c56-916b-4e20f09902c7 admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:07.114633 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d6afa-384a-4c56-916b-4e20f09902c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:07.114633 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d6afa-384a-4c56-916b-4e20f09902c7 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:07.168555 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 917/1821] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:52:06 2022] POST /identity/v3/users => generated 286 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:52:07.178628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a493a47-ae8b-4f3d-887b-3e58d7b778bc admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:07.203386 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a493a47-ae8b-4f3d-887b-3e58d7b778bc admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:07.215492 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd181d4-e423-41ae-8d2e-c63bcda2777b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:07.217656 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd181d4-e423-41ae-8d2e-c63bcda2777b admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:07.217932 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd181d4-e423-41ae-8d2e-c63bcda2777b admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:07.219654 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd181d4-e423-41ae-8d2e-c63bcda2777b admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:07.224475 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd181d4-e423-41ae-8d2e-c63bcda2777b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:07.230252 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd181d4-e423-41ae-8d2e-c63bcda2777b admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:07.285989 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 905/1822] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:52:07.286746 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d6afa-384a-4c56-916b-4e20f09902c7 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:07.309207 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d6afa-384a-4c56-916b-4e20f09902c7 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:07.331965 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afda855-20ca-4f84-a8e7-9acb24ec7e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:07.332602 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afda855-20ca-4f84-a8e7-9acb24ec7e32 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:07.332881 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afda855-20ca-4f84-a8e7-9acb24ec7e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:07.336384 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afda855-20ca-4f84-a8e7-9acb24ec7e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:07.339294 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afda855-20ca-4f84-a8e7-9acb24ec7e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:07.341820 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afda855-20ca-4f84-a8e7-9acb24ec7e32 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:07.400240 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd181d4-e423-41ae-8d2e-c63bcda2777b admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:07.410339 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 918/1823] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:52:07.423717 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd181d4-e423-41ae-8d2e-c63bcda2777b admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:07.449059 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c6236-5030-46bc-aeea-78dff2ebddf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:07.449798 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c6236-5030-46bc-aeea-78dff2ebddf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:07.450087 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c6236-5030-46bc-aeea-78dff2ebddf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:07.450677 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c6236-5030-46bc-aeea-78dff2ebddf0 admin admin] PATH_INFO: `/v3/projects/0ff2495b6df94c0d9d4fe331e780b197/users/e10d580c2d244cd5addb0a88de7689c8/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:07.489119 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c6236-5030-46bc-aeea-78dff2ebddf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ff2495b6df94c0d9d4fe331e780b197, user_id=e10d580c2d244cd5addb0a88de7689c8, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:07.495093 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c6236-5030-46bc-aeea-78dff2ebddf0 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:07.537710 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 906/1824] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:52:07 2022] PUT /identity/v3/projects/0ff2495b6df94c0d9d4fe331e780b197/users/e10d580c2d244cd5addb0a88de7689c8/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:07.551181 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca4797-881b-42bf-9d47-ae3a36ff483f None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:07.551613 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca4797-881b-42bf-9d47-ae3a36ff483f None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:07.552159 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca4797-881b-42bf-9d47-ae3a36ff483f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:07.619076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-03ca4797-881b-42bf-9d47-ae3a36ff483f None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:07.621557 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-03ca4797-881b-42bf-9d47-ae3a36ff483f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:07.819296 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 919/1825] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:07.915855 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c6236-5030-46bc-aeea-78dff2ebddf0 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:07.917837 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-770c6236-5030-46bc-aeea-78dff2ebddf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:08.040545 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c6236-5030-46bc-aeea-78dff2ebddf0 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:08.049363 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4090d-09ec-44dd-a57e-3e7f7447e01c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:08.050100 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4090d-09ec-44dd-a57e-3e7f7447e01c service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:08.050384 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4090d-09ec-44dd-a57e-3e7f7447e01c service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:08.050662 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4090d-09ec-44dd-a57e-3e7f7447e01c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:08.100205 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4090d-09ec-44dd-a57e-3e7f7447e01c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:08.104368 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4090d-09ec-44dd-a57e-3e7f7447e01c service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:08.114557 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:08.124193 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 907/1826] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:09.791400 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca4797-881b-42bf-9d47-ae3a36ff483f None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:09.793180 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-03ca4797-881b-42bf-9d47-ae3a36ff483f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:09.808911 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca4797-881b-42bf-9d47-ae3a36ff483f None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:09.815504 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f0b5e-49af-4307-9fdf-4d7732bac4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:09.816681 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f0b5e-49af-4307-9fdf-4d7732bac4d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:09.817188 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f0b5e-49af-4307-9fdf-4d7732bac4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:09.817729 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f0b5e-49af-4307-9fdf-4d7732bac4d2 admin admin] PATH_INFO: `/v3/users/88b1d3616ba34955b061d0ed4f3ea498` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:09.819273 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f0b5e-49af-4307-9fdf-4d7732bac4d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88b1d3616ba34955b061d0ed4f3ea498)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:09.822748 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f0b5e-49af-4307-9fdf-4d7732bac4d2 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:10.024531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-aa0f0b5e-49af-4307-9fdf-4d7732bac4d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88b1d3616ba34955b061d0ed4f3ea498'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:10.026421 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-aa0f0b5e-49af-4307-9fdf-4d7732bac4d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88b1d3616ba34955b061d0ed4f3ea498'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:10.028488 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-aa0f0b5e-49af-4307-9fdf-4d7732bac4d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88b1d3616ba34955b061d0ed4f3ea498'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:10.054163 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:10.082835 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-aa0f0b5e-49af-4307-9fdf-4d7732bac4d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88b1d3616ba34955b061d0ed4f3ea498'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:10.100963 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-aa0f0b5e-49af-4307-9fdf-4d7732bac4d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88b1d3616ba34955b061d0ed4f3ea498'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:10.131597 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 920/1827] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:52:09 2022] DELETE /identity/v3/users/88b1d3616ba34955b061d0ed4f3ea498 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:10.137036 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508827bd-4062-4d48-9c0e-8aa3fd9e95de None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:10.137616 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508827bd-4062-4d48-9c0e-8aa3fd9e95de None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:10.137743 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508827bd-4062-4d48-9c0e-8aa3fd9e95de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:10.176444 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-508827bd-4062-4d48-9c0e-8aa3fd9e95de None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:10.177987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-508827bd-4062-4d48-9c0e-8aa3fd9e95de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:10.301018 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 908/1828] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:52:10.443737 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f0b5e-49af-4307-9fdf-4d7732bac4d2 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:10.443737 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-aa0f0b5e-49af-4307-9fdf-4d7732bac4d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:10.501272 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508827bd-4062-4d48-9c0e-8aa3fd9e95de None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:10.505429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-508827bd-4062-4d48-9c0e-8aa3fd9e95de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:10.529577 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508827bd-4062-4d48-9c0e-8aa3fd9e95de None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:10.537003 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5320b78-d689-4e13-966c-f802e247cf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:10.538499 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5320b78-d689-4e13-966c-f802e247cf62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:10.538965 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5320b78-d689-4e13-966c-f802e247cf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:10.539413 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5320b78-d689-4e13-966c-f802e247cf62 admin admin] PATH_INFO: `/v3/users/a295b8bcc2e947bc94fc6f721edfd7ab` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:10.541058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5320b78-d689-4e13-966c-f802e247cf62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a295b8bcc2e947bc94fc6f721edfd7ab)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:10.557837 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5320b78-d689-4e13-966c-f802e247cf62 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:10.599204 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f0b5e-49af-4307-9fdf-4d7732bac4d2 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:10.605414 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb3129-5ee0-4c80-baf3-21c32a4a85f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:10.608252 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb3129-5ee0-4c80-baf3-21c32a4a85f3 service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:10.608859 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb3129-5ee0-4c80-baf3-21c32a4a85f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:10.610488 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb3129-5ee0-4c80-baf3-21c32a4a85f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:10.637523 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb3129-5ee0-4c80-baf3-21c32a4a85f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:10.639912 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb3129-5ee0-4c80-baf3-21c32a4a85f3 service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:10.655677 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 921/1829] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:10.699543 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-c5320b78-d689-4e13-966c-f802e247cf62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a295b8bcc2e947bc94fc6f721edfd7ab'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:10.712828 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-c5320b78-d689-4e13-966c-f802e247cf62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a295b8bcc2e947bc94fc6f721edfd7ab'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:10.714069 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-c5320b78-d689-4e13-966c-f802e247cf62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a295b8bcc2e947bc94fc6f721edfd7ab'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:10.723923 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-c5320b78-d689-4e13-966c-f802e247cf62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a295b8bcc2e947bc94fc6f721edfd7ab'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:10.746910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-c5320b78-d689-4e13-966c-f802e247cf62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a295b8bcc2e947bc94fc6f721edfd7ab'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:10.772683 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 909/1830] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:52:10 2022] DELETE /identity/v3/users/a295b8bcc2e947bc94fc6f721edfd7ab => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:52:10.773220 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664b613-639b-4d5b-835a-7cd9f137305c None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:10.773599 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664b613-639b-4d5b-835a-7cd9f137305c None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:10.773884 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664b613-639b-4d5b-835a-7cd9f137305c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:10.848875 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b1b34-1ebf-4f8f-83e0-8d63f1499a99 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:10.849269 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b1b34-1ebf-4f8f-83e0-8d63f1499a99 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:10.849665 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b1b34-1ebf-4f8f-83e0-8d63f1499a99 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:10.851124 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 910/1831] 10.222.0.46 () {54 vars in 921 bytes} [Wed Aug 3 12:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 03 12:52:10.855021 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-1664b613-639b-4d5b-835a-7cd9f137305c None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:10.856441 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-1664b613-639b-4d5b-835a-7cd9f137305c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:10.903003 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53987d69-7799-4865-b2be-f27d213eb26c None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:10.903302 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53987d69-7799-4865-b2be-f27d213eb26c None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:10.903586 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53987d69-7799-4865-b2be-f27d213eb26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:10.940499 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-53987d69-7799-4865-b2be-f27d213eb26c None None] MFA Rules not processed for user `dcf670ff4f62486dbf70cf6ea0f08bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:10.941809 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-53987d69-7799-4865-b2be-f27d213eb26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:11.002526 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 922/1832] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:52:11.075172 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664b613-639b-4d5b-835a-7cd9f137305c None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:11.076803 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-1664b613-639b-4d5b-835a-7cd9f137305c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:11.091926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 911/1833] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Aug 3 12:52:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:11.224190 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664b613-639b-4d5b-835a-7cd9f137305c None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:11.233938 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfaf549-9491-46b0-8087-70213470befd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:11.234619 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfaf549-9491-46b0-8087-70213470befd service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:11.234918 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfaf549-9491-46b0-8087-70213470befd service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:11.235239 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfaf549-9491-46b0-8087-70213470befd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:11.254801 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfaf549-9491-46b0-8087-70213470befd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:11.256396 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfaf549-9491-46b0-8087-70213470befd service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:11.287744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 923/1834] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:52:11.496974 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53987d69-7799-4865-b2be-f27d213eb26c None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:11.498553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-53987d69-7799-4865-b2be-f27d213eb26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:11.517843 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:11.525687 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53987d69-7799-4865-b2be-f27d213eb26c None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:11.543523 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8243ca1-7511-4966-afa5-dc8683467144 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:11.544203 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8243ca1-7511-4966-afa5-dc8683467144 service nova] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:11.544484 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8243ca1-7511-4966-afa5-dc8683467144 service nova] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:11.544772 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8243ca1-7511-4966-afa5-dc8683467144 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:11.567808 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8243ca1-7511-4966-afa5-dc8683467144 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:11.569435 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8243ca1-7511-4966-afa5-dc8683467144 service nova] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:11.613910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 912/1835] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:12.477982 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfaf549-9491-46b0-8087-70213470befd service neutron] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:12.479662 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-4cfaf549-9491-46b0-8087-70213470befd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:12.558463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335ef66-e498-4c19-a39b-5b1660c462cf None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:12.559442 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335ef66-e498-4c19-a39b-5b1660c462cf None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:12.559998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335ef66-e498-4c19-a39b-5b1660c462cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:12.573365 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfaf549-9491-46b0-8087-70213470befd service neutron] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:12.591911 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b2200-d78d-442d-89ed-42be0f01d54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:12.592904 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b2200-d78d-442d-89ed-42be0f01d54c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:12.593366 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b2200-d78d-442d-89ed-42be0f01d54c admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:12.593869 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b2200-d78d-442d-89ed-42be0f01d54c admin admin] PATH_INFO: `/v3/projects/28045081acc94157aef07d67baf3cb0a` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:12.595575 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b2200-d78d-442d-89ed-42be0f01d54c admin admin] RBAC: Authorizing `identity:delete_project(project_id=28045081acc94157aef07d67baf3cb0a)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:12.602866 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b2200-d78d-442d-89ed-42be0f01d54c admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:12.645288 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-5335ef66-e498-4c19-a39b-5b1660c462cf None None] MFA Rules not processed for user `e10d580c2d244cd5addb0a88de7689c8`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:12.648016 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-5335ef66-e498-4c19-a39b-5b1660c462cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:12.659935 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:12.765364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-364b2200-d78d-442d-89ed-42be0f01d54c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28045081acc94157aef07d67baf3cb0a', 'request_id': 'req-364b2200-d78d-442d-89ed-42be0f01d54c'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:12.796839 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-364b2200-d78d-442d-89ed-42be0f01d54c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28045081acc94157aef07d67baf3cb0a', 'request_id': 'req-364b2200-d78d-442d-89ed-42be0f01d54c'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:12.828558 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-364b2200-d78d-442d-89ed-42be0f01d54c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28045081acc94157aef07d67baf3cb0a', 'request_id': 'req-364b2200-d78d-442d-89ed-42be0f01d54c'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:12.856201 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 913/1836] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:12.869560 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335ef66-e498-4c19-a39b-5b1660c462cf None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:12.871847 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-5335ef66-e498-4c19-a39b-5b1660c462cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:12.886213 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-364b2200-d78d-442d-89ed-42be0f01d54c admin admin] The token cache is being invalidate because project 28045081acc94157aef07d67baf3cb0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:52:12.886695 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-364b2200-d78d-442d-89ed-42be0f01d54c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:12.889037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-364b2200-d78d-442d-89ed-42be0f01d54c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:12.909451 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 924/1837] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:52:12 2022] DELETE /identity/v3/projects/28045081acc94157aef07d67baf3cb0a => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:12.912837 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b2200-d78d-442d-89ed-42be0f01d54c admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:12.919469 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-364b2200-d78d-442d-89ed-42be0f01d54c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:13.002165 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335ef66-e498-4c19-a39b-5b1660c462cf None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:13.072826 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b2200-d78d-442d-89ed-42be0f01d54c admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:13.092712 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be80a3-511b-486f-b3d5-fc401d20e2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:13.094335 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be80a3-511b-486f-b3d5-fc401d20e2e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:13.094922 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be80a3-511b-486f-b3d5-fc401d20e2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:13.095475 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be80a3-511b-486f-b3d5-fc401d20e2e5 admin admin] PATH_INFO: `/v3/users/6cc6bb3918724dfc87ccebab9ac62a58` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:13.098261 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be80a3-511b-486f-b3d5-fc401d20e2e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cc6bb3918724dfc87ccebab9ac62a58)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:13.100692 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be80a3-511b-486f-b3d5-fc401d20e2e5 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:13.102010 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac5155-7e4d-4b94-b80b-7e06fb7dbf1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:13.102829 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac5155-7e4d-4b94-b80b-7e06fb7dbf1a service cinder] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:13.103061 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac5155-7e4d-4b94-b80b-7e06fb7dbf1a service cinder] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:13.103344 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac5155-7e4d-4b94-b80b-7e06fb7dbf1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:13.121862 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-9fac5155-7e4d-4b94-b80b-7e06fb7dbf1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:13.238390 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-22be80a3-511b-486f-b3d5-fc401d20e2e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cc6bb3918724dfc87ccebab9ac62a58'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:13.239205 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-22be80a3-511b-486f-b3d5-fc401d20e2e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cc6bb3918724dfc87ccebab9ac62a58'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:13.239976 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-22be80a3-511b-486f-b3d5-fc401d20e2e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cc6bb3918724dfc87ccebab9ac62a58'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:13.258643 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:13.264624 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-22be80a3-511b-486f-b3d5-fc401d20e2e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cc6bb3918724dfc87ccebab9ac62a58'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:13.277845 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac5155-7e4d-4b94-b80b-7e06fb7dbf1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:13.280540 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac5155-7e4d-4b94-b80b-7e06fb7dbf1a service cinder] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:13.283673 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-22be80a3-511b-486f-b3d5-fc401d20e2e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cc6bb3918724dfc87ccebab9ac62a58'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:13.302559 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 925/1838] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:52:12 2022] DELETE /identity/v3/users/6cc6bb3918724dfc87ccebab9ac62a58 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:52:13.304004 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be80a3-511b-486f-b3d5-fc401d20e2e5 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:13.306518 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-22be80a3-511b-486f-b3d5-fc401d20e2e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:13.320285 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 914/1839] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:52:13.392176 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:13.489985 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be80a3-511b-486f-b3d5-fc401d20e2e5 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:13.505866 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83daf04f-9766-4fbd-938e-abbdf84b2f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:13.507658 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83daf04f-9766-4fbd-938e-abbdf84b2f1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:13.508842 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83daf04f-9766-4fbd-938e-abbdf84b2f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:13.509936 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83daf04f-9766-4fbd-938e-abbdf84b2f1c admin admin] PATH_INFO: `/v3/projects/d4a6ec1658da4f0e84ac5677759e1298` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:13.512674 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83daf04f-9766-4fbd-938e-abbdf84b2f1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4a6ec1658da4f0e84ac5677759e1298)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:13.517078 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83daf04f-9766-4fbd-938e-abbdf84b2f1c admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:13.650852 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-83daf04f-9766-4fbd-938e-abbdf84b2f1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4a6ec1658da4f0e84ac5677759e1298', 'request_id': 'req-83daf04f-9766-4fbd-938e-abbdf84b2f1c'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:13.663246 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-83daf04f-9766-4fbd-938e-abbdf84b2f1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4a6ec1658da4f0e84ac5677759e1298', 'request_id': 'req-83daf04f-9766-4fbd-938e-abbdf84b2f1c'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:13.678718 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-83daf04f-9766-4fbd-938e-abbdf84b2f1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4a6ec1658da4f0e84ac5677759e1298', 'request_id': 'req-83daf04f-9766-4fbd-938e-abbdf84b2f1c'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:13.709857 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-83daf04f-9766-4fbd-938e-abbdf84b2f1c admin admin] The token cache is being invalidate because project d4a6ec1658da4f0e84ac5677759e1298 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:52:13.710220 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-83daf04f-9766-4fbd-938e-abbdf84b2f1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:13.712226 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-83daf04f-9766-4fbd-938e-abbdf84b2f1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:13.719352 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 926/1840] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:52:13 2022] DELETE /identity/v3/projects/d4a6ec1658da4f0e84ac5677759e1298 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:13.723648 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac5155-7e4d-4b94-b80b-7e06fb7dbf1a service cinder] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:13.726184 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-9fac5155-7e4d-4b94-b80b-7e06fb7dbf1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:13.789883 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac5155-7e4d-4b94-b80b-7e06fb7dbf1a service cinder] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:13.831305 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83daf04f-9766-4fbd-938e-abbdf84b2f1c admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:13.832768 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-83daf04f-9766-4fbd-938e-abbdf84b2f1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:14.036675 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be85815-0ca4-4133-bb77-977a80b5d350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:14.045805 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83daf04f-9766-4fbd-938e-abbdf84b2f1c admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:14.048760 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be85815-0ca4-4133-bb77-977a80b5d350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:14.064679 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be85815-0ca4-4133-bb77-977a80b5d350 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:14.065050 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be85815-0ca4-4133-bb77-977a80b5d350 admin admin] PATH_INFO: `/v3/users/071043198a34465b9673127491beb914` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:14.072256 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb5513-1510-4aee-a41e-b49426697aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:14.072985 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb5513-1510-4aee-a41e-b49426697aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:14.073094 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be85815-0ca4-4133-bb77-977a80b5d350 admin admin] RBAC: Authorizing `identity:delete_user(user_id=071043198a34465b9673127491beb914)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:14.073316 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb5513-1510-4aee-a41e-b49426697aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:14.073753 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb5513-1510-4aee-a41e-b49426697aa0 admin admin] PATH_INFO: `/v3/projects/468d17d2133b4878a19bf69e11cc8e16` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:14.075727 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb5513-1510-4aee-a41e-b49426697aa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=468d17d2133b4878a19bf69e11cc8e16)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:14.077956 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb5513-1510-4aee-a41e-b49426697aa0 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:14.082462 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be85815-0ca4-4133-bb77-977a80b5d350 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:14.230209 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-2be85815-0ca4-4133-bb77-977a80b5d350 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '071043198a34465b9673127491beb914'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:14.252529 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-d9eb5513-1510-4aee-a41e-b49426697aa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '468d17d2133b4878a19bf69e11cc8e16', 'request_id': 'req-d9eb5513-1510-4aee-a41e-b49426697aa0'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:14.255035 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-2be85815-0ca4-4133-bb77-977a80b5d350 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '071043198a34465b9673127491beb914'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:14.255676 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-2be85815-0ca4-4133-bb77-977a80b5d350 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '071043198a34465b9673127491beb914'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:14.256372 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-2be85815-0ca4-4133-bb77-977a80b5d350 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '071043198a34465b9673127491beb914'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:14.268575 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-d9eb5513-1510-4aee-a41e-b49426697aa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '468d17d2133b4878a19bf69e11cc8e16', 'request_id': 'req-d9eb5513-1510-4aee-a41e-b49426697aa0'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:14.271215 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:14.292038 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-d9eb5513-1510-4aee-a41e-b49426697aa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '468d17d2133b4878a19bf69e11cc8e16', 'request_id': 'req-d9eb5513-1510-4aee-a41e-b49426697aa0'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:14.292347 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-2be85815-0ca4-4133-bb77-977a80b5d350 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '071043198a34465b9673127491beb914'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:14.308316 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-d9eb5513-1510-4aee-a41e-b49426697aa0 admin admin] The token cache is being invalidate because project 468d17d2133b4878a19bf69e11cc8e16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:52:14.308874 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-d9eb5513-1510-4aee-a41e-b49426697aa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:14.309736 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-d9eb5513-1510-4aee-a41e-b49426697aa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:14.313647 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 927/1841] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:52:13 2022] DELETE /identity/v3/projects/468d17d2133b4878a19bf69e11cc8e16 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:14.315422 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bab42d-5eee-4f4b-b43d-8542fab292c7 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:14.315868 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bab42d-5eee-4f4b-b43d-8542fab292c7 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:14.316693 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bab42d-5eee-4f4b-b43d-8542fab292c7 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:14.317040 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 915/1842] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:52:13 2022] DELETE /identity/v3/users/071043198a34465b9673127491beb914 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:14.318648 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8b479-3377-4c2e-8b45-17dc71dada5a None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:14.318826 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 928/1843] 10.222.0.46 () {54 vars in 921 bytes} [Wed Aug 3 12:52:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:14.320773 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8b479-3377-4c2e-8b45-17dc71dada5a None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:14.321196 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8b479-3377-4c2e-8b45-17dc71dada5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:14.337059 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229bb75-c630-4b35-beaa-3dc51892708c None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:14.337637 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229bb75-c630-4b35-beaa-3dc51892708c None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:14.338360 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229bb75-c630-4b35-beaa-3dc51892708c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:14.358972 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-f7a8b479-3377-4c2e-8b45-17dc71dada5a None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:14.361021 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-f7a8b479-3377-4c2e-8b45-17dc71dada5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:14.378703 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-4229bb75-c630-4b35-beaa-3dc51892708c None None] MFA Rules not processed for user `dcf670ff4f62486dbf70cf6ea0f08bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:14.382976 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-4229bb75-c630-4b35-beaa-3dc51892708c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:14.543400 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 916/1844] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:14.552113 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683ba85-5265-4eb1-a9d6-08aff95fd2e2 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:14.552631 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683ba85-5265-4eb1-a9d6-08aff95fd2e2 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:14.553126 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683ba85-5265-4eb1-a9d6-08aff95fd2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:14.572508 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 929/1845] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Aug 3 12:52:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:14.644452 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-0683ba85-5265-4eb1-a9d6-08aff95fd2e2 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:14.645423 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229bb75-c630-4b35-beaa-3dc51892708c None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:14.646097 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-0683ba85-5265-4eb1-a9d6-08aff95fd2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:14.647790 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-4229bb75-c630-4b35-beaa-3dc51892708c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:14.680304 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 917/1846] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:52:14.684534 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683ba85-5265-4eb1-a9d6-08aff95fd2e2 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:14.685836 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229bb75-c630-4b35-beaa-3dc51892708c None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:14.702510 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:14.711517 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca90327-e010-47fa-bd82-4867b68d1b48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:14.713198 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca90327-e010-47fa-bd82-4867b68d1b48 service nova] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:14.713821 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca90327-e010-47fa-bd82-4867b68d1b48 service nova] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:14.714563 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca90327-e010-47fa-bd82-4867b68d1b48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:14.717828 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683ba85-5265-4eb1-a9d6-08aff95fd2e2 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:14.734474 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca90327-e010-47fa-bd82-4867b68d1b48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:14.737621 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca90327-e010-47fa-bd82-4867b68d1b48 service nova] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:14.742150 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2a0f7-97e0-4a93-9b9b-b921308b0003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:14.742833 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2a0f7-97e0-4a93-9b9b-b921308b0003 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:14.744036 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2a0f7-97e0-4a93-9b9b-b921308b0003 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:14.746255 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2a0f7-97e0-4a93-9b9b-b921308b0003 admin admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:14.747076 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2a0f7-97e0-4a93-9b9b-b921308b0003 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:14.747438 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2a0f7-97e0-4a93-9b9b-b921308b0003 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:14.749360 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2a0f7-97e0-4a93-9b9b-b921308b0003 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:14.761968 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 930/1847] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:14.790936 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 918/1848] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:14.796007 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca90327-e010-47fa-bd82-4867b68d1b48 service nova] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:14.820484 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca90327-e010-47fa-bd82-4867b68d1b48 service nova] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:14.826818 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa419e-3011-45be-bf73-04d424f7fcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:14.827795 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa419e-3011-45be-bf73-04d424f7fcbd admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:14.828267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa419e-3011-45be-bf73-04d424f7fcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:14.828770 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa419e-3011-45be-bf73-04d424f7fcbd admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:14.829817 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa419e-3011-45be-bf73-04d424f7fcbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:14.832259 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa419e-3011-45be-bf73-04d424f7fcbd admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:14.911261 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 931/1849] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:52:14 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:52:14.911491 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2a0f7-97e0-4a93-9b9b-b921308b0003 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:14.929950 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2a0f7-97e0-4a93-9b9b-b921308b0003 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:15.141536 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6b3bc-f02d-48f3-913f-177ee0b653bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:15.141536 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6b3bc-f02d-48f3-913f-177ee0b653bf admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:15.141536 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6b3bc-f02d-48f3-913f-177ee0b653bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:15.141536 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6b3bc-f02d-48f3-913f-177ee0b653bf admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:15.141936 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6b3bc-f02d-48f3-913f-177ee0b653bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:15.144571 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6b3bc-f02d-48f3-913f-177ee0b653bf admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:15.152753 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a81d2-ff12-465b-969b-399d37926271 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:15.153627 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a81d2-ff12-465b-969b-399d37926271 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:15.154125 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a81d2-ff12-465b-969b-399d37926271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:15.182156 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-b45a81d2-ff12-465b-969b-399d37926271 None None] MFA Rules not processed for user `e10d580c2d244cd5addb0a88de7689c8`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:15.183967 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-b45a81d2-ff12-465b-969b-399d37926271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:15.205178 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 919/1850] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:52:14 2022] POST /identity/v3/users => generated 290 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:52:15.210001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6b3bc-f02d-48f3-913f-177ee0b653bf admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:15.225283 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6b3bc-f02d-48f3-913f-177ee0b653bf admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:15.232143 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89cb4d-5044-4c3f-bd57-64f988fbe16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:15.233316 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89cb4d-5044-4c3f-bd57-64f988fbe16e admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:15.234001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89cb4d-5044-4c3f-bd57-64f988fbe16e admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:15.234297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89cb4d-5044-4c3f-bd57-64f988fbe16e admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:15.235019 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89cb4d-5044-4c3f-bd57-64f988fbe16e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:15.236890 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89cb4d-5044-4c3f-bd57-64f988fbe16e admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:15.294590 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 920/1851] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:52:15.302607 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89cb4d-5044-4c3f-bd57-64f988fbe16e admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:15.321873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 932/1852] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:52:15.322845 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89cb4d-5044-4c3f-bd57-64f988fbe16e admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:15.337482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74cd682-4aec-42f6-9f9d-0ddc90074a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:15.338644 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74cd682-4aec-42f6-9f9d-0ddc90074a79 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:15.339062 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74cd682-4aec-42f6-9f9d-0ddc90074a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:15.339471 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74cd682-4aec-42f6-9f9d-0ddc90074a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:15.340333 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74cd682-4aec-42f6-9f9d-0ddc90074a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:15.352091 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74cd682-4aec-42f6-9f9d-0ddc90074a79 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:15.367975 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 921/1853] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:52:15.369328 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a81d2-ff12-465b-969b-399d37926271 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:15.388102 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a81d2-ff12-465b-969b-399d37926271 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:15.394268 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fedf9b0-c15d-44a5-874a-7d29abaa9e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:15.395744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fedf9b0-c15d-44a5-874a-7d29abaa9e2c admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:15.396530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fedf9b0-c15d-44a5-874a-7d29abaa9e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:15.396843 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fedf9b0-c15d-44a5-874a-7d29abaa9e2c admin admin] PATH_INFO: `/v3/projects/593a235d61f547ab96409e0b9353d0ef/users/a87ed3a0cbda4d00be2e417e156e5967/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:15.466757 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fedf9b0-c15d-44a5-874a-7d29abaa9e2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=593a235d61f547ab96409e0b9353d0ef, user_id=a87ed3a0cbda4d00be2e417e156e5967, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:15.472108 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fedf9b0-c15d-44a5-874a-7d29abaa9e2c admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:15.506210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 933/1854] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:52:15 2022] PUT /identity/v3/projects/593a235d61f547ab96409e0b9353d0ef/users/a87ed3a0cbda4d00be2e417e156e5967/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:15.520840 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a8617-0c2c-4758-a1a9-2615f28d8126 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:15.521367 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a8617-0c2c-4758-a1a9-2615f28d8126 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:15.521676 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a8617-0c2c-4758-a1a9-2615f28d8126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:15.585222 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-651a8617-0c2c-4758-a1a9-2615f28d8126 None None] MFA Rules not processed for user `a87ed3a0cbda4d00be2e417e156e5967`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:15.586982 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-651a8617-0c2c-4758-a1a9-2615f28d8126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:15.715131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 922/1855] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:15.715956 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fedf9b0-c15d-44a5-874a-7d29abaa9e2c admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:15.752607 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:15.830355 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fedf9b0-c15d-44a5-874a-7d29abaa9e2c admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:15.836447 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78aabdb-415e-4cf3-aaaf-a20bcc2e0e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:15.837332 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78aabdb-415e-4cf3-aaaf-a20bcc2e0e61 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:15.837676 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78aabdb-415e-4cf3-aaaf-a20bcc2e0e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:15.837959 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78aabdb-415e-4cf3-aaaf-a20bcc2e0e61 admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:15.838710 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78aabdb-415e-4cf3-aaaf-a20bcc2e0e61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:15.840643 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78aabdb-415e-4cf3-aaaf-a20bcc2e0e61 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:15.907174 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 934/1856] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:52:15 2022] POST /identity/v3/projects => generated 381 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:52:15.911790 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a8617-0c2c-4758-a1a9-2615f28d8126 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:15.935289 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a8617-0c2c-4758-a1a9-2615f28d8126 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:15.946952 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78aabdb-415e-4cf3-aaaf-a20bcc2e0e61 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:15.949749 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-a78aabdb-415e-4cf3-aaaf-a20bcc2e0e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:16.027943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:16.051406 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff64088-5a12-4fbf-915a-db4a6f166d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:16.052407 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff64088-5a12-4fbf-915a-db4a6f166d8c admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:16.052975 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff64088-5a12-4fbf-915a-db4a6f166d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:16.053335 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff64088-5a12-4fbf-915a-db4a6f166d8c admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:16.054033 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff64088-5a12-4fbf-915a-db4a6f166d8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:16.056641 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff64088-5a12-4fbf-915a-db4a6f166d8c admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:16.058156 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78aabdb-415e-4cf3-aaaf-a20bcc2e0e61 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:16.064915 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33defaa1-2c7d-48ff-802b-2cdd94f6aad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:16.065853 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33defaa1-2c7d-48ff-802b-2cdd94f6aad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:16.066297 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33defaa1-2c7d-48ff-802b-2cdd94f6aad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:16.067055 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33defaa1-2c7d-48ff-802b-2cdd94f6aad9 admin admin] PATH_INFO: `/v3/projects/e62e93b8221b4dc790b892463d000b60` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:16.071274 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33defaa1-2c7d-48ff-802b-2cdd94f6aad9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e62e93b8221b4dc790b892463d000b60)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:16.075270 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33defaa1-2c7d-48ff-802b-2cdd94f6aad9 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:16.088946 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 923/1857] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:52:15 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:52:16.094718 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff64088-5a12-4fbf-915a-db4a6f166d8c admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:16.110613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff64088-5a12-4fbf-915a-db4a6f166d8c admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:16.117706 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a4b11-1985-468e-a9d8-24ff29c7984a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:16.118601 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a4b11-1985-468e-a9d8-24ff29c7984a admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:16.118935 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a4b11-1985-468e-a9d8-24ff29c7984a admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:16.119331 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a4b11-1985-468e-a9d8-24ff29c7984a admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:16.120052 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a4b11-1985-468e-a9d8-24ff29c7984a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:16.122176 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a4b11-1985-468e-a9d8-24ff29c7984a admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:16.141819 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 924/1858] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:52:16.142768 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a4b11-1985-468e-a9d8-24ff29c7984a admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:16.142887 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-33defaa1-2c7d-48ff-802b-2cdd94f6aad9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e62e93b8221b4dc790b892463d000b60', 'request_id': 'req-33defaa1-2c7d-48ff-802b-2cdd94f6aad9'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:16.152364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-33defaa1-2c7d-48ff-802b-2cdd94f6aad9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e62e93b8221b4dc790b892463d000b60', 'request_id': 'req-33defaa1-2c7d-48ff-802b-2cdd94f6aad9'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:16.156620 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a4b11-1985-468e-a9d8-24ff29c7984a admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:16.162562 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-33defaa1-2c7d-48ff-802b-2cdd94f6aad9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e62e93b8221b4dc790b892463d000b60', 'request_id': 'req-33defaa1-2c7d-48ff-802b-2cdd94f6aad9'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:16.186953 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-33defaa1-2c7d-48ff-802b-2cdd94f6aad9 admin admin] The token cache is being invalidate because project e62e93b8221b4dc790b892463d000b60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:52:16.187251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-33defaa1-2c7d-48ff-802b-2cdd94f6aad9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:16.187948 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-33defaa1-2c7d-48ff-802b-2cdd94f6aad9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:16.192815 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 935/1859] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:52:15 2022] DELETE /identity/v3/projects/e62e93b8221b4dc790b892463d000b60 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:52:16.193938 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33defaa1-2c7d-48ff-802b-2cdd94f6aad9 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:16.196110 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-33defaa1-2c7d-48ff-802b-2cdd94f6aad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:16.255768 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b500193-4e81-4453-8e5b-5b48052a247f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:16.255768 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b500193-4e81-4453-8e5b-5b48052a247f admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:16.255768 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b500193-4e81-4453-8e5b-5b48052a247f admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:16.256134 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b500193-4e81-4453-8e5b-5b48052a247f admin admin] PATH_INFO: `/v3/projects/8bd09b5329754edab61fa846650e87f9/users/f4f6033b020a42d08f4ada47085d4531/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:16.259395 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:16.277973 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b500193-4e81-4453-8e5b-5b48052a247f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bd09b5329754edab61fa846650e87f9, user_id=f4f6033b020a42d08f4ada47085d4531, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:16.281406 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b500193-4e81-4453-8e5b-5b48052a247f admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:16.302325 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33defaa1-2c7d-48ff-802b-2cdd94f6aad9 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:16.304002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 925/1860] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:52:16 2022] PUT /identity/v3/projects/8bd09b5329754edab61fa846650e87f9/users/f4f6033b020a42d08f4ada47085d4531/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:16.308162 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b500193-4e81-4453-8e5b-5b48052a247f admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:16.310005 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-3b500193-4e81-4453-8e5b-5b48052a247f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:16.385273 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56b855-1acd-46d5-8e20-22f2156ed10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:16.386766 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56b855-1acd-46d5-8e20-22f2156ed10f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:16.387323 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56b855-1acd-46d5-8e20-22f2156ed10f admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:16.388071 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56b855-1acd-46d5-8e20-22f2156ed10f admin admin] PATH_INFO: `/v3/users/65589b3fd7204b2ea853bac5817d3140` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:16.390315 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56b855-1acd-46d5-8e20-22f2156ed10f admin admin] RBAC: Authorizing `identity:delete_user(user_id=65589b3fd7204b2ea853bac5817d3140)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:16.392344 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56b855-1acd-46d5-8e20-22f2156ed10f admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:16.411892 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b500193-4e81-4453-8e5b-5b48052a247f admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:16.417005 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd2ef3-2f72-42c6-9076-a469b8755496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:16.417850 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd2ef3-2f72-42c6-9076-a469b8755496 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:16.418139 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd2ef3-2f72-42c6-9076-a469b8755496 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:16.418674 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd2ef3-2f72-42c6-9076-a469b8755496 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:16.419122 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd2ef3-2f72-42c6-9076-a469b8755496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:16.420728 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd2ef3-2f72-42c6-9076-a469b8755496 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:16.434365 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 926/1861] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:52:16.438431 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd2ef3-2f72-42c6-9076-a469b8755496 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:16.452601 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd2ef3-2f72-42c6-9076-a469b8755496 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:16.457046 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-cd56b855-1acd-46d5-8e20-22f2156ed10f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65589b3fd7204b2ea853bac5817d3140'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:16.457621 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ba88d-09ec-48da-847b-806d75cf4d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:16.457758 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-cd56b855-1acd-46d5-8e20-22f2156ed10f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65589b3fd7204b2ea853bac5817d3140'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:16.458396 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-cd56b855-1acd-46d5-8e20-22f2156ed10f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65589b3fd7204b2ea853bac5817d3140'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:16.458507 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ba88d-09ec-48da-847b-806d75cf4d21 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:16.458756 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ba88d-09ec-48da-847b-806d75cf4d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:16.459106 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ba88d-09ec-48da-847b-806d75cf4d21 admin admin] PATH_INFO: `/v3/projects/8bd09b5329754edab61fa846650e87f9/users/f4f6033b020a42d08f4ada47085d4531/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:16.461734 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ba88d-09ec-48da-847b-806d75cf4d21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bd09b5329754edab61fa846650e87f9, user_id=f4f6033b020a42d08f4ada47085d4531, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:16.464448 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ba88d-09ec-48da-847b-806d75cf4d21 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:16.474410 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-cd56b855-1acd-46d5-8e20-22f2156ed10f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65589b3fd7204b2ea853bac5817d3140'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:16.481927 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 927/1862] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:52:16 2022] PUT /identity/v3/projects/8bd09b5329754edab61fa846650e87f9/users/f4f6033b020a42d08f4ada47085d4531/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:52:16.488915 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-cd56b855-1acd-46d5-8e20-22f2156ed10f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65589b3fd7204b2ea853bac5817d3140'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:16.494724 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280414b-156e-475e-a1de-22f013bf21d9 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:16.495025 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280414b-156e-475e-a1de-22f013bf21d9 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:16.495297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280414b-156e-475e-a1de-22f013bf21d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:16.514842 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 936/1863] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:52:16 2022] DELETE /identity/v3/users/65589b3fd7204b2ea853bac5817d3140 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:16.533547 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-c280414b-156e-475e-a1de-22f013bf21d9 None None] MFA Rules not processed for user `f4f6033b020a42d08f4ada47085d4531`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:16.534187 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-c280414b-156e-475e-a1de-22f013bf21d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:16.561556 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:16.647338 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 928/1864] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:16 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:16.662971 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56b855-1acd-46d5-8e20-22f2156ed10f admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:16.665644 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-cd56b855-1acd-46d5-8e20-22f2156ed10f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:16.745721 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56b855-1acd-46d5-8e20-22f2156ed10f admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:16.751266 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ef08e-4795-431d-83de-f1bd69fa8bf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:16.752670 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ef08e-4795-431d-83de-f1bd69fa8bf4 service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:16.754200 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ef08e-4795-431d-83de-f1bd69fa8bf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:16.754722 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ef08e-4795-431d-83de-f1bd69fa8bf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:16.769920 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ef08e-4795-431d-83de-f1bd69fa8bf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:16.774375 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ef08e-4795-431d-83de-f1bd69fa8bf4 service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:16.792036 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 937/1865] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:16 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:16.853460 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c280414b-156e-475e-a1de-22f013bf21d9 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:16.855103 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-c280414b-156e-475e-a1de-22f013bf21d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:16.951702 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c280414b-156e-475e-a1de-22f013bf21d9 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:16.956595 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80242b6-c742-41fa-a9be-da5f6cf53561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:16.957296 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80242b6-c742-41fa-a9be-da5f6cf53561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:16.957608 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80242b6-c742-41fa-a9be-da5f6cf53561 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:16.957909 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80242b6-c742-41fa-a9be-da5f6cf53561 admin admin] PATH_INFO: `/v3/projects/16ad9f619c904865a35502173eefb39f` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:16.959135 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80242b6-c742-41fa-a9be-da5f6cf53561 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16ad9f619c904865a35502173eefb39f)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:16.962476 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80242b6-c742-41fa-a9be-da5f6cf53561 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:17.021166 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-e80242b6-c742-41fa-a9be-da5f6cf53561 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16ad9f619c904865a35502173eefb39f', 'request_id': 'req-e80242b6-c742-41fa-a9be-da5f6cf53561'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:17.030204 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-e80242b6-c742-41fa-a9be-da5f6cf53561 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16ad9f619c904865a35502173eefb39f', 'request_id': 'req-e80242b6-c742-41fa-a9be-da5f6cf53561'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:17.040092 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-e80242b6-c742-41fa-a9be-da5f6cf53561 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16ad9f619c904865a35502173eefb39f', 'request_id': 'req-e80242b6-c742-41fa-a9be-da5f6cf53561'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:17.058281 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-e80242b6-c742-41fa-a9be-da5f6cf53561 admin admin] The token cache is being invalidate because project 16ad9f619c904865a35502173eefb39f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:52:17.058573 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-e80242b6-c742-41fa-a9be-da5f6cf53561 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:17.059239 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-e80242b6-c742-41fa-a9be-da5f6cf53561 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:17.061486 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 929/1866] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:52:16 2022] DELETE /identity/v3/projects/16ad9f619c904865a35502173eefb39f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:17.068629 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34fe29-cd8f-4d01-a6be-0bda9661999c None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:17.068903 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34fe29-cd8f-4d01-a6be-0bda9661999c None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:17.069185 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34fe29-cd8f-4d01-a6be-0bda9661999c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:17.088106 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:17.107540 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-7d34fe29-cd8f-4d01-a6be-0bda9661999c None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:17.108991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-7d34fe29-cd8f-4d01-a6be-0bda9661999c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:17.202524 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 938/1867] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:17.219665 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1d36d-dc96-48ca-bd29-ec76bb7b5ab9 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:17.219978 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1d36d-dc96-48ca-bd29-ec76bb7b5ab9 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:17.220247 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1d36d-dc96-48ca-bd29-ec76bb7b5ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:17.259466 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34fe29-cd8f-4d01-a6be-0bda9661999c None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:17.261163 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-7d34fe29-cd8f-4d01-a6be-0bda9661999c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:17.263754 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-a9b1d36d-dc96-48ca-bd29-ec76bb7b5ab9 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:17.271060 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-a9b1d36d-dc96-48ca-bd29-ec76bb7b5ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:17.290312 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 930/1868] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:17.291446 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1d36d-dc96-48ca-bd29-ec76bb7b5ab9 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:17.314766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1d36d-dc96-48ca-bd29-ec76bb7b5ab9 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:17.332973 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ab148-5052-43b1-b76d-a4aea9a20d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:17.333647 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ab148-5052-43b1-b76d-a4aea9a20d37 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:17.333932 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ab148-5052-43b1-b76d-a4aea9a20d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:17.334209 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ab148-5052-43b1-b76d-a4aea9a20d37 admin admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:17.334926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ab148-5052-43b1-b76d-a4aea9a20d37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:17.335233 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ab148-5052-43b1-b76d-a4aea9a20d37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:17.337273 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ab148-5052-43b1-b76d-a4aea9a20d37 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:17.387279 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 931/1869] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:17.391521 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ab148-5052-43b1-b76d-a4aea9a20d37 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:17.413311 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ab148-5052-43b1-b76d-a4aea9a20d37 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:17.426808 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87598c-71aa-4d33-9d10-c4e2a4e0671d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:17.428030 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87598c-71aa-4d33-9d10-c4e2a4e0671d admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:17.428502 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87598c-71aa-4d33-9d10-c4e2a4e0671d admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:17.428960 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87598c-71aa-4d33-9d10-c4e2a4e0671d admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:17.430388 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f87598c-71aa-4d33-9d10-c4e2a4e0671d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:17.433933 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f87598c-71aa-4d33-9d10-c4e2a4e0671d admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:17.490747 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34fe29-cd8f-4d01-a6be-0bda9661999c None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:17.504750 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 932/1870] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:52:17 2022] POST /identity/v3/projects => generated 401 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:52:17.504913 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f53177-b8f9-4e69-a798-2c4a9ae429e8 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f6033b020a42d08f4ada47085d4531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bd09b5329754edab61fa846650e87f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:17.505598 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f53177-b8f9-4e69-a798-2c4a9ae429e8 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:17.505897 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f53177-b8f9-4e69-a798-2c4a9ae429e8 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:17.506089 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87598c-71aa-4d33-9d10-c4e2a4e0671d admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:17.506188 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f53177-b8f9-4e69-a798-2c4a9ae429e8 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:17.506906 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f53177-b8f9-4e69-a798-2c4a9ae429e8 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:17.507316 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f53177-b8f9-4e69-a798-2c4a9ae429e8 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:17.509974 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f53177-b8f9-4e69-a798-2c4a9ae429e8 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:17.532644 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 939/1871] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:17.535305 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:17.535450 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f53177-b8f9-4e69-a798-2c4a9ae429e8 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:17.555512 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f53177-b8f9-4e69-a798-2c4a9ae429e8 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:17.649131 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0671735-0e1a-40bd-b883-55cb46badbb0 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f6033b020a42d08f4ada47085d4531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bd09b5329754edab61fa846650e87f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:17.649817 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0671735-0e1a-40bd-b883-55cb46badbb0 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:17.650107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0671735-0e1a-40bd-b883-55cb46badbb0 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:17.650389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0671735-0e1a-40bd-b883-55cb46badbb0 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:17.651221 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0671735-0e1a-40bd-b883-55cb46badbb0 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:17.653585 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0671735-0e1a-40bd-b883-55cb46badbb0 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:17.717161 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 940/1872] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:52:17 2022] POST /identity/v3/projects => generated 352 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:52:17.718579 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0671735-0e1a-40bd-b883-55cb46badbb0 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:17.720656 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87598c-71aa-4d33-9d10-c4e2a4e0671d admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:17.782502 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:17.828269 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802bdf97-cdd5-428b-95a0-502fbd5191f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:17.829129 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bdf97-cdd5-428b-95a0-502fbd5191f2 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:17.829575 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bdf97-cdd5-428b-95a0-502fbd5191f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:17.829929 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bdf97-cdd5-428b-95a0-502fbd5191f2 admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:17.830794 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802bdf97-cdd5-428b-95a0-502fbd5191f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:17.832819 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802bdf97-cdd5-428b-95a0-502fbd5191f2 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:17.837459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0671735-0e1a-40bd-b883-55cb46badbb0 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:17.842963 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbfaefb-a5d1-41cf-9855-c62ab2427f83 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f6033b020a42d08f4ada47085d4531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bd09b5329754edab61fa846650e87f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:17.843801 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfaefb-a5d1-41cf-9855-c62ab2427f83 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:17.844241 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfaefb-a5d1-41cf-9855-c62ab2427f83 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:17.845378 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfaefb-a5d1-41cf-9855-c62ab2427f83 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:17.846287 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbfaefb-a5d1-41cf-9855-c62ab2427f83 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:17.846832 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbfaefb-a5d1-41cf-9855-c62ab2427f83 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:17.850696 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbfaefb-a5d1-41cf-9855-c62ab2427f83 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:17.866692 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 941/1873] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:17.883939 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 933/1874] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:52:17 2022] POST /identity/v3/users => generated 301 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:52:17.892911 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbfaefb-a5d1-41cf-9855-c62ab2427f83 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:17.914946 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbfaefb-a5d1-41cf-9855-c62ab2427f83 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:17.921040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee30c7d-5c1c-404b-b63b-d812a5103aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:17.922318 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee30c7d-5c1c-404b-b63b-d812a5103aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:17.922602 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee30c7d-5c1c-404b-b63b-d812a5103aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:17.922880 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee30c7d-5c1c-404b-b63b-d812a5103aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:17.923595 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee30c7d-5c1c-404b-b63b-d812a5103aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:17.925639 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee30c7d-5c1c-404b-b63b-d812a5103aa8 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:17.934126 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802bdf97-cdd5-428b-95a0-502fbd5191f2 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:17.947853 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 942/1875] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:52:17.948787 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802bdf97-cdd5-428b-95a0-502fbd5191f2 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:17.949154 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee30c7d-5c1c-404b-b63b-d812a5103aa8 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:17.955505 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305898e8-1f43-4a09-8478-02ab85b2a835 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4f6033b020a42d08f4ada47085d4531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bd09b5329754edab61fa846650e87f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:17.956887 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305898e8-1f43-4a09-8478-02ab85b2a835 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:17.957241 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305898e8-1f43-4a09-8478-02ab85b2a835 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:17.958086 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305898e8-1f43-4a09-8478-02ab85b2a835 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] PATH_INFO: `/v3/projects/eb579e76e6c948879442d5034ccbddd1` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:17.959226 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305898e8-1f43-4a09-8478-02ab85b2a835 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] RBAC: Authorizing `identity:delete_project(project_id=eb579e76e6c948879442d5034ccbddd1)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:17.962490 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305898e8-1f43-4a09-8478-02ab85b2a835 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:17.966520 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee30c7d-5c1c-404b-b63b-d812a5103aa8 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:17.974570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318add7-b729-49fa-bda1-84b906f36ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:17.975780 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318add7-b729-49fa-bda1-84b906f36ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:17.975780 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318add7-b729-49fa-bda1-84b906f36ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:17.975780 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318add7-b729-49fa-bda1-84b906f36ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:17.977229 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318add7-b729-49fa-bda1-84b906f36ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:17.979671 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318add7-b729-49fa-bda1-84b906f36ce5 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:17.991378 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 943/1876] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:52:17.995867 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318add7-b729-49fa-bda1-84b906f36ce5 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:18.012331 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318add7-b729-49fa-bda1-84b906f36ce5 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:18.020394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e49f62-2fd7-4826-821e-569020cfe7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:18.021564 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e49f62-2fd7-4826-821e-569020cfe7de admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:18.022125 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e49f62-2fd7-4826-821e-569020cfe7de admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:18.022463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e49f62-2fd7-4826-821e-569020cfe7de admin admin] PATH_INFO: `/v3/projects/cf5e0f405680438193ba5bd7e5905cdb/users/34e38b633189478eb90956537207c643/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:18.042502 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e49f62-2fd7-4826-821e-569020cfe7de admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf5e0f405680438193ba5bd7e5905cdb, user_id=34e38b633189478eb90956537207c643, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:18.043286 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-305898e8-1f43-4a09-8478-02ab85b2a835 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb579e76e6c948879442d5034ccbddd1', 'request_id': 'req-305898e8-1f43-4a09-8478-02ab85b2a835'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:18.051434 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-305898e8-1f43-4a09-8478-02ab85b2a835 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb579e76e6c948879442d5034ccbddd1', 'request_id': 'req-305898e8-1f43-4a09-8478-02ab85b2a835'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:18.055784 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e49f62-2fd7-4826-821e-569020cfe7de admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:18.058943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-305898e8-1f43-4a09-8478-02ab85b2a835 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb579e76e6c948879442d5034ccbddd1', 'request_id': 'req-305898e8-1f43-4a09-8478-02ab85b2a835'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:18.097614 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-305898e8-1f43-4a09-8478-02ab85b2a835 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] The token cache is being invalidate because project eb579e76e6c948879442d5034ccbddd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:52:18.100954 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 944/1877] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:52:17 2022] PUT /identity/v3/projects/cf5e0f405680438193ba5bd7e5905cdb/users/34e38b633189478eb90956537207c643/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:18.101215 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-305898e8-1f43-4a09-8478-02ab85b2a835 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:18.110193 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-305898e8-1f43-4a09-8478-02ab85b2a835 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:18.117426 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 934/1878] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:52:17 2022] DELETE /identity/v3/projects/eb579e76e6c948879442d5034ccbddd1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:52:18.117650 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2949bf9-57e2-40d0-8e03-3b11453a017c None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:18.117754 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2949bf9-57e2-40d0-8e03-3b11453a017c None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:18.118740 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2949bf9-57e2-40d0-8e03-3b11453a017c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:18.179151 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-f2949bf9-57e2-40d0-8e03-3b11453a017c None None] MFA Rules not processed for user `34e38b633189478eb90956537207c643`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:18.181031 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-f2949bf9-57e2-40d0-8e03-3b11453a017c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:18.373427 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 945/1879] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:18 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:18.377277 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305898e8-1f43-4a09-8478-02ab85b2a835 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:18.379019 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-305898e8-1f43-4a09-8478-02ab85b2a835 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:18.441224 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:18.536502 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305898e8-1f43-4a09-8478-02ab85b2a835 tempest-VolumeQuotaClassesTest-1468344448 tempest-VolumeQuotaClassesTest-1468344448-project-admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:18.585003 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2949bf9-57e2-40d0-8e03-3b11453a017c None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:18.590539 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-f2949bf9-57e2-40d0-8e03-3b11453a017c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:18.631901 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9a7ac-219d-4b54-9464-a8b223cf8df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:18.633388 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9a7ac-219d-4b54-9464-a8b223cf8df1 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:18.633801 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9a7ac-219d-4b54-9464-a8b223cf8df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:18.634076 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9a7ac-219d-4b54-9464-a8b223cf8df1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:18.634865 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9a7ac-219d-4b54-9464-a8b223cf8df1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:18.636863 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9a7ac-219d-4b54-9464-a8b223cf8df1 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:18.675501 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 935/1880] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:52:18 2022] POST /identity/v3/projects => generated 399 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:52:18.681216 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9a7ac-219d-4b54-9464-a8b223cf8df1 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:18.720078 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2949bf9-57e2-40d0-8e03-3b11453a017c None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:18.725302 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:18.760521 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9a7ac-219d-4b54-9464-a8b223cf8df1 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:18.767195 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e484bf-24ba-4b00-a51c-cacac77956d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:18.767843 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e484bf-24ba-4b00-a51c-cacac77956d3 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:18.768125 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e484bf-24ba-4b00-a51c-cacac77956d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:18.768403 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e484bf-24ba-4b00-a51c-cacac77956d3 admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:18.769077 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e484bf-24ba-4b00-a51c-cacac77956d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:18.771232 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e484bf-24ba-4b00-a51c-cacac77956d3 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:18.796774 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39c7fa-7eca-4767-93cc-b9860bea4083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:18.797480 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39c7fa-7eca-4767-93cc-b9860bea4083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:18.797794 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39c7fa-7eca-4767-93cc-b9860bea4083 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:18.798065 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39c7fa-7eca-4767-93cc-b9860bea4083 admin admin] PATH_INFO: `/v3/users/a87ed3a0cbda4d00be2e417e156e5967` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:18.799230 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 936/1881] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:52:18 2022] POST /identity/v3/users => generated 306 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:52:18.799400 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39c7fa-7eca-4767-93cc-b9860bea4083 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a87ed3a0cbda4d00be2e417e156e5967)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:18.801475 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39c7fa-7eca-4767-93cc-b9860bea4083 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:18.803402 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e484bf-24ba-4b00-a51c-cacac77956d3 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:18.818075 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e484bf-24ba-4b00-a51c-cacac77956d3 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:18.824475 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233301f-13ad-46c2-9d0f-b675d31082c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:18.825090 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233301f-13ad-46c2-9d0f-b675d31082c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:18.826007 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233301f-13ad-46c2-9d0f-b675d31082c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:18.826850 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233301f-13ad-46c2-9d0f-b675d31082c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:18.828947 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233301f-13ad-46c2-9d0f-b675d31082c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:18.830815 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233301f-13ad-46c2-9d0f-b675d31082c2 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:18.845116 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 937/1882] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:52:18.849316 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233301f-13ad-46c2-9d0f-b675d31082c2 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:18.859984 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233301f-13ad-46c2-9d0f-b675d31082c2 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:18.864957 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-af39c7fa-7eca-4767-93cc-b9860bea4083 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a87ed3a0cbda4d00be2e417e156e5967'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:18.865931 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-af39c7fa-7eca-4767-93cc-b9860bea4083 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a87ed3a0cbda4d00be2e417e156e5967'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:18.866548 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-af39c7fa-7eca-4767-93cc-b9860bea4083 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a87ed3a0cbda4d00be2e417e156e5967'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:18.871976 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69992fe-5485-4583-aa80-0ab44179155b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:18.872758 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69992fe-5485-4583-aa80-0ab44179155b admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:18.874337 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69992fe-5485-4583-aa80-0ab44179155b admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:18.874337 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69992fe-5485-4583-aa80-0ab44179155b admin admin] PATH_INFO: `/v3/projects/e0e3d689f2574e0a800fe4ab768a7ed3/users/c784894eb86b4099b8816884541caa22/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:18.885420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-af39c7fa-7eca-4767-93cc-b9860bea4083 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a87ed3a0cbda4d00be2e417e156e5967'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:18.893966 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-af39c7fa-7eca-4767-93cc-b9860bea4083 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a87ed3a0cbda4d00be2e417e156e5967'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:18.903142 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69992fe-5485-4583-aa80-0ab44179155b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0e3d689f2574e0a800fe4ab768a7ed3, user_id=c784894eb86b4099b8816884541caa22, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:18.906543 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69992fe-5485-4583-aa80-0ab44179155b admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:18.918219 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 946/1883] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:52:18 2022] DELETE /identity/v3/users/a87ed3a0cbda4d00be2e417e156e5967 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:52:18.920215 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8dfd2-2c97-40b8-826d-c861da9ac31a None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:18.920606 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8dfd2-2c97-40b8-826d-c861da9ac31a None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:18.921052 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8dfd2-2c97-40b8-826d-c861da9ac31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:18.928673 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 938/1884] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:52:18 2022] PUT /identity/v3/projects/e0e3d689f2574e0a800fe4ab768a7ed3/users/c784894eb86b4099b8816884541caa22/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:52:18.930586 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69992fe-5485-4583-aa80-0ab44179155b admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:18.932837 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-a69992fe-5485-4583-aa80-0ab44179155b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:18.949033 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-eef8dfd2-2c97-40b8-826d-c861da9ac31a None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:18.951571 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-eef8dfd2-2c97-40b8-826d-c861da9ac31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:18.955845 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:19.027742 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 947/1885] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:19.035677 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69992fe-5485-4583-aa80-0ab44179155b admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:19.040519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8dfd2-2c97-40b8-826d-c861da9ac31a None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:19.041916 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b570c-0dde-4d77-9846-d4c376cf6ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:19.042139 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-eef8dfd2-2c97-40b8-826d-c861da9ac31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:19.042693 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b570c-0dde-4d77-9846-d4c376cf6ced admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:19.043043 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b570c-0dde-4d77-9846-d4c376cf6ced admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:19.043388 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b570c-0dde-4d77-9846-d4c376cf6ced admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:19.044161 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b570c-0dde-4d77-9846-d4c376cf6ced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:19.046601 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b570c-0dde-4d77-9846-d4c376cf6ced admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:19.059418 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 939/1886] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:52:19.067324 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b570c-0dde-4d77-9846-d4c376cf6ced admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:19.081276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:19.083484 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b570c-0dde-4d77-9846-d4c376cf6ced admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:19.091749 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fd5df-4ca0-44bf-97c5-05a35ccfeba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:19.093630 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fd5df-4ca0-44bf-97c5-05a35ccfeba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:19.093987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fd5df-4ca0-44bf-97c5-05a35ccfeba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:19.094272 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fd5df-4ca0-44bf-97c5-05a35ccfeba8 admin admin] PATH_INFO: `/v3/projects/e0e3d689f2574e0a800fe4ab768a7ed3/users/c784894eb86b4099b8816884541caa22/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:19.098787 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069fd5df-4ca0-44bf-97c5-05a35ccfeba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0e3d689f2574e0a800fe4ab768a7ed3, user_id=c784894eb86b4099b8816884541caa22, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:19.104669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069fd5df-4ca0-44bf-97c5-05a35ccfeba8 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:19.118771 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 940/1887] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:52:19 2022] PUT /identity/v3/projects/e0e3d689f2574e0a800fe4ab768a7ed3/users/c784894eb86b4099b8816884541caa22/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:19.121168 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8dfd2-2c97-40b8-826d-c861da9ac31a None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:19.129948 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5569fca-7067-4d65-805b-e00f41409f3e None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:19.130362 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5569fca-7067-4d65-805b-e00f41409f3e None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:19.130736 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5569fca-7067-4d65-805b-e00f41409f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:19.163260 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-c5569fca-7067-4d65-805b-e00f41409f3e None None] MFA Rules not processed for user `c784894eb86b4099b8816884541caa22`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:19.165406 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-c5569fca-7067-4d65-805b-e00f41409f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:19.183488 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f8cc0-859b-4919-bf59-f9c00d5da6ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:19.184687 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f8cc0-859b-4919-bf59-f9c00d5da6ec service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:19.185091 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f8cc0-859b-4919-bf59-f9c00d5da6ec service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:19.185593 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f8cc0-859b-4919-bf59-f9c00d5da6ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:19.259257 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 941/1888] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:19 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:52:19.264761 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f8cc0-859b-4919-bf59-f9c00d5da6ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:19.266363 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f8cc0-859b-4919-bf59-f9c00d5da6ec service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:19.278816 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5569fca-7067-4d65-805b-e00f41409f3e None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:19.280817 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-c5569fca-7067-4d65-805b-e00f41409f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:19.295928 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 948/1889] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:19.350695 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5569fca-7067-4d65-805b-e00f41409f3e None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:19.356238 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd02509-9774-49bc-82ea-b784bdf00290 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:19.357170 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd02509-9774-49bc-82ea-b784bdf00290 service cinder] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:19.357641 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd02509-9774-49bc-82ea-b784bdf00290 service cinder] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:19.358075 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd02509-9774-49bc-82ea-b784bdf00290 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:19.371375 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd02509-9774-49bc-82ea-b784bdf00290 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:19.372835 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd02509-9774-49bc-82ea-b784bdf00290 service cinder] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:19.384406 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 942/1890] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:19 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:19.480375 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f8cc0-859b-4919-bf59-f9c00d5da6ec service neutron] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:19.493464 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f8cc0-859b-4919-bf59-f9c00d5da6ec service neutron] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:19.503131 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b4a25-d860-45b5-87d5-380a0e7bbdb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:19.503930 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b4a25-d860-45b5-87d5-380a0e7bbdb9 service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:19.504283 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b4a25-d860-45b5-87d5-380a0e7bbdb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:19.504624 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b4a25-d860-45b5-87d5-380a0e7bbdb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:19.508907 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-1c3b4a25-d860-45b5-87d5-380a0e7bbdb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:19.579252 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b4a25-d860-45b5-87d5-380a0e7bbdb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:19.581349 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b4a25-d860-45b5-87d5-380a0e7bbdb9 service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:19.595119 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 949/1891] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:19 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:19.670544 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd02509-9774-49bc-82ea-b784bdf00290 service cinder] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:19.671940 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-9bd02509-9774-49bc-82ea-b784bdf00290 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:19.699860 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd02509-9774-49bc-82ea-b784bdf00290 service cinder] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:19.706099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47271096-bc90-4091-a5b5-2066261de052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:19.707433 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47271096-bc90-4091-a5b5-2066261de052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:19.707782 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47271096-bc90-4091-a5b5-2066261de052 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:19.708144 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47271096-bc90-4091-a5b5-2066261de052 admin admin] PATH_INFO: `/v3/projects/593a235d61f547ab96409e0b9353d0ef` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:19.709416 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47271096-bc90-4091-a5b5-2066261de052 admin admin] RBAC: Authorizing `identity:delete_project(project_id=593a235d61f547ab96409e0b9353d0ef)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:19.712639 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47271096-bc90-4091-a5b5-2066261de052 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:19.739727 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:19.774298 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-47271096-bc90-4091-a5b5-2066261de052 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '593a235d61f547ab96409e0b9353d0ef', 'request_id': 'req-47271096-bc90-4091-a5b5-2066261de052'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:19.781549 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-47271096-bc90-4091-a5b5-2066261de052 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '593a235d61f547ab96409e0b9353d0ef', 'request_id': 'req-47271096-bc90-4091-a5b5-2066261de052'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:19.787995 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-47271096-bc90-4091-a5b5-2066261de052 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '593a235d61f547ab96409e0b9353d0ef', 'request_id': 'req-47271096-bc90-4091-a5b5-2066261de052'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:19.800798 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-47271096-bc90-4091-a5b5-2066261de052 admin admin] The token cache is being invalidate because project 593a235d61f547ab96409e0b9353d0ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:52:19.801084 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-47271096-bc90-4091-a5b5-2066261de052 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:19.801765 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-47271096-bc90-4091-a5b5-2066261de052 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:19.803345 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 943/1892] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:52:19 2022] DELETE /identity/v3/projects/593a235d61f547ab96409e0b9353d0ef => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:19.807839 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b4a25-d860-45b5-87d5-380a0e7bbdb9 service cinder] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:19.819208 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b4a25-d860-45b5-87d5-380a0e7bbdb9 service cinder] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:19.852762 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:19.894181 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a0432-b1df-4efd-8443-00890e33b5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:19.895782 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a0432-b1df-4efd-8443-00890e33b5a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:19.896249 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a0432-b1df-4efd-8443-00890e33b5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:19.896705 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a0432-b1df-4efd-8443-00890e33b5a0 admin admin] PATH_INFO: `/v3/users/f4f6033b020a42d08f4ada47085d4531` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:19.898871 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a0432-b1df-4efd-8443-00890e33b5a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4f6033b020a42d08f4ada47085d4531)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:19.901201 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a0432-b1df-4efd-8443-00890e33b5a0 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:19.983223 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-f36a0432-b1df-4efd-8443-00890e33b5a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4f6033b020a42d08f4ada47085d4531'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:19.985698 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-f36a0432-b1df-4efd-8443-00890e33b5a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4f6033b020a42d08f4ada47085d4531'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:19.986575 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-f36a0432-b1df-4efd-8443-00890e33b5a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4f6033b020a42d08f4ada47085d4531'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:20.003140 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-f36a0432-b1df-4efd-8443-00890e33b5a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4f6033b020a42d08f4ada47085d4531'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:20.015831 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-f36a0432-b1df-4efd-8443-00890e33b5a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4f6033b020a42d08f4ada47085d4531'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:20.034113 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 950/1893] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:52:19 2022] DELETE /identity/v3/users/f4f6033b020a42d08f4ada47085d4531 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:20.390615 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47271096-bc90-4091-a5b5-2066261de052 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:20.392134 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-47271096-bc90-4091-a5b5-2066261de052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:20.408739 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47271096-bc90-4091-a5b5-2066261de052 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:20.472156 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84848d-51ef-4fc0-b2e8-ab88c27e6a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:20.472755 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84848d-51ef-4fc0-b2e8-ab88c27e6a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:20.473036 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84848d-51ef-4fc0-b2e8-ab88c27e6a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:20.473314 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84848d-51ef-4fc0-b2e8-ab88c27e6a6a admin admin] PATH_INFO: `/v3/projects/8bd09b5329754edab61fa846650e87f9` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:20.474559 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84848d-51ef-4fc0-b2e8-ab88c27e6a6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bd09b5329754edab61fa846650e87f9)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:20.476671 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84848d-51ef-4fc0-b2e8-ab88c27e6a6a admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:20.524593 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-ca84848d-51ef-4fc0-b2e8-ab88c27e6a6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bd09b5329754edab61fa846650e87f9', 'request_id': 'req-ca84848d-51ef-4fc0-b2e8-ab88c27e6a6a'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:20.530901 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-ca84848d-51ef-4fc0-b2e8-ab88c27e6a6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bd09b5329754edab61fa846650e87f9', 'request_id': 'req-ca84848d-51ef-4fc0-b2e8-ab88c27e6a6a'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:20.537561 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-ca84848d-51ef-4fc0-b2e8-ab88c27e6a6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bd09b5329754edab61fa846650e87f9', 'request_id': 'req-ca84848d-51ef-4fc0-b2e8-ab88c27e6a6a'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:20.554198 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-ca84848d-51ef-4fc0-b2e8-ab88c27e6a6a admin admin] The token cache is being invalidate because project 8bd09b5329754edab61fa846650e87f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:52:20.555256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-ca84848d-51ef-4fc0-b2e8-ab88c27e6a6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:20.556106 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-ca84848d-51ef-4fc0-b2e8-ab88c27e6a6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:20.558115 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 944/1894] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:52:20 2022] DELETE /identity/v3/projects/8bd09b5329754edab61fa846650e87f9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:20.563435 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eab9a5-a7b0-465f-888c-5c1bebce7baf None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:20.563752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eab9a5-a7b0-465f-888c-5c1bebce7baf None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:20.564073 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eab9a5-a7b0-465f-888c-5c1bebce7baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:20.584349 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-05eab9a5-a7b0-465f-888c-5c1bebce7baf None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:20.585768 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-05eab9a5-a7b0-465f-888c-5c1bebce7baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:20.650748 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 951/1895] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:52:20.658286 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cccdb38-181b-49b0-8ce9-e268e6c9432f None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:20.658544 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cccdb38-181b-49b0-8ce9-e268e6c9432f None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:20.658842 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cccdb38-181b-49b0-8ce9-e268e6c9432f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:20.706701 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-7cccdb38-181b-49b0-8ce9-e268e6c9432f None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:20.707967 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-7cccdb38-181b-49b0-8ce9-e268e6c9432f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:20.722889 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eab9a5-a7b0-465f-888c-5c1bebce7baf None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:20.723116 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 945/1896] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:52:20.733839 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eab9a5-a7b0-465f-888c-5c1bebce7baf None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:20.742367 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fcf993-76e1-45c8-8148-ff61662f032a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:20.743222 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcf993-76e1-45c8-8148-ff61662f032a admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:20.743506 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcf993-76e1-45c8-8148-ff61662f032a admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:20.743782 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcf993-76e1-45c8-8148-ff61662f032a admin admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:20.744505 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fcf993-76e1-45c8-8148-ff61662f032a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:20.745247 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fcf993-76e1-45c8-8148-ff61662f032a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:20.746731 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fcf993-76e1-45c8-8148-ff61662f032a admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:20.769139 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cccdb38-181b-49b0-8ce9-e268e6c9432f None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:20.774810 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 952/1897] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:20.793525 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cccdb38-181b-49b0-8ce9-e268e6c9432f None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:20.803565 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ad95c-d885-4c40-8ada-dc07b5e48b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:20.804355 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ad95c-d885-4c40-8ada-dc07b5e48b99 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:20.804700 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ad95c-d885-4c40-8ada-dc07b5e48b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:20.805101 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ad95c-d885-4c40-8ada-dc07b5e48b99 admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:20.806220 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ad95c-d885-4c40-8ada-dc07b5e48b99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:20.808427 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ad95c-d885-4c40-8ada-dc07b5e48b99 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:20.854317 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 946/1898] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:52:20 2022] POST /identity/v3/projects => generated 385 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:52:20.858605 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fcf993-76e1-45c8-8148-ff61662f032a admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:20.868522 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fcf993-76e1-45c8-8148-ff61662f032a admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:20.906836 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:20.927560 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74a892-8694-4dc6-8cd3-ecf84dfc6e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:20.928180 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74a892-8694-4dc6-8cd3-ecf84dfc6e58 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:20.928465 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74a892-8694-4dc6-8cd3-ecf84dfc6e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:20.928744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74a892-8694-4dc6-8cd3-ecf84dfc6e58 admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:20.930129 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74a892-8694-4dc6-8cd3-ecf84dfc6e58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:20.932061 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74a892-8694-4dc6-8cd3-ecf84dfc6e58 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:20.957608 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 953/1899] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:52:20 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:52:20.959064 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ad95c-d885-4c40-8ada-dc07b5e48b99 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:20.969929 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ad95c-d885-4c40-8ada-dc07b5e48b99 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:20.974660 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89505e8-688f-4b37-8629-e1b5f2ffb55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:20.975273 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89505e8-688f-4b37-8629-e1b5f2ffb55c admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:20.975555 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89505e8-688f-4b37-8629-e1b5f2ffb55c admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:20.975830 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89505e8-688f-4b37-8629-e1b5f2ffb55c admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:20.976566 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89505e8-688f-4b37-8629-e1b5f2ffb55c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:20.978790 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89505e8-688f-4b37-8629-e1b5f2ffb55c admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:20.980867 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:20.993769 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 947/1900] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:52:20.995912 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74a892-8694-4dc6-8cd3-ecf84dfc6e58 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:21.011517 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74a892-8694-4dc6-8cd3-ecf84dfc6e58 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:21.017407 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82113a1-fb98-4c02-9673-71ab8b8098b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:21.018185 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82113a1-fb98-4c02-9673-71ab8b8098b6 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:21.018480 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82113a1-fb98-4c02-9673-71ab8b8098b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:21.018914 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82113a1-fb98-4c02-9673-71ab8b8098b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:21.019713 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82113a1-fb98-4c02-9673-71ab8b8098b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:21.021562 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82113a1-fb98-4c02-9673-71ab8b8098b6 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:21.033603 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 954/1901] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:52:21.038014 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89505e8-688f-4b37-8629-e1b5f2ffb55c admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:21.048532 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89505e8-688f-4b37-8629-e1b5f2ffb55c admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:21.053521 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fffc29-670a-4df7-b540-21d974372a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:21.054183 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fffc29-670a-4df7-b540-21d974372a59 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:21.054465 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fffc29-670a-4df7-b540-21d974372a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:21.054739 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fffc29-670a-4df7-b540-21d974372a59 admin admin] PATH_INFO: `/v3/projects/c3eb2f6d734942538161a61790ec1783/users/380285fab2e3456cacac005fc550a37c/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:21.073710 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fffc29-670a-4df7-b540-21d974372a59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3eb2f6d734942538161a61790ec1783, user_id=380285fab2e3456cacac005fc550a37c, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:21.076234 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fffc29-670a-4df7-b540-21d974372a59 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:21.095583 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 948/1902] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:52:21 2022] PUT /identity/v3/projects/c3eb2f6d734942538161a61790ec1783/users/380285fab2e3456cacac005fc550a37c/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:21.105922 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa3cc9-06a0-46b9-a575-22ddd2e2a9e9 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:21.106942 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa3cc9-06a0-46b9-a575-22ddd2e2a9e9 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:21.106942 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa3cc9-06a0-46b9-a575-22ddd2e2a9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:21.139500 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-5afa3cc9-06a0-46b9-a575-22ddd2e2a9e9 None None] MFA Rules not processed for user `380285fab2e3456cacac005fc550a37c`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:21.140695 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-5afa3cc9-06a0-46b9-a575-22ddd2e2a9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:21.250597 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 955/1903] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:21.254857 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fffc29-670a-4df7-b540-21d974372a59 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:21.366276 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fffc29-670a-4df7-b540-21d974372a59 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:21.372539 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edbe28c-a0ce-4b4e-887b-0033de195878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:21.373444 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edbe28c-a0ce-4b4e-887b-0033de195878 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:21.373946 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edbe28c-a0ce-4b4e-887b-0033de195878 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:21.374507 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edbe28c-a0ce-4b4e-887b-0033de195878 admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:21.376525 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edbe28c-a0ce-4b4e-887b-0033de195878 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:21.378569 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edbe28c-a0ce-4b4e-887b-0033de195878 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:21.408795 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 949/1904] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:52:21 2022] POST /identity/v3/projects => generated 387 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:52:21.412600 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa3cc9-06a0-46b9-a575-22ddd2e2a9e9 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:21.424343 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa3cc9-06a0-46b9-a575-22ddd2e2a9e9 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:21.552041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76388ac6-9438-4a41-ac42-33308a0d6e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:21.552803 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76388ac6-9438-4a41-ac42-33308a0d6e29 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:21.553157 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76388ac6-9438-4a41-ac42-33308a0d6e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:21.553737 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76388ac6-9438-4a41-ac42-33308a0d6e29 admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:21.555227 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76388ac6-9438-4a41-ac42-33308a0d6e29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:21.558507 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76388ac6-9438-4a41-ac42-33308a0d6e29 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:21.585556 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 956/1905] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:52:21 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:52:21.588835 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edbe28c-a0ce-4b4e-887b-0033de195878 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:21.599054 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edbe28c-a0ce-4b4e-887b-0033de195878 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:21.604556 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d5b0f-f0a4-46b6-8d34-7376862d12fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:21.605991 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d5b0f-f0a4-46b6-8d34-7376862d12fa admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:21.606281 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d5b0f-f0a4-46b6-8d34-7376862d12fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:21.606550 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d5b0f-f0a4-46b6-8d34-7376862d12fa admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:21.607317 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d5b0f-f0a4-46b6-8d34-7376862d12fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:21.608832 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d5b0f-f0a4-46b6-8d34-7376862d12fa admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:21.621693 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 950/1906] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:52:21.626035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76388ac6-9438-4a41-ac42-33308a0d6e29 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:21.636040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76388ac6-9438-4a41-ac42-33308a0d6e29 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:21.640940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a82e8-9951-4136-ae73-64cb44816d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:21.641640 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a82e8-9951-4136-ae73-64cb44816d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:21.641924 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a82e8-9951-4136-ae73-64cb44816d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:21.642219 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a82e8-9951-4136-ae73-64cb44816d31 admin admin] PATH_INFO: `/v3/projects/899969ab64f24c93b0ccea0547ae50ba/users/a2ba8ecb02c44b59b02a500463b995ee/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:21.659225 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a82e8-9951-4136-ae73-64cb44816d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=899969ab64f24c93b0ccea0547ae50ba, user_id=a2ba8ecb02c44b59b02a500463b995ee, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:21.662027 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a82e8-9951-4136-ae73-64cb44816d31 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:21.680344 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 957/1907] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:52:21 2022] PUT /identity/v3/projects/899969ab64f24c93b0ccea0547ae50ba/users/a2ba8ecb02c44b59b02a500463b995ee/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:21.684518 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d5b0f-f0a4-46b6-8d34-7376862d12fa admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:21.695293 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d5b0f-f0a4-46b6-8d34-7376862d12fa admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:21.754786 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3177d298-b110-475d-9619-1483fc8b07f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:21.755414 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3177d298-b110-475d-9619-1483fc8b07f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:21.755705 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3177d298-b110-475d-9619-1483fc8b07f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:21.755983 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3177d298-b110-475d-9619-1483fc8b07f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:21.756683 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3177d298-b110-475d-9619-1483fc8b07f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:21.758385 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3177d298-b110-475d-9619-1483fc8b07f7 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:21.771117 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 951/1908] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:52:21.773569 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a82e8-9951-4136-ae73-64cb44816d31 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:21.784140 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a82e8-9951-4136-ae73-64cb44816d31 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:21.789672 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a368755-83e5-4286-8263-95a06d2bcfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:21.790453 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a368755-83e5-4286-8263-95a06d2bcfbf admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:21.790835 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a368755-83e5-4286-8263-95a06d2bcfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:21.791205 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a368755-83e5-4286-8263-95a06d2bcfbf admin admin] PATH_INFO: `/v3/projects/899969ab64f24c93b0ccea0547ae50ba/users/a2ba8ecb02c44b59b02a500463b995ee/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:21.793291 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a368755-83e5-4286-8263-95a06d2bcfbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=899969ab64f24c93b0ccea0547ae50ba, user_id=a2ba8ecb02c44b59b02a500463b995ee, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:21.796081 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a368755-83e5-4286-8263-95a06d2bcfbf admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:21.803360 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:21.809482 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 958/1909] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:52:21 2022] PUT /identity/v3/projects/899969ab64f24c93b0ccea0547ae50ba/users/a2ba8ecb02c44b59b02a500463b995ee/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:21.820866 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d29b72-5841-4adf-b254-e0e41b068b69 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:21.821083 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d29b72-5841-4adf-b254-e0e41b068b69 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:21.821374 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d29b72-5841-4adf-b254-e0e41b068b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:21.855902 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-d2d29b72-5841-4adf-b254-e0e41b068b69 None None] MFA Rules not processed for user `a2ba8ecb02c44b59b02a500463b995ee`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:21.857189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-d2d29b72-5841-4adf-b254-e0e41b068b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:21.902758 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:21.948878 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 952/1910] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:21 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:21.959924 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a368755-83e5-4286-8263-95a06d2bcfbf admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:21.963116 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-8a368755-83e5-4286-8263-95a06d2bcfbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:22.032538 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a368755-83e5-4286-8263-95a06d2bcfbf admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:22.036379 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1c160-3053-4508-ab76-bdab07469f42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:22.037002 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1c160-3053-4508-ab76-bdab07469f42 service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:22.037291 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1c160-3053-4508-ab76-bdab07469f42 service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:22.037601 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1c160-3053-4508-ab76-bdab07469f42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:22.046631 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1c160-3053-4508-ab76-bdab07469f42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:22.048078 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1c160-3053-4508-ab76-bdab07469f42 service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:22.057423 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 959/1911] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:21 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:52:22.710304 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d29b72-5841-4adf-b254-e0e41b068b69 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:22.820478 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d29b72-5841-4adf-b254-e0e41b068b69 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:22.827686 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12a3f2-c5a3-4be7-9649-9c5dba5770d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:22.828472 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12a3f2-c5a3-4be7-9649-9c5dba5770d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:22.828856 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12a3f2-c5a3-4be7-9649-9c5dba5770d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:22.829236 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12a3f2-c5a3-4be7-9649-9c5dba5770d5 admin admin] PATH_INFO: `/v3/users/380285fab2e3456cacac005fc550a37c` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:22.830526 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12a3f2-c5a3-4be7-9649-9c5dba5770d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=380285fab2e3456cacac005fc550a37c)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:22.833316 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12a3f2-c5a3-4be7-9649-9c5dba5770d5 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:22.901413 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-fa12a3f2-c5a3-4be7-9649-9c5dba5770d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '380285fab2e3456cacac005fc550a37c'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:22.911118 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-fa12a3f2-c5a3-4be7-9649-9c5dba5770d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '380285fab2e3456cacac005fc550a37c'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:22.912383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-fa12a3f2-c5a3-4be7-9649-9c5dba5770d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '380285fab2e3456cacac005fc550a37c'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:22.915581 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-fa12a3f2-c5a3-4be7-9649-9c5dba5770d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '380285fab2e3456cacac005fc550a37c'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:22.930273 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-fa12a3f2-c5a3-4be7-9649-9c5dba5770d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '380285fab2e3456cacac005fc550a37c'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:22.948107 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 953/1912] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:52:22 2022] DELETE /identity/v3/users/380285fab2e3456cacac005fc550a37c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:22.952636 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbb309-e9f1-4ba9-b18d-716942ca8952 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:22.952923 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbb309-e9f1-4ba9-b18d-716942ca8952 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:22.953199 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbb309-e9f1-4ba9-b18d-716942ca8952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:22.973716 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-14bbb309-e9f1-4ba9-b18d-716942ca8952 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:22.974875 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-14bbb309-e9f1-4ba9-b18d-716942ca8952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:23.042730 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 960/1913] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:23.052356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12a3f2-c5a3-4be7-9649-9c5dba5770d5 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:23.054039 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-fa12a3f2-c5a3-4be7-9649-9c5dba5770d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:23.122980 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:23.127851 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12a3f2-c5a3-4be7-9649-9c5dba5770d5 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:23.132979 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3129d1-e602-4bec-9ebd-4b31b36410f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:23.133800 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3129d1-e602-4bec-9ebd-4b31b36410f8 service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:23.134013 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3129d1-e602-4bec-9ebd-4b31b36410f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:23.134646 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3129d1-e602-4bec-9ebd-4b31b36410f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:23.144568 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3129d1-e602-4bec-9ebd-4b31b36410f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:23.146046 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3129d1-e602-4bec-9ebd-4b31b36410f8 service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:23.156574 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 954/1914] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:23.436744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbb309-e9f1-4ba9-b18d-716942ca8952 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:23.438549 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-14bbb309-e9f1-4ba9-b18d-716942ca8952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:23.452169 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbb309-e9f1-4ba9-b18d-716942ca8952 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:23.456762 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8eaf70-e93e-4fb9-9cb5-66e50f29c28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:23.457489 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8eaf70-e93e-4fb9-9cb5-66e50f29c28a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:23.457799 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8eaf70-e93e-4fb9-9cb5-66e50f29c28a admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:23.458104 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8eaf70-e93e-4fb9-9cb5-66e50f29c28a admin admin] PATH_INFO: `/v3/projects/c3eb2f6d734942538161a61790ec1783` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:23.459270 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8eaf70-e93e-4fb9-9cb5-66e50f29c28a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3eb2f6d734942538161a61790ec1783)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:23.462206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8eaf70-e93e-4fb9-9cb5-66e50f29c28a admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:23.516472 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-ad8eaf70-e93e-4fb9-9cb5-66e50f29c28a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3eb2f6d734942538161a61790ec1783', 'request_id': 'req-ad8eaf70-e93e-4fb9-9cb5-66e50f29c28a'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:23.529865 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-ad8eaf70-e93e-4fb9-9cb5-66e50f29c28a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3eb2f6d734942538161a61790ec1783', 'request_id': 'req-ad8eaf70-e93e-4fb9-9cb5-66e50f29c28a'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:23.540391 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-ad8eaf70-e93e-4fb9-9cb5-66e50f29c28a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3eb2f6d734942538161a61790ec1783', 'request_id': 'req-ad8eaf70-e93e-4fb9-9cb5-66e50f29c28a'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:23.553287 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-ad8eaf70-e93e-4fb9-9cb5-66e50f29c28a admin admin] The token cache is being invalidate because project c3eb2f6d734942538161a61790ec1783 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:52:23.553617 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-ad8eaf70-e93e-4fb9-9cb5-66e50f29c28a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:23.554317 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-ad8eaf70-e93e-4fb9-9cb5-66e50f29c28a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:23.555933 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 961/1915] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:52:23 2022] DELETE /identity/v3/projects/c3eb2f6d734942538161a61790ec1783 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:52:23.559827 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3129d1-e602-4bec-9ebd-4b31b36410f8 service neutron] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:23.570706 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3129d1-e602-4bec-9ebd-4b31b36410f8 service neutron] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:23.629853 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f53c6-794c-42ca-9a3c-8b09752c5c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:23.630501 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f53c6-794c-42ca-9a3c-8b09752c5c61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:23.631188 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f53c6-794c-42ca-9a3c-8b09752c5c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:23.631188 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f53c6-794c-42ca-9a3c-8b09752c5c61 admin admin] PATH_INFO: `/v3/users/a2ba8ecb02c44b59b02a500463b995ee` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:23.632742 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f53c6-794c-42ca-9a3c-8b09752c5c61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2ba8ecb02c44b59b02a500463b995ee)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:23.634841 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f53c6-794c-42ca-9a3c-8b09752c5c61 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:23.696875 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-586f53c6-794c-42ca-9a3c-8b09752c5c61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2ba8ecb02c44b59b02a500463b995ee'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:23.705840 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-586f53c6-794c-42ca-9a3c-8b09752c5c61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2ba8ecb02c44b59b02a500463b995ee'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:23.706459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-586f53c6-794c-42ca-9a3c-8b09752c5c61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2ba8ecb02c44b59b02a500463b995ee'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:23.707113 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-586f53c6-794c-42ca-9a3c-8b09752c5c61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2ba8ecb02c44b59b02a500463b995ee'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:23.722951 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-586f53c6-794c-42ca-9a3c-8b09752c5c61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2ba8ecb02c44b59b02a500463b995ee'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:23.736466 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 955/1916] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:52:23 2022] DELETE /identity/v3/users/a2ba8ecb02c44b59b02a500463b995ee => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:23.897338 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8eaf70-e93e-4fb9-9cb5-66e50f29c28a admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:23.899618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-ad8eaf70-e93e-4fb9-9cb5-66e50f29c28a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:23.913243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8eaf70-e93e-4fb9-9cb5-66e50f29c28a admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:23.939906 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:23.978254 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b9b1d-7cdc-4fa4-8025-a25567b5fde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:23.978991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b9b1d-7cdc-4fa4-8025-a25567b5fde7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:23.979276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b9b1d-7cdc-4fa4-8025-a25567b5fde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:23.979544 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b9b1d-7cdc-4fa4-8025-a25567b5fde7 admin admin] PATH_INFO: `/v3/users/34e38b633189478eb90956537207c643` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:23.980701 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b9b1d-7cdc-4fa4-8025-a25567b5fde7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34e38b633189478eb90956537207c643)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:23.982687 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b9b1d-7cdc-4fa4-8025-a25567b5fde7 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:24.040603 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-753b9b1d-7cdc-4fa4-8025-a25567b5fde7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34e38b633189478eb90956537207c643'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:24.041190 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-753b9b1d-7cdc-4fa4-8025-a25567b5fde7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34e38b633189478eb90956537207c643'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:24.041926 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-753b9b1d-7cdc-4fa4-8025-a25567b5fde7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34e38b633189478eb90956537207c643'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:24.057339 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-753b9b1d-7cdc-4fa4-8025-a25567b5fde7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34e38b633189478eb90956537207c643'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:24.067003 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-753b9b1d-7cdc-4fa4-8025-a25567b5fde7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34e38b633189478eb90956537207c643'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:24.088703 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 962/1917] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:52:23 2022] DELETE /identity/v3/users/34e38b633189478eb90956537207c643 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:24.093256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb61db2-bc04-49d4-9a2d-ffc23c84da7f None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:24.093535 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb61db2-bc04-49d4-9a2d-ffc23c84da7f None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:24.093923 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb61db2-bc04-49d4-9a2d-ffc23c84da7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:24.137158 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-7bb61db2-bc04-49d4-9a2d-ffc23c84da7f None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:24.138695 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-7bb61db2-bc04-49d4-9a2d-ffc23c84da7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:24.213285 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 956/1918] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:24.237472 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b9b1d-7cdc-4fa4-8025-a25567b5fde7 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:24.238977 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-753b9b1d-7cdc-4fa4-8025-a25567b5fde7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:24.323901 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b9b1d-7cdc-4fa4-8025-a25567b5fde7 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:24.328098 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2ab12-7085-4b06-919b-b2dc029b9b19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:24.329120 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2ab12-7085-4b06-919b-b2dc029b9b19 service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:24.329120 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2ab12-7085-4b06-919b-b2dc029b9b19 service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:24.329330 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2ab12-7085-4b06-919b-b2dc029b9b19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:24.347332 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2ab12-7085-4b06-919b-b2dc029b9b19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:24.349315 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2ab12-7085-4b06-919b-b2dc029b9b19 service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:24.369967 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb61db2-bc04-49d4-9a2d-ffc23c84da7f None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:24.372119 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 963/1919] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:24.377579 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-7bb61db2-bc04-49d4-9a2d-ffc23c84da7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:24.401579 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb61db2-bc04-49d4-9a2d-ffc23c84da7f None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:24.426497 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efac7b0-4520-4826-af15-a702a27f53d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:24.427438 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efac7b0-4520-4826-af15-a702a27f53d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:24.428067 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efac7b0-4520-4826-af15-a702a27f53d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:24.428739 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efac7b0-4520-4826-af15-a702a27f53d8 admin admin] PATH_INFO: `/v3/projects/899969ab64f24c93b0ccea0547ae50ba` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:24.431646 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efac7b0-4520-4826-af15-a702a27f53d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=899969ab64f24c93b0ccea0547ae50ba)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:24.434148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efac7b0-4520-4826-af15-a702a27f53d8 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:24.446253 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:24.496134 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-5efac7b0-4520-4826-af15-a702a27f53d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '899969ab64f24c93b0ccea0547ae50ba', 'request_id': 'req-5efac7b0-4520-4826-af15-a702a27f53d8'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:24.503405 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-5efac7b0-4520-4826-af15-a702a27f53d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '899969ab64f24c93b0ccea0547ae50ba', 'request_id': 'req-5efac7b0-4520-4826-af15-a702a27f53d8'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:24.510243 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-5efac7b0-4520-4826-af15-a702a27f53d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '899969ab64f24c93b0ccea0547ae50ba', 'request_id': 'req-5efac7b0-4520-4826-af15-a702a27f53d8'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:24.524931 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-5efac7b0-4520-4826-af15-a702a27f53d8 admin admin] The token cache is being invalidate because project 899969ab64f24c93b0ccea0547ae50ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:52:24.525222 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-5efac7b0-4520-4826-af15-a702a27f53d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:24.525942 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-5efac7b0-4520-4826-af15-a702a27f53d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:24.527543 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 957/1920] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:52:24 2022] DELETE /identity/v3/projects/899969ab64f24c93b0ccea0547ae50ba => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:24.532482 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f2dad-2aef-4de2-84dd-4b14e3ed7292 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:24.532777 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f2dad-2aef-4de2-84dd-4b14e3ed7292 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:24.533078 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f2dad-2aef-4de2-84dd-4b14e3ed7292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:24.556179 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-da8f2dad-2aef-4de2-84dd-4b14e3ed7292 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:24.558043 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-da8f2dad-2aef-4de2-84dd-4b14e3ed7292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:24.620857 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:24.661595 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 964/1921] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:24.670131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76525a9-6950-405b-ab54-86656ede34d6 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:24.670684 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76525a9-6950-405b-ab54-86656ede34d6 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:24.670967 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76525a9-6950-405b-ab54-86656ede34d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:24.698145 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-a76525a9-6950-405b-ab54-86656ede34d6 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:24.699748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-a76525a9-6950-405b-ab54-86656ede34d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:24.711864 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 958/1922] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:24.716468 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f2dad-2aef-4de2-84dd-4b14e3ed7292 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:24.729578 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f2dad-2aef-4de2-84dd-4b14e3ed7292 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:24.734565 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0f1d2-a98d-47d9-ad0d-3a821ab012b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:24.735379 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0f1d2-a98d-47d9-ad0d-3a821ab012b2 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:24.735499 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0f1d2-a98d-47d9-ad0d-3a821ab012b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:24.735726 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0f1d2-a98d-47d9-ad0d-3a821ab012b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:24.736438 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0f1d2-a98d-47d9-ad0d-3a821ab012b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:24.736759 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0f1d2-a98d-47d9-ad0d-3a821ab012b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:24.738679 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0f1d2-a98d-47d9-ad0d-3a821ab012b2 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:24.754017 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 965/1923] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:24.756879 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76525a9-6950-405b-ab54-86656ede34d6 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:24.770513 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76525a9-6950-405b-ab54-86656ede34d6 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:24.777060 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265edb5-68c6-443c-8d99-b958c8a918ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:24.777864 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265edb5-68c6-443c-8d99-b958c8a918ad admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:24.778871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265edb5-68c6-443c-8d99-b958c8a918ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:24.778871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265edb5-68c6-443c-8d99-b958c8a918ad admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:24.779132 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c265edb5-68c6-443c-8d99-b958c8a918ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:24.782103 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c265edb5-68c6-443c-8d99-b958c8a918ad admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:24.818058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 959/1924] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:52:24 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:52:24.819798 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0f1d2-a98d-47d9-ad0d-3a821ab012b2 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:24.830679 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0f1d2-a98d-47d9-ad0d-3a821ab012b2 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:24.900825 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b855c-a04d-4d7a-a9a1-a33780d76729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:24.901427 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b855c-a04d-4d7a-a9a1-a33780d76729 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:24.901804 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b855c-a04d-4d7a-a9a1-a33780d76729 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:24.902153 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b855c-a04d-4d7a-a9a1-a33780d76729 admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:24.902900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b855c-a04d-4d7a-a9a1-a33780d76729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:24.905342 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b855c-a04d-4d7a-a9a1-a33780d76729 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:24.934466 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 966/1925] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:52:24 2022] POST /identity/v3/users => generated 286 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:52:24.935740 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265edb5-68c6-443c-8d99-b958c8a918ad admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:24.952526 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265edb5-68c6-443c-8d99-b958c8a918ad admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:24.964511 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b4dc2-0510-4b8f-80c2-52ad88250869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:24.965572 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b4dc2-0510-4b8f-80c2-52ad88250869 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:24.965870 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b4dc2-0510-4b8f-80c2-52ad88250869 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:24.966150 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b4dc2-0510-4b8f-80c2-52ad88250869 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:24.966942 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b4dc2-0510-4b8f-80c2-52ad88250869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:24.968558 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b4dc2-0510-4b8f-80c2-52ad88250869 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:24.986395 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 960/1926] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:52:24.986487 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b855c-a04d-4d7a-a9a1-a33780d76729 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:24.988413 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b4dc2-0510-4b8f-80c2-52ad88250869 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:24.988549 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-796b855c-a04d-4d7a-a9a1-a33780d76729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:25.006303 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b4dc2-0510-4b8f-80c2-52ad88250869 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:25.009722 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b855c-a04d-4d7a-a9a1-a33780d76729 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:25.011978 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f968e-c57c-4e43-8627-f95cb285b2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:25.012605 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f968e-c57c-4e43-8627-f95cb285b2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:25.012892 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f968e-c57c-4e43-8627-f95cb285b2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:25.013167 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f968e-c57c-4e43-8627-f95cb285b2a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:25.013912 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f968e-c57c-4e43-8627-f95cb285b2a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:25.014693 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54732cdb-b838-4b41-b49d-259675ba69a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:25.015472 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54732cdb-b838-4b41-b49d-259675ba69a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:25.015594 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f968e-c57c-4e43-8627-f95cb285b2a9 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:25.015837 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54732cdb-b838-4b41-b49d-259675ba69a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:25.017239 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54732cdb-b838-4b41-b49d-259675ba69a5 admin admin] PATH_INFO: `/v3/projects/cf5e0f405680438193ba5bd7e5905cdb` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:25.018215 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54732cdb-b838-4b41-b49d-259675ba69a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf5e0f405680438193ba5bd7e5905cdb)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:25.020448 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54732cdb-b838-4b41-b49d-259675ba69a5 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:25.027020 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 961/1927] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:52:25.030958 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f968e-c57c-4e43-8627-f95cb285b2a9 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:25.048120 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f968e-c57c-4e43-8627-f95cb285b2a9 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:25.055310 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e922a-6f66-4ea4-be7b-eae6a0fd134e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:25.056511 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e922a-6f66-4ea4-be7b-eae6a0fd134e admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:25.056511 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e922a-6f66-4ea4-be7b-eae6a0fd134e admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:25.056887 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e922a-6f66-4ea4-be7b-eae6a0fd134e admin admin] PATH_INFO: `/v3/projects/ee59cfe3e4e947458bb26e759e40d732/users/b5a2205daf6043e3869dceb39356a82b/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:25.072949 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e922a-6f66-4ea4-be7b-eae6a0fd134e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee59cfe3e4e947458bb26e759e40d732, user_id=b5a2205daf6043e3869dceb39356a82b, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:25.075401 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-54732cdb-b838-4b41-b49d-259675ba69a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf5e0f405680438193ba5bd7e5905cdb', 'request_id': 'req-54732cdb-b838-4b41-b49d-259675ba69a5'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:25.075719 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e922a-6f66-4ea4-be7b-eae6a0fd134e admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:25.083839 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-54732cdb-b838-4b41-b49d-259675ba69a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf5e0f405680438193ba5bd7e5905cdb', 'request_id': 'req-54732cdb-b838-4b41-b49d-259675ba69a5'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:25.092499 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-54732cdb-b838-4b41-b49d-259675ba69a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf5e0f405680438193ba5bd7e5905cdb', 'request_id': 'req-54732cdb-b838-4b41-b49d-259675ba69a5'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:25.093134 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 962/1928] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:52:25 2022] PUT /identity/v3/projects/ee59cfe3e4e947458bb26e759e40d732/users/b5a2205daf6043e3869dceb39356a82b/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:52:25.104683 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d2ee5-1b65-429b-9b27-c47de5a92a10 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:25.104969 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d2ee5-1b65-429b-9b27-c47de5a92a10 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:25.105250 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d2ee5-1b65-429b-9b27-c47de5a92a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:25.107765 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-54732cdb-b838-4b41-b49d-259675ba69a5 admin admin] The token cache is being invalidate because project cf5e0f405680438193ba5bd7e5905cdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:52:25.108151 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-54732cdb-b838-4b41-b49d-259675ba69a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:25.108974 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-54732cdb-b838-4b41-b49d-259675ba69a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:25.110804 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 967/1929] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:52:24 2022] DELETE /identity/v3/projects/cf5e0f405680438193ba5bd7e5905cdb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:52:25.114491 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54732cdb-b838-4b41-b49d-259675ba69a5 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:25.116166 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-54732cdb-b838-4b41-b49d-259675ba69a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:25.145879 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-d09d2ee5-1b65-429b-9b27-c47de5a92a10 None None] MFA Rules not processed for user `b5a2205daf6043e3869dceb39356a82b`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:25.148365 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-d09d2ee5-1b65-429b-9b27-c47de5a92a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:25.187616 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:25.211404 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54732cdb-b838-4b41-b49d-259675ba69a5 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:25.290766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 963/1930] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:52:25.292772 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a131a56-5a9d-49c2-b418-10d4f0afd9c8 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:25.293271 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a131a56-5a9d-49c2-b418-10d4f0afd9c8 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:25.293711 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a131a56-5a9d-49c2-b418-10d4f0afd9c8 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:25.295971 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 964/1931] 10.222.0.46 () {54 vars in 921 bytes} [Wed Aug 3 12:52:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:52:25.302462 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1caf7-d1fc-4dcf-86b8-0caacb0bc327 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:25.302824 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1caf7-d1fc-4dcf-86b8-0caacb0bc327 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:25.303171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1caf7-d1fc-4dcf-86b8-0caacb0bc327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:25.316734 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3698c-f3c9-48f5-83ac-e639b8925ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:25.317836 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3698c-f3c9-48f5-83ac-e639b8925ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:25.318336 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3698c-f3c9-48f5-83ac-e639b8925ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:25.318629 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3698c-f3c9-48f5-83ac-e639b8925ea7 admin admin] PATH_INFO: `/v3/users/c784894eb86b4099b8816884541caa22` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:25.320047 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3698c-f3c9-48f5-83ac-e639b8925ea7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c784894eb86b4099b8816884541caa22)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:25.322621 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3698c-f3c9-48f5-83ac-e639b8925ea7 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:25.326116 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-e5a1caf7-d1fc-4dcf-86b8-0caacb0bc327 None None] MFA Rules not processed for user `dcf670ff4f62486dbf70cf6ea0f08bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:25.327348 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-e5a1caf7-d1fc-4dcf-86b8-0caacb0bc327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:25.332769 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:25.382259 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-d4d3698c-f3c9-48f5-83ac-e639b8925ea7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c784894eb86b4099b8816884541caa22'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:25.383640 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-d4d3698c-f3c9-48f5-83ac-e639b8925ea7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c784894eb86b4099b8816884541caa22'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:25.386159 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-d4d3698c-f3c9-48f5-83ac-e639b8925ea7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c784894eb86b4099b8816884541caa22'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:25.405779 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-d4d3698c-f3c9-48f5-83ac-e639b8925ea7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c784894eb86b4099b8816884541caa22'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:25.411507 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 965/1932] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Aug 3 12:52:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:25.412403 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1caf7-d1fc-4dcf-86b8-0caacb0bc327 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:25.414725 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-e5a1caf7-d1fc-4dcf-86b8-0caacb0bc327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:25.424728 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-d4d3698c-f3c9-48f5-83ac-e639b8925ea7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c784894eb86b4099b8816884541caa22'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:25.469018 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 968/1933] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:52:25 2022] DELETE /identity/v3/users/c784894eb86b4099b8816884541caa22 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:52:25.501584 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1caf7-d1fc-4dcf-86b8-0caacb0bc327 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:25.561378 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74311b3-3627-46aa-b439-8019d4fc0348 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:25.562500 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74311b3-3627-46aa-b439-8019d4fc0348 service cinder] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:25.562500 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74311b3-3627-46aa-b439-8019d4fc0348 service cinder] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:25.562787 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74311b3-3627-46aa-b439-8019d4fc0348 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:25.565360 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-d74311b3-3627-46aa-b439-8019d4fc0348 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:25.685088 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3698c-f3c9-48f5-83ac-e639b8925ea7 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:25.687092 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-d4d3698c-f3c9-48f5-83ac-e639b8925ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:25.708236 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74311b3-3627-46aa-b439-8019d4fc0348 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:25.709755 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74311b3-3627-46aa-b439-8019d4fc0348 service cinder] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:25.724490 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 966/1934] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:25.749354 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74311b3-3627-46aa-b439-8019d4fc0348 service cinder] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:25.751320 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-d74311b3-3627-46aa-b439-8019d4fc0348 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:25.773701 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:25.803704 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3698c-f3c9-48f5-83ac-e639b8925ea7 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:25.811019 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0518c-a7cf-4847-82e5-5db4e77d302c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:25.811653 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0518c-a7cf-4847-82e5-5db4e77d302c service nova] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:25.811940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0518c-a7cf-4847-82e5-5db4e77d302c service nova] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:25.812217 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0518c-a7cf-4847-82e5-5db4e77d302c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:25.829116 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0518c-a7cf-4847-82e5-5db4e77d302c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:25.829116 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0518c-a7cf-4847-82e5-5db4e77d302c service nova] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:25.836254 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:25.845793 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 969/1935] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:25.876203 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74311b3-3627-46aa-b439-8019d4fc0348 service cinder] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:25.881771 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6f6a8-4454-45ae-99af-c055c72fb755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:25.883112 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6f6a8-4454-45ae-99af-c055c72fb755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:25.883421 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6f6a8-4454-45ae-99af-c055c72fb755 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:25.883698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6f6a8-4454-45ae-99af-c055c72fb755 admin admin] PATH_INFO: `/v3/users/b5a2205daf6043e3869dceb39356a82b` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:25.884913 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6f6a8-4454-45ae-99af-c055c72fb755 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5a2205daf6043e3869dceb39356a82b)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:25.886997 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6f6a8-4454-45ae-99af-c055c72fb755 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:25.956878 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0518c-a7cf-4847-82e5-5db4e77d302c service nova] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:25.961283 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-d2d0518c-a7cf-4847-82e5-5db4e77d302c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:25.963820 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-f9b6f6a8-4454-45ae-99af-c055c72fb755 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5a2205daf6043e3869dceb39356a82b'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:25.974890 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-f9b6f6a8-4454-45ae-99af-c055c72fb755 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5a2205daf6043e3869dceb39356a82b'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:25.975626 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-f9b6f6a8-4454-45ae-99af-c055c72fb755 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5a2205daf6043e3869dceb39356a82b'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:25.976703 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-f9b6f6a8-4454-45ae-99af-c055c72fb755 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5a2205daf6043e3869dceb39356a82b'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:25.980881 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0518c-a7cf-4847-82e5-5db4e77d302c service nova] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:25.987200 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125cd660-0f50-4022-aceb-78fede675567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:25.987848 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125cd660-0f50-4022-aceb-78fede675567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:25.988132 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125cd660-0f50-4022-aceb-78fede675567 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:25.988584 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125cd660-0f50-4022-aceb-78fede675567 admin admin] PATH_INFO: `/v3/projects/e0e3d689f2574e0a800fe4ab768a7ed3` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:25.990022 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125cd660-0f50-4022-aceb-78fede675567 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0e3d689f2574e0a800fe4ab768a7ed3)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:25.992466 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-f9b6f6a8-4454-45ae-99af-c055c72fb755 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5a2205daf6043e3869dceb39356a82b'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:25.993401 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125cd660-0f50-4022-aceb-78fede675567 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:26.013545 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 967/1936] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:52:25 2022] DELETE /identity/v3/users/b5a2205daf6043e3869dceb39356a82b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:52:26.019963 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a44cd3-eccb-4419-961a-724a93d7a6d7 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:26.020415 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a44cd3-eccb-4419-961a-724a93d7a6d7 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:26.021048 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a44cd3-eccb-4419-961a-724a93d7a6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:26.057083 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-87a44cd3-eccb-4419-961a-724a93d7a6d7 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:26.058390 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-87a44cd3-eccb-4419-961a-724a93d7a6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:26.058532 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-125cd660-0f50-4022-aceb-78fede675567 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0e3d689f2574e0a800fe4ab768a7ed3', 'request_id': 'req-125cd660-0f50-4022-aceb-78fede675567'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:26.066757 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-125cd660-0f50-4022-aceb-78fede675567 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0e3d689f2574e0a800fe4ab768a7ed3', 'request_id': 'req-125cd660-0f50-4022-aceb-78fede675567'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:26.079350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-125cd660-0f50-4022-aceb-78fede675567 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0e3d689f2574e0a800fe4ab768a7ed3', 'request_id': 'req-125cd660-0f50-4022-aceb-78fede675567'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:26.095825 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-125cd660-0f50-4022-aceb-78fede675567 admin admin] The token cache is being invalidate because project e0e3d689f2574e0a800fe4ab768a7ed3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:52:26.096221 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-125cd660-0f50-4022-aceb-78fede675567 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:26.096979 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-125cd660-0f50-4022-aceb-78fede675567 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:26.099755 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 970/1937] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:52:25 2022] DELETE /identity/v3/projects/e0e3d689f2574e0a800fe4ab768a7ed3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:26.107319 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f84e8-25cd-4997-a273-1ddffa8fd467 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:26.107618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f84e8-25cd-4997-a273-1ddffa8fd467 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:26.107901 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f84e8-25cd-4997-a273-1ddffa8fd467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:26.133066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-932f84e8-25cd-4997-a273-1ddffa8fd467 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:26.134450 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-932f84e8-25cd-4997-a273-1ddffa8fd467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:26.139370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 968/1938] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:26.143011 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 971/1939] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:26.151542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077483a-0cce-4d70-982a-c8bf02cbbd65 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:26.151829 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077483a-0cce-4d70-982a-c8bf02cbbd65 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:26.152108 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077483a-0cce-4d70-982a-c8bf02cbbd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:26.156332 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f84e8-25cd-4997-a273-1ddffa8fd467 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:26.158059 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-932f84e8-25cd-4997-a273-1ddffa8fd467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:26.175075 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-9077483a-0cce-4d70-982a-c8bf02cbbd65 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:26.176302 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-9077483a-0cce-4d70-982a-c8bf02cbbd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:26.186000 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 969/1940] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:26.190522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077483a-0cce-4d70-982a-c8bf02cbbd65 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:26.202257 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077483a-0cce-4d70-982a-c8bf02cbbd65 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:26.207111 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0423a-6b09-43ac-b616-fea5ddf44331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:26.207805 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0423a-6b09-43ac-b616-fea5ddf44331 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:26.208091 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0423a-6b09-43ac-b616-fea5ddf44331 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:26.208365 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0423a-6b09-43ac-b616-fea5ddf44331 admin admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:26.209061 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce0423a-6b09-43ac-b616-fea5ddf44331 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:26.209393 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce0423a-6b09-43ac-b616-fea5ddf44331 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:26.211069 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce0423a-6b09-43ac-b616-fea5ddf44331 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:26.225552 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 970/1941] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:52:26.227697 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0423a-6b09-43ac-b616-fea5ddf44331 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:26.233041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f84e8-25cd-4997-a273-1ddffa8fd467 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:26.236669 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d641f-d254-4931-9c07-ecac88f5afdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:26.237382 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d641f-d254-4931-9c07-ecac88f5afdd service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:26.237693 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d641f-d254-4931-9c07-ecac88f5afdd service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:26.237788 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0423a-6b09-43ac-b616-fea5ddf44331 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:26.237970 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d641f-d254-4931-9c07-ecac88f5afdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:26.243031 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d29601-067c-4cd6-9235-db922e89aad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:26.243632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d29601-067c-4cd6-9235-db922e89aad1 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:26.243913 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d29601-067c-4cd6-9235-db922e89aad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:26.244190 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d29601-067c-4cd6-9235-db922e89aad1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:26.244839 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d29601-067c-4cd6-9235-db922e89aad1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:26.246803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d29601-067c-4cd6-9235-db922e89aad1 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:26.247629 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d641f-d254-4931-9c07-ecac88f5afdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:26.249054 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d641f-d254-4931-9c07-ecac88f5afdd service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:26.258247 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:26.259274 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 972/1942] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:52:26.277782 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 971/1943] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:52:26 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:52:26.281842 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d641f-d254-4931-9c07-ecac88f5afdd service neutron] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:26.292022 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d641f-d254-4931-9c07-ecac88f5afdd service neutron] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:26.354747 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0721f-c9d1-43e5-af3f-b453e7cf767b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:26.355272 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0721f-c9d1-43e5-af3f-b453e7cf767b admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:26.355587 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0721f-c9d1-43e5-af3f-b453e7cf767b admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:26.355871 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0721f-c9d1-43e5-af3f-b453e7cf767b admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:26.356519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f0721f-c9d1-43e5-af3f-b453e7cf767b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:26.358489 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f0721f-c9d1-43e5-af3f-b453e7cf767b admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:26.380166 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 973/1944] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:52:26 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:52:26.385324 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d29601-067c-4cd6-9235-db922e89aad1 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:26.396143 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d29601-067c-4cd6-9235-db922e89aad1 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:26.402002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a18d9-92cb-4009-bdf7-640819573342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:26.402688 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a18d9-92cb-4009-bdf7-640819573342 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:26.402973 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a18d9-92cb-4009-bdf7-640819573342 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:26.403248 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a18d9-92cb-4009-bdf7-640819573342 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:26.403953 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a18d9-92cb-4009-bdf7-640819573342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:26.405626 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a18d9-92cb-4009-bdf7-640819573342 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:26.420798 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 972/1945] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:52:26.425738 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0721f-c9d1-43e5-af3f-b453e7cf767b admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:26.438866 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0721f-c9d1-43e5-af3f-b453e7cf767b admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:26.444904 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809444d7-e495-4d73-9573-b0e2fe1bdd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:26.445562 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809444d7-e495-4d73-9573-b0e2fe1bdd75 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:26.445851 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809444d7-e495-4d73-9573-b0e2fe1bdd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:26.446126 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809444d7-e495-4d73-9573-b0e2fe1bdd75 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:26.446849 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809444d7-e495-4d73-9573-b0e2fe1bdd75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:26.448435 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809444d7-e495-4d73-9573-b0e2fe1bdd75 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:26.452848 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:26.467128 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a18d9-92cb-4009-bdf7-640819573342 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:26.468225 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 974/1946] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:52:26.481078 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a18d9-92cb-4009-bdf7-640819573342 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:26.485994 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc953eb0-68c4-4b11-8893-5793417a2249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:26.486734 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc953eb0-68c4-4b11-8893-5793417a2249 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:26.487021 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc953eb0-68c4-4b11-8893-5793417a2249 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:26.487530 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc953eb0-68c4-4b11-8893-5793417a2249 admin admin] PATH_INFO: `/v3/projects/82af5128630143e38f3a7a70629efd74/users/133ee5ab1bdd4c44906fc197d825b0bf/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:26.508066 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc953eb0-68c4-4b11-8893-5793417a2249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82af5128630143e38f3a7a70629efd74, user_id=133ee5ab1bdd4c44906fc197d825b0bf, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:26.511177 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc953eb0-68c4-4b11-8893-5793417a2249 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:26.525614 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 973/1947] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:52:26 2022] PUT /identity/v3/projects/82af5128630143e38f3a7a70629efd74/users/133ee5ab1bdd4c44906fc197d825b0bf/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:26.541254 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba61aa-9aeb-4609-8125-3594a9a49838 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:26.541568 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba61aa-9aeb-4609-8125-3594a9a49838 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:26.541847 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba61aa-9aeb-4609-8125-3594a9a49838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:26.575089 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-c0ba61aa-9aeb-4609-8125-3594a9a49838 None None] MFA Rules not processed for user `133ee5ab1bdd4c44906fc197d825b0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:26.576426 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-c0ba61aa-9aeb-4609-8125-3594a9a49838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:26.652009 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 975/1948] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:26.656774 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc953eb0-68c4-4b11-8893-5793417a2249 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:26.683532 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba61aa-9aeb-4609-8125-3594a9a49838 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:26.685010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-c0ba61aa-9aeb-4609-8125-3594a9a49838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:26.754576 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc953eb0-68c4-4b11-8893-5793417a2249 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:26.762884 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821158b-9661-49e4-bc20-693ae04b221f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:26.763629 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821158b-9661-49e4-bc20-693ae04b221f admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:26.764000 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821158b-9661-49e4-bc20-693ae04b221f admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:26.764326 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821158b-9661-49e4-bc20-693ae04b221f admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:26.765783 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821158b-9661-49e4-bc20-693ae04b221f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:26.768139 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821158b-9661-49e4-bc20-693ae04b221f admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:26.804511 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba61aa-9aeb-4609-8125-3594a9a49838 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:26.809529 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486521e-b750-4800-a27c-9e494e24d483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:26.810338 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486521e-b750-4800-a27c-9e494e24d483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:26.810623 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486521e-b750-4800-a27c-9e494e24d483 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:26.810900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486521e-b750-4800-a27c-9e494e24d483 admin admin] PATH_INFO: `/v3/projects/ee59cfe3e4e947458bb26e759e40d732` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:26.812094 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486521e-b750-4800-a27c-9e494e24d483 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee59cfe3e4e947458bb26e759e40d732)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:26.814086 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486521e-b750-4800-a27c-9e494e24d483 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:26.826194 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 974/1949] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:52:26 2022] POST /identity/v3/projects => generated 379 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:52:26.829933 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821158b-9661-49e4-bc20-693ae04b221f admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:26.888319 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-c486521e-b750-4800-a27c-9e494e24d483 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee59cfe3e4e947458bb26e759e40d732', 'request_id': 'req-c486521e-b750-4800-a27c-9e494e24d483'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:26.899514 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-c486521e-b750-4800-a27c-9e494e24d483 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee59cfe3e4e947458bb26e759e40d732', 'request_id': 'req-c486521e-b750-4800-a27c-9e494e24d483'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:26.910784 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-c486521e-b750-4800-a27c-9e494e24d483 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee59cfe3e4e947458bb26e759e40d732', 'request_id': 'req-c486521e-b750-4800-a27c-9e494e24d483'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:26.919935 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821158b-9661-49e4-bc20-693ae04b221f admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:26.923625 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-c486521e-b750-4800-a27c-9e494e24d483 admin admin] The token cache is being invalidate because project ee59cfe3e4e947458bb26e759e40d732 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:52:26.923971 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-c486521e-b750-4800-a27c-9e494e24d483 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:26.924641 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-c486521e-b750-4800-a27c-9e494e24d483 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:26.930206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 976/1950] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:52:26 2022] DELETE /identity/v3/projects/ee59cfe3e4e947458bb26e759e40d732 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:26.931995 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27a4ed-9085-4e9c-966a-265e164a64d2 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:26.933008 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27a4ed-9085-4e9c-966a-265e164a64d2 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:26.933362 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27a4ed-9085-4e9c-966a-265e164a64d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:26.961083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-2a27a4ed-9085-4e9c-966a-265e164a64d2 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:26.962566 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-2a27a4ed-9085-4e9c-966a-265e164a64d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:26.978204 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:26.989815 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:27.045852 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690869fb-4b99-41a5-b47b-a2249386dd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:27.047643 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690869fb-4b99-41a5-b47b-a2249386dd2f admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:27.048005 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690869fb-4b99-41a5-b47b-a2249386dd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:27.048355 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690869fb-4b99-41a5-b47b-a2249386dd2f admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:27.049168 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690869fb-4b99-41a5-b47b-a2249386dd2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:27.051672 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690869fb-4b99-41a5-b47b-a2249386dd2f admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:27.088252 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 977/1951] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:52:27.088805 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 975/1952] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:52:26 2022] POST /identity/v3/users => generated 290 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:52:27.088898 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27a4ed-9085-4e9c-966a-265e164a64d2 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:27.090064 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c40901-d6e9-4415-b2e3-f59d5b6912ef None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:27.090209 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-2a27a4ed-9085-4e9c-966a-265e164a64d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:27.090511 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c40901-d6e9-4415-b2e3-f59d5b6912ef None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:27.090866 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c40901-d6e9-4415-b2e3-f59d5b6912ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:27.105286 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27a4ed-9085-4e9c-966a-265e164a64d2 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:27.122677 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc373bb-fa75-4993-9ca3-4f3ad3baeea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:27.123469 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc373bb-fa75-4993-9ca3-4f3ad3baeea5 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:27.123833 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc373bb-fa75-4993-9ca3-4f3ad3baeea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:27.124221 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc373bb-fa75-4993-9ca3-4f3ad3baeea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:27.125286 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc373bb-fa75-4993-9ca3-4f3ad3baeea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:27.126633 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-a3c40901-d6e9-4415-b2e3-f59d5b6912ef None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:27.127130 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc373bb-fa75-4993-9ca3-4f3ad3baeea5 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:27.127893 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-a3c40901-d6e9-4415-b2e3-f59d5b6912ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:27.138532 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 976/1953] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:52:27.140234 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 978/1954] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:52:27.142359 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c40901-d6e9-4415-b2e3-f59d5b6912ef None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:27.145191 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc373bb-fa75-4993-9ca3-4f3ad3baeea5 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:27.153185 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c40901-d6e9-4415-b2e3-f59d5b6912ef None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:27.156079 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc373bb-fa75-4993-9ca3-4f3ad3baeea5 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:27.158789 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5183191-7768-46b2-bdf7-3bb10850dad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:27.159592 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5183191-7768-46b2-bdf7-3bb10850dad3 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:27.160139 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5183191-7768-46b2-bdf7-3bb10850dad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:27.160375 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5183191-7768-46b2-bdf7-3bb10850dad3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:27.161202 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0edcb6-4726-44fd-85a6-984e15a92a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:27.161437 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5183191-7768-46b2-bdf7-3bb10850dad3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:27.161806 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5183191-7768-46b2-bdf7-3bb10850dad3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:27.162076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0edcb6-4726-44fd-85a6-984e15a92a21 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:27.162661 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0edcb6-4726-44fd-85a6-984e15a92a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:27.162769 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0edcb6-4726-44fd-85a6-984e15a92a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:27.163557 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0edcb6-4726-44fd-85a6-984e15a92a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:27.163666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5183191-7768-46b2-bdf7-3bb10850dad3 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:27.165416 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0edcb6-4726-44fd-85a6-984e15a92a21 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:27.177111 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 979/1955] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:52:27.183159 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 977/1956] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:27.183258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0edcb6-4726-44fd-85a6-984e15a92a21 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:27.184995 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5183191-7768-46b2-bdf7-3bb10850dad3 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:27.196404 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0edcb6-4726-44fd-85a6-984e15a92a21 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:27.199630 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5183191-7768-46b2-bdf7-3bb10850dad3 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:27.201488 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02e7f8-f88a-4254-adb9-f18fdabd2760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:27.202251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02e7f8-f88a-4254-adb9-f18fdabd2760 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:27.202603 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02e7f8-f88a-4254-adb9-f18fdabd2760 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:27.203067 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02e7f8-f88a-4254-adb9-f18fdabd2760 admin admin] PATH_INFO: `/v3/projects/e8b30bc373f343f498f1b825a37225b4/users/b7e25686c5bf470e9071c00364cd0beb/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:27.204891 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c1b26-d53c-4274-b7d0-70b4434b68e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:27.205534 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c1b26-d53c-4274-b7d0-70b4434b68e8 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:27.205966 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c1b26-d53c-4274-b7d0-70b4434b68e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:27.206254 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c1b26-d53c-4274-b7d0-70b4434b68e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:27.206929 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c1b26-d53c-4274-b7d0-70b4434b68e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:27.208846 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c1b26-d53c-4274-b7d0-70b4434b68e8 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:27.223916 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02e7f8-f88a-4254-adb9-f18fdabd2760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8b30bc373f343f498f1b825a37225b4, user_id=b7e25686c5bf470e9071c00364cd0beb, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:27.227536 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02e7f8-f88a-4254-adb9-f18fdabd2760 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:27.250061 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 980/1957] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:52:27 2022] PUT /identity/v3/projects/e8b30bc373f343f498f1b825a37225b4/users/b7e25686c5bf470e9071c00364cd0beb/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:52:27.257107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e7a20-1353-4b1a-8ef9-a1cd19c5b3a5 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:27.258882 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e7a20-1353-4b1a-8ef9-a1cd19c5b3a5 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:27.259383 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e7a20-1353-4b1a-8ef9-a1cd19c5b3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:27.259949 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 978/1958] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:52:27 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:52:27.263888 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c1b26-d53c-4274-b7d0-70b4434b68e8 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:27.300897 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-a00e7a20-1353-4b1a-8ef9-a1cd19c5b3a5 None None] MFA Rules not processed for user `b7e25686c5bf470e9071c00364cd0beb`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:27.303076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-a00e7a20-1353-4b1a-8ef9-a1cd19c5b3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:27.361721 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c1b26-d53c-4274-b7d0-70b4434b68e8 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:27.366622 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257cae7b-8c7c-4ac2-8680-f3963a689fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:27.367809 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cae7b-8c7c-4ac2-8680-f3963a689fcd admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:27.368096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cae7b-8c7c-4ac2-8680-f3963a689fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:27.368584 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cae7b-8c7c-4ac2-8680-f3963a689fcd admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:27.369029 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257cae7b-8c7c-4ac2-8680-f3963a689fcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:27.371084 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257cae7b-8c7c-4ac2-8680-f3963a689fcd admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:27.393670 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 981/1959] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:27.395694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 979/1960] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:52:27 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:52:27.396876 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e7a20-1353-4b1a-8ef9-a1cd19c5b3a5 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:27.399473 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257cae7b-8c7c-4ac2-8680-f3963a689fcd admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:27.417693 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e7a20-1353-4b1a-8ef9-a1cd19c5b3a5 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:27.417834 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257cae7b-8c7c-4ac2-8680-f3963a689fcd admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:27.417927 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af025890-74b4-40fa-a74f-21a2900a17af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:27.417927 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af025890-74b4-40fa-a74f-21a2900a17af admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:27.417927 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af025890-74b4-40fa-a74f-21a2900a17af admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:27.417927 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af025890-74b4-40fa-a74f-21a2900a17af admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:27.418231 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47472293-830f-4131-b3c5-b762d20bd098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:27.418321 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af025890-74b4-40fa-a74f-21a2900a17af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:27.418397 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47472293-830f-4131-b3c5-b762d20bd098 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:27.418397 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47472293-830f-4131-b3c5-b762d20bd098 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:27.418397 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47472293-830f-4131-b3c5-b762d20bd098 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:27.418974 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47472293-830f-4131-b3c5-b762d20bd098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:27.419098 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af025890-74b4-40fa-a74f-21a2900a17af admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:27.420628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47472293-830f-4131-b3c5-b762d20bd098 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:27.432090 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 980/1961] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:52:27.436004 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47472293-830f-4131-b3c5-b762d20bd098 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:27.446492 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47472293-830f-4131-b3c5-b762d20bd098 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:27.448894 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 982/1962] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:52:27 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:52:27.451102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb84073-dd16-4e6b-8142-65de487fa300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:27.451706 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb84073-dd16-4e6b-8142-65de487fa300 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:27.452245 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb84073-dd16-4e6b-8142-65de487fa300 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:27.452524 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb84073-dd16-4e6b-8142-65de487fa300 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:27.452820 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af025890-74b4-40fa-a74f-21a2900a17af admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:27.453228 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb84073-dd16-4e6b-8142-65de487fa300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:27.454843 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb84073-dd16-4e6b-8142-65de487fa300 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:27.465478 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 981/1963] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:52:27.469578 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb84073-dd16-4e6b-8142-65de487fa300 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:27.480888 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb84073-dd16-4e6b-8142-65de487fa300 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:27.500510 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:27.520626 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af025890-74b4-40fa-a74f-21a2900a17af admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:27.525822 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54b96f-8e8d-49da-93ed-5c73863386ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:27.526426 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54b96f-8e8d-49da-93ed-5c73863386ed admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:27.526704 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54b96f-8e8d-49da-93ed-5c73863386ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:27.526978 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54b96f-8e8d-49da-93ed-5c73863386ed admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:27.527642 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54b96f-8e8d-49da-93ed-5c73863386ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:27.529604 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54b96f-8e8d-49da-93ed-5c73863386ed admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:27.542984 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c9f36-ae32-47d3-ad27-d4656fa9c93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:27.543671 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c9f36-ae32-47d3-ad27-d4656fa9c93a admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:27.543962 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c9f36-ae32-47d3-ad27-d4656fa9c93a admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:27.544285 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c9f36-ae32-47d3-ad27-d4656fa9c93a admin admin] PATH_INFO: `/v3/projects/5d8afb9b41c7400e8ef02bd8bdcc7d5b/users/24bd2b8d4e4648adbcbc284cc414c93e/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:27.547909 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:27.555686 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 983/1964] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:52:27 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:52:27.559127 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54b96f-8e8d-49da-93ed-5c73863386ed admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:27.561457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c9f36-ae32-47d3-ad27-d4656fa9c93a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8afb9b41c7400e8ef02bd8bdcc7d5b, user_id=24bd2b8d4e4648adbcbc284cc414c93e, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:27.564312 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c9f36-ae32-47d3-ad27-d4656fa9c93a admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:27.569916 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54b96f-8e8d-49da-93ed-5c73863386ed admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:27.575287 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9e8c3-3617-4e1c-9566-c34bdde9c1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:27.576081 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9e8c3-3617-4e1c-9566-c34bdde9c1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:27.576370 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9e8c3-3617-4e1c-9566-c34bdde9c1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:27.576651 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9e8c3-3617-4e1c-9566-c34bdde9c1f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:27.577352 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9e8c3-3617-4e1c-9566-c34bdde9c1f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:27.577800 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 982/1965] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:52:27 2022] PUT /identity/v3/projects/5d8afb9b41c7400e8ef02bd8bdcc7d5b/users/24bd2b8d4e4648adbcbc284cc414c93e/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:52:27.578988 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9e8c3-3617-4e1c-9566-c34bdde9c1f8 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:27.588347 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e150e-a077-4f34-9d71-b715589d0a37 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:27.588641 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e150e-a077-4f34-9d71-b715589d0a37 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:27.588929 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e150e-a077-4f34-9d71-b715589d0a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:27.592411 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 984/1966] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:52:27.594493 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9e8c3-3617-4e1c-9566-c34bdde9c1f8 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:27.605524 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9e8c3-3617-4e1c-9566-c34bdde9c1f8 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:27.619690 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-f72e150e-a077-4f34-9d71-b715589d0a37 None None] MFA Rules not processed for user `24bd2b8d4e4648adbcbc284cc414c93e`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:27.620912 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-f72e150e-a077-4f34-9d71-b715589d0a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:27.672422 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18693f16-86f6-44a5-97be-1d4a359d2939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:27.673433 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18693f16-86f6-44a5-97be-1d4a359d2939 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:27.673899 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18693f16-86f6-44a5-97be-1d4a359d2939 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:27.674185 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18693f16-86f6-44a5-97be-1d4a359d2939 admin admin] PATH_INFO: `/v3/projects/23a0794ec97a4b218811fd3db75840f6/users/300858c8d2a2471dbdaaf54ce2bc5846/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:27.692744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18693f16-86f6-44a5-97be-1d4a359d2939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23a0794ec97a4b218811fd3db75840f6, user_id=300858c8d2a2471dbdaaf54ce2bc5846, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:27.696028 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 983/1967] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:52:27.699870 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18693f16-86f6-44a5-97be-1d4a359d2939 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:27.708740 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e150e-a077-4f34-9d71-b715589d0a37 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:27.710190 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-f72e150e-a077-4f34-9d71-b715589d0a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:27.717434 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 985/1968] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:52:27 2022] PUT /identity/v3/projects/23a0794ec97a4b218811fd3db75840f6/users/300858c8d2a2471dbdaaf54ce2bc5846/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:27.721132 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18693f16-86f6-44a5-97be-1d4a359d2939 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:27.808849 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18693f16-86f6-44a5-97be-1d4a359d2939 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:27.812508 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e150e-a077-4f34-9d71-b715589d0a37 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:27.815022 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d898bf-6dd9-4bc7-a89c-cb24d19350bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:27.815750 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d898bf-6dd9-4bc7-a89c-cb24d19350bd admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:27.816093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d898bf-6dd9-4bc7-a89c-cb24d19350bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:27.816380 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d898bf-6dd9-4bc7-a89c-cb24d19350bd admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:27.817146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d898bf-6dd9-4bc7-a89c-cb24d19350bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:27.818802 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d898bf-6dd9-4bc7-a89c-cb24d19350bd admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:27.838090 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 986/1969] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:52:27.839228 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d898bf-6dd9-4bc7-a89c-cb24d19350bd admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:27.851669 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d898bf-6dd9-4bc7-a89c-cb24d19350bd admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:27.858279 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48777e94-440a-447b-810d-e916454f0085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:27.859112 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48777e94-440a-447b-810d-e916454f0085 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:27.859406 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48777e94-440a-447b-810d-e916454f0085 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:27.859688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48777e94-440a-447b-810d-e916454f0085 admin admin] PATH_INFO: `/v3/projects/23a0794ec97a4b218811fd3db75840f6/users/300858c8d2a2471dbdaaf54ce2bc5846/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:27.862206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48777e94-440a-447b-810d-e916454f0085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23a0794ec97a4b218811fd3db75840f6, user_id=300858c8d2a2471dbdaaf54ce2bc5846, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:27.865341 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48777e94-440a-447b-810d-e916454f0085 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:27.876874 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 987/1970] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:52:27 2022] PUT /identity/v3/projects/23a0794ec97a4b218811fd3db75840f6/users/300858c8d2a2471dbdaaf54ce2bc5846/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:27.877066 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff67856-7593-40c2-887e-aabdca6f4be2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:27.877670 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff67856-7593-40c2-887e-aabdca6f4be2 service cinder] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:27.877932 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff67856-7593-40c2-887e-aabdca6f4be2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:27.878273 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff67856-7593-40c2-887e-aabdca6f4be2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:27.887393 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4226eeb-a504-4fa1-b221-f3b0c45c6b11 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:27.887681 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4226eeb-a504-4fa1-b221-f3b0c45c6b11 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:27.887953 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4226eeb-a504-4fa1-b221-f3b0c45c6b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:27.921377 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-f4226eeb-a504-4fa1-b221-f3b0c45c6b11 None None] MFA Rules not processed for user `300858c8d2a2471dbdaaf54ce2bc5846`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:27.922933 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-f4226eeb-a504-4fa1-b221-f3b0c45c6b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:27.937523 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:27.940604 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:27.961252 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff67856-7593-40c2-887e-aabdca6f4be2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:27.964043 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff67856-7593-40c2-887e-aabdca6f4be2 service cinder] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:27.976645 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 984/1971] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:52:28.025262 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 988/1972] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:52:28.046757 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff67856-7593-40c2-887e-aabdca6f4be2 service cinder] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:28.048157 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-eff67856-7593-40c2-887e-aabdca6f4be2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:28.066897 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff67856-7593-40c2-887e-aabdca6f4be2 service cinder] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:28.141135 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db756ef2-22a3-469a-908c-33424e1d98e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:28.142339 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db756ef2-22a3-469a-908c-33424e1d98e3 service cinder] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:28.142620 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db756ef2-22a3-469a-908c-33424e1d98e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:28.142892 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db756ef2-22a3-469a-908c-33424e1d98e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:28.154171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db756ef2-22a3-469a-908c-33424e1d98e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:28.155683 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db756ef2-22a3-469a-908c-33424e1d98e3 service cinder] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:28.166349 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 985/1973] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:28.219917 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4226eeb-a504-4fa1-b221-f3b0c45c6b11 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:28.233647 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4226eeb-a504-4fa1-b221-f3b0c45c6b11 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:28.238425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4874a0e-3b39-4d0a-b5c8-fe97bbcb8a23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:28.239341 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4874a0e-3b39-4d0a-b5c8-fe97bbcb8a23 service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:28.239627 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4874a0e-3b39-4d0a-b5c8-fe97bbcb8a23 service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:28.240024 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4874a0e-3b39-4d0a-b5c8-fe97bbcb8a23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:28.242125 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-c4874a0e-3b39-4d0a-b5c8-fe97bbcb8a23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:28.343249 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4874a0e-3b39-4d0a-b5c8-fe97bbcb8a23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:28.344747 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4874a0e-3b39-4d0a-b5c8-fe97bbcb8a23 service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:28.403016 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 989/1974] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:31.525622 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db756ef2-22a3-469a-908c-33424e1d98e3 service cinder] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:31.677390 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db756ef2-22a3-469a-908c-33424e1d98e3 service cinder] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:31.686096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33904abc-c87d-43ef-bc0f-c794867f89e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:31.688727 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33904abc-c87d-43ef-bc0f-c794867f89e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:31.689384 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33904abc-c87d-43ef-bc0f-c794867f89e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:31.689927 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33904abc-c87d-43ef-bc0f-c794867f89e9 admin admin] PATH_INFO: `/v3/users/133ee5ab1bdd4c44906fc197d825b0bf` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:31.691849 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33904abc-c87d-43ef-bc0f-c794867f89e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=133ee5ab1bdd4c44906fc197d825b0bf)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:31.695832 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33904abc-c87d-43ef-bc0f-c794867f89e9 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:31.834845 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-33904abc-c87d-43ef-bc0f-c794867f89e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '133ee5ab1bdd4c44906fc197d825b0bf'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:31.854054 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-33904abc-c87d-43ef-bc0f-c794867f89e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '133ee5ab1bdd4c44906fc197d825b0bf'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:31.855113 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-33904abc-c87d-43ef-bc0f-c794867f89e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '133ee5ab1bdd4c44906fc197d825b0bf'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:31.856497 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-33904abc-c87d-43ef-bc0f-c794867f89e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '133ee5ab1bdd4c44906fc197d825b0bf'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:31.877480 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-33904abc-c87d-43ef-bc0f-c794867f89e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '133ee5ab1bdd4c44906fc197d825b0bf'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:31.893604 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 986/1975] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:52:31 2022] DELETE /identity/v3/users/133ee5ab1bdd4c44906fc197d825b0bf => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:31.896700 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fbea6-0cac-42f6-bb4d-7d75c008d53c None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:31.897208 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fbea6-0cac-42f6-bb4d-7d75c008d53c None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:31.897208 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fbea6-0cac-42f6-bb4d-7d75c008d53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:31.918936 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-298fbea6-0cac-42f6-bb4d-7d75c008d53c None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:31.920324 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-298fbea6-0cac-42f6-bb4d-7d75c008d53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:32.008899 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 990/1976] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:32.111934 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33904abc-c87d-43ef-bc0f-c794867f89e9 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:32.113857 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-33904abc-c87d-43ef-bc0f-c794867f89e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:32.126289 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:32.188330 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33904abc-c87d-43ef-bc0f-c794867f89e9 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:32.192472 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb6f3f-89d3-4144-a1a0-65284ad89e3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:32.192927 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb6f3f-89d3-4144-a1a0-65284ad89e3b service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:32.193336 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb6f3f-89d3-4144-a1a0-65284ad89e3b service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:32.193716 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb6f3f-89d3-4144-a1a0-65284ad89e3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:32.207481 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb6f3f-89d3-4144-a1a0-65284ad89e3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:32.209588 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb6f3f-89d3-4144-a1a0-65284ad89e3b service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:32.237815 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 987/1977] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:32.931547 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298fbea6-0cac-42f6-bb4d-7d75c008d53c None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:32.933844 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-298fbea6-0cac-42f6-bb4d-7d75c008d53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:32.951223 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298fbea6-0cac-42f6-bb4d-7d75c008d53c None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:32.959523 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9fe69-a77d-4794-9cb2-16972f780fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:32.961412 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9fe69-a77d-4794-9cb2-16972f780fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:32.962287 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9fe69-a77d-4794-9cb2-16972f780fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:32.962287 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9fe69-a77d-4794-9cb2-16972f780fb4 admin admin] PATH_INFO: `/v3/projects/82af5128630143e38f3a7a70629efd74` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:32.964117 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9fe69-a77d-4794-9cb2-16972f780fb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82af5128630143e38f3a7a70629efd74)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:32.972387 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9fe69-a77d-4794-9cb2-16972f780fb4 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:33.050907 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:33.067779 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-4ff9fe69-a77d-4794-9cb2-16972f780fb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82af5128630143e38f3a7a70629efd74', 'request_id': 'req-4ff9fe69-a77d-4794-9cb2-16972f780fb4'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:33.076841 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-4ff9fe69-a77d-4794-9cb2-16972f780fb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82af5128630143e38f3a7a70629efd74', 'request_id': 'req-4ff9fe69-a77d-4794-9cb2-16972f780fb4'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:33.086831 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-4ff9fe69-a77d-4794-9cb2-16972f780fb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82af5128630143e38f3a7a70629efd74', 'request_id': 'req-4ff9fe69-a77d-4794-9cb2-16972f780fb4'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:33.099047 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-4ff9fe69-a77d-4794-9cb2-16972f780fb4 admin admin] The token cache is being invalidate because project 82af5128630143e38f3a7a70629efd74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:52:33.099381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-4ff9fe69-a77d-4794-9cb2-16972f780fb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:33.100118 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-4ff9fe69-a77d-4794-9cb2-16972f780fb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:33.102394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 991/1978] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:52:32 2022] DELETE /identity/v3/projects/82af5128630143e38f3a7a70629efd74 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:33.107022 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb6f3f-89d3-4144-a1a0-65284ad89e3b service neutron] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:33.118216 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb6f3f-89d3-4144-a1a0-65284ad89e3b service neutron] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:33.179892 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d50ee-1e7d-49a0-b731-787d3c525268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:33.180545 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d50ee-1e7d-49a0-b731-787d3c525268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:33.181334 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d50ee-1e7d-49a0-b731-787d3c525268 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:33.181334 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d50ee-1e7d-49a0-b731-787d3c525268 admin admin] PATH_INFO: `/v3/users/b7e25686c5bf470e9071c00364cd0beb` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:33.182302 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d50ee-1e7d-49a0-b731-787d3c525268 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7e25686c5bf470e9071c00364cd0beb)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:33.184259 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d50ee-1e7d-49a0-b731-787d3c525268 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:33.242802 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-938d50ee-1e7d-49a0-b731-787d3c525268 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7e25686c5bf470e9071c00364cd0beb'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:33.252041 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-938d50ee-1e7d-49a0-b731-787d3c525268 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7e25686c5bf470e9071c00364cd0beb'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:33.252786 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-938d50ee-1e7d-49a0-b731-787d3c525268 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7e25686c5bf470e9071c00364cd0beb'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:33.253458 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-938d50ee-1e7d-49a0-b731-787d3c525268 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7e25686c5bf470e9071c00364cd0beb'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:33.271435 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-938d50ee-1e7d-49a0-b731-787d3c525268 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7e25686c5bf470e9071c00364cd0beb'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:33.289869 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 988/1979] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:52:33 2022] DELETE /identity/v3/users/b7e25686c5bf470e9071c00364cd0beb => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:33.612968 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9fe69-a77d-4794-9cb2-16972f780fb4 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:33.614599 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-4ff9fe69-a77d-4794-9cb2-16972f780fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:33.634484 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9fe69-a77d-4794-9cb2-16972f780fb4 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:33.703767 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72489409-6e11-4d32-b3e7-9510a9df33b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:33.704619 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72489409-6e11-4d32-b3e7-9510a9df33b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:33.705079 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72489409-6e11-4d32-b3e7-9510a9df33b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:33.705740 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72489409-6e11-4d32-b3e7-9510a9df33b1 admin admin] PATH_INFO: `/v3/projects/e8b30bc373f343f498f1b825a37225b4` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:33.707110 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72489409-6e11-4d32-b3e7-9510a9df33b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8b30bc373f343f498f1b825a37225b4)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:33.709471 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72489409-6e11-4d32-b3e7-9510a9df33b1 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:33.779122 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-72489409-6e11-4d32-b3e7-9510a9df33b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8b30bc373f343f498f1b825a37225b4', 'request_id': 'req-72489409-6e11-4d32-b3e7-9510a9df33b1'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:33.785700 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-72489409-6e11-4d32-b3e7-9510a9df33b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8b30bc373f343f498f1b825a37225b4', 'request_id': 'req-72489409-6e11-4d32-b3e7-9510a9df33b1'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:33.795560 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-72489409-6e11-4d32-b3e7-9510a9df33b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8b30bc373f343f498f1b825a37225b4', 'request_id': 'req-72489409-6e11-4d32-b3e7-9510a9df33b1'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:33.809041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-72489409-6e11-4d32-b3e7-9510a9df33b1 admin admin] The token cache is being invalidate because project e8b30bc373f343f498f1b825a37225b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:52:33.809312 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-72489409-6e11-4d32-b3e7-9510a9df33b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:33.810020 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-72489409-6e11-4d32-b3e7-9510a9df33b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:33.811631 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 992/1980] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:52:33 2022] DELETE /identity/v3/projects/e8b30bc373f343f498f1b825a37225b4 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:33.815738 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d50ee-1e7d-49a0-b731-787d3c525268 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:33.817265 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-938d50ee-1e7d-49a0-b731-787d3c525268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:33.831622 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d50ee-1e7d-49a0-b731-787d3c525268 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:33.861793 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:33.905380 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9abc6-fa55-466b-816c-990f7378c949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:33.906071 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9abc6-fa55-466b-816c-990f7378c949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:33.906403 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9abc6-fa55-466b-816c-990f7378c949 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:33.906618 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9abc6-fa55-466b-816c-990f7378c949 admin admin] PATH_INFO: `/v3/users/300858c8d2a2471dbdaaf54ce2bc5846` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:33.907811 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9abc6-fa55-466b-816c-990f7378c949 admin admin] RBAC: Authorizing `identity:delete_user(user_id=300858c8d2a2471dbdaaf54ce2bc5846)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:33.909800 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9abc6-fa55-466b-816c-990f7378c949 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:33.968834 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-34b9abc6-fa55-466b-816c-990f7378c949 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '300858c8d2a2471dbdaaf54ce2bc5846'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:33.978884 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-34b9abc6-fa55-466b-816c-990f7378c949 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '300858c8d2a2471dbdaaf54ce2bc5846'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:33.980658 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-34b9abc6-fa55-466b-816c-990f7378c949 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '300858c8d2a2471dbdaaf54ce2bc5846'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:33.981417 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-34b9abc6-fa55-466b-816c-990f7378c949 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '300858c8d2a2471dbdaaf54ce2bc5846'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:34.003955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-34b9abc6-fa55-466b-816c-990f7378c949 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '300858c8d2a2471dbdaaf54ce2bc5846'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:34.019915 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 989/1981] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:52:33 2022] DELETE /identity/v3/users/300858c8d2a2471dbdaaf54ce2bc5846 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:34.095640 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72489409-6e11-4d32-b3e7-9510a9df33b1 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:34.097193 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-72489409-6e11-4d32-b3e7-9510a9df33b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:34.119162 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72489409-6e11-4d32-b3e7-9510a9df33b1 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:34.194367 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1853cc-002d-42e9-b4f4-1cbb5dc6a957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:34.195872 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1853cc-002d-42e9-b4f4-1cbb5dc6a957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:34.196159 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1853cc-002d-42e9-b4f4-1cbb5dc6a957 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:34.196584 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1853cc-002d-42e9-b4f4-1cbb5dc6a957 admin admin] PATH_INFO: `/v3/users/24bd2b8d4e4648adbcbc284cc414c93e` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:34.197868 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1853cc-002d-42e9-b4f4-1cbb5dc6a957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24bd2b8d4e4648adbcbc284cc414c93e)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:34.200041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1853cc-002d-42e9-b4f4-1cbb5dc6a957 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:34.206697 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:34.288165 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-0f1853cc-002d-42e9-b4f4-1cbb5dc6a957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24bd2b8d4e4648adbcbc284cc414c93e'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:34.289682 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-0f1853cc-002d-42e9-b4f4-1cbb5dc6a957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24bd2b8d4e4648adbcbc284cc414c93e'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:34.290430 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-0f1853cc-002d-42e9-b4f4-1cbb5dc6a957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24bd2b8d4e4648adbcbc284cc414c93e'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:34.305166 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-0f1853cc-002d-42e9-b4f4-1cbb5dc6a957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24bd2b8d4e4648adbcbc284cc414c93e'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:34.313217 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-0f1853cc-002d-42e9-b4f4-1cbb5dc6a957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24bd2b8d4e4648adbcbc284cc414c93e'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:34.332245 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 993/1982] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:52:34 2022] DELETE /identity/v3/users/24bd2b8d4e4648adbcbc284cc414c93e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:34.337451 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64e473-8461-4443-8907-a56f46e14e8d None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:34.337946 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64e473-8461-4443-8907-a56f46e14e8d None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:34.338074 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64e473-8461-4443-8907-a56f46e14e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:34.358287 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-8c64e473-8461-4443-8907-a56f46e14e8d None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:34.368752 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-8c64e473-8461-4443-8907-a56f46e14e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:34.434699 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 990/1983] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:34.444817 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1853cc-002d-42e9-b4f4-1cbb5dc6a957 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:34.446413 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-0f1853cc-002d-42e9-b4f4-1cbb5dc6a957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:34.506325 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1853cc-002d-42e9-b4f4-1cbb5dc6a957 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:34.510008 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007032b9-aae1-4149-8357-184d5cc6c59c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:34.510635 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007032b9-aae1-4149-8357-184d5cc6c59c service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:34.510920 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007032b9-aae1-4149-8357-184d5cc6c59c service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:34.511223 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007032b9-aae1-4149-8357-184d5cc6c59c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:34.520403 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007032b9-aae1-4149-8357-184d5cc6c59c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:34.521913 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007032b9-aae1-4149-8357-184d5cc6c59c service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:34.532226 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 994/1984] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:34.562497 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64e473-8461-4443-8907-a56f46e14e8d None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:34.564121 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-8c64e473-8461-4443-8907-a56f46e14e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:34.582796 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64e473-8461-4443-8907-a56f46e14e8d None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:34.589147 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcebf6b-fd2e-438e-b3da-dab681acbaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:34.589823 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcebf6b-fd2e-438e-b3da-dab681acbaed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:34.590100 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcebf6b-fd2e-438e-b3da-dab681acbaed admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:34.590376 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcebf6b-fd2e-438e-b3da-dab681acbaed admin admin] PATH_INFO: `/v3/projects/23a0794ec97a4b218811fd3db75840f6` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:34.591554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcebf6b-fd2e-438e-b3da-dab681acbaed admin admin] RBAC: Authorizing `identity:delete_project(project_id=23a0794ec97a4b218811fd3db75840f6)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:34.593471 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcebf6b-fd2e-438e-b3da-dab681acbaed admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:34.652271 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:34.656436 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-6dcebf6b-fd2e-438e-b3da-dab681acbaed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23a0794ec97a4b218811fd3db75840f6', 'request_id': 'req-6dcebf6b-fd2e-438e-b3da-dab681acbaed'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:34.664892 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-6dcebf6b-fd2e-438e-b3da-dab681acbaed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23a0794ec97a4b218811fd3db75840f6', 'request_id': 'req-6dcebf6b-fd2e-438e-b3da-dab681acbaed'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:34.671689 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-6dcebf6b-fd2e-438e-b3da-dab681acbaed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23a0794ec97a4b218811fd3db75840f6', 'request_id': 'req-6dcebf6b-fd2e-438e-b3da-dab681acbaed'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:34.685979 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-6dcebf6b-fd2e-438e-b3da-dab681acbaed admin admin] The token cache is being invalidate because project 23a0794ec97a4b218811fd3db75840f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:52:34.686272 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-6dcebf6b-fd2e-438e-b3da-dab681acbaed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:34.687067 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-6dcebf6b-fd2e-438e-b3da-dab681acbaed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:34.688820 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 991/1985] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:52:34 2022] DELETE /identity/v3/projects/23a0794ec97a4b218811fd3db75840f6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:52:34.694437 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8a572-430d-410d-9810-c0579f99fce1 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:34.694775 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8a572-430d-410d-9810-c0579f99fce1 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:34.695040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8a572-430d-410d-9810-c0579f99fce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:34.729223 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-95c8a572-430d-410d-9810-c0579f99fce1 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:34.730519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-95c8a572-430d-410d-9810-c0579f99fce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:34.795515 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 995/1986] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:34.811052 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5302d-3474-4bca-9bf3-f99dbbe45ae4 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:34.811052 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5302d-3474-4bca-9bf3-f99dbbe45ae4 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:34.811052 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5302d-3474-4bca-9bf3-f99dbbe45ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:34.829406 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-99d5302d-3474-4bca-9bf3-f99dbbe45ae4 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:34.830591 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-99d5302d-3474-4bca-9bf3-f99dbbe45ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:34.840334 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 992/1987] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:34.844521 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8a572-430d-410d-9810-c0579f99fce1 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:34.856177 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8a572-430d-410d-9810-c0579f99fce1 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:34.863177 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c83834-ade5-4a5b-a6f6-2fcad8f47327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:34.863807 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c83834-ade5-4a5b-a6f6-2fcad8f47327 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:34.864131 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c83834-ade5-4a5b-a6f6-2fcad8f47327 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:34.864376 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c83834-ade5-4a5b-a6f6-2fcad8f47327 admin admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:34.865055 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c83834-ade5-4a5b-a6f6-2fcad8f47327 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:52:34.865362 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c83834-ade5-4a5b-a6f6-2fcad8f47327 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:34.867537 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c83834-ade5-4a5b-a6f6-2fcad8f47327 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:34.880540 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 996/1988] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:52:34.883507 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5302d-3474-4bca-9bf3-f99dbbe45ae4 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:34.885046 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-99d5302d-3474-4bca-9bf3-f99dbbe45ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:34.885720 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c83834-ade5-4a5b-a6f6-2fcad8f47327 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:34.896163 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c83834-ade5-4a5b-a6f6-2fcad8f47327 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:34.900993 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5302d-3474-4bca-9bf3-f99dbbe45ae4 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:34.901684 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d0a01-89de-4919-bd0a-09949d776d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:34.902393 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d0a01-89de-4919-bd0a-09949d776d79 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:34.902770 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d0a01-89de-4919-bd0a-09949d776d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:34.903122 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d0a01-89de-4919-bd0a-09949d776d79 admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:34.903892 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d0a01-89de-4919-bd0a-09949d776d79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:34.905882 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d0a01-89de-4919-bd0a-09949d776d79 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:34.906599 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f647b-d7f0-46ad-b1e3-c4fe8efb8870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:34.907314 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f647b-d7f0-46ad-b1e3-c4fe8efb8870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:34.907671 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f647b-d7f0-46ad-b1e3-c4fe8efb8870 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:34.908020 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f647b-d7f0-46ad-b1e3-c4fe8efb8870 admin admin] PATH_INFO: `/v3/projects/5d8afb9b41c7400e8ef02bd8bdcc7d5b` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:34.909282 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f647b-d7f0-46ad-b1e3-c4fe8efb8870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d8afb9b41c7400e8ef02bd8bdcc7d5b)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:34.911515 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f647b-d7f0-46ad-b1e3-c4fe8efb8870 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:34.917187 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:34.977883 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 997/1989] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:52:34 2022] POST /identity/v3/projects => generated 371 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:52:34.979013 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d0a01-89de-4919-bd0a-09949d776d79 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:34.990154 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-1b1f647b-d7f0-46ad-b1e3-c4fe8efb8870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d8afb9b41c7400e8ef02bd8bdcc7d5b', 'request_id': 'req-1b1f647b-d7f0-46ad-b1e3-c4fe8efb8870'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:35.004155 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-1b1f647b-d7f0-46ad-b1e3-c4fe8efb8870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d8afb9b41c7400e8ef02bd8bdcc7d5b', 'request_id': 'req-1b1f647b-d7f0-46ad-b1e3-c4fe8efb8870'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:35.013744 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-1b1f647b-d7f0-46ad-b1e3-c4fe8efb8870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d8afb9b41c7400e8ef02bd8bdcc7d5b', 'request_id': 'req-1b1f647b-d7f0-46ad-b1e3-c4fe8efb8870'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:35.040058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-1b1f647b-d7f0-46ad-b1e3-c4fe8efb8870 admin admin] The token cache is being invalidate because project 5d8afb9b41c7400e8ef02bd8bdcc7d5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:52:35.040563 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-1b1f647b-d7f0-46ad-b1e3-c4fe8efb8870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:35.041403 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-1b1f647b-d7f0-46ad-b1e3-c4fe8efb8870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:52:35.043766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 993/1990] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:52:34 2022] DELETE /identity/v3/projects/5d8afb9b41c7400e8ef02bd8bdcc7d5b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:35.087872 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d0a01-89de-4919-bd0a-09949d776d79 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:35.163690 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80048f94-6004-4267-b308-cf80b7687d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:35.164488 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80048f94-6004-4267-b308-cf80b7687d44 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:35.164926 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80048f94-6004-4267-b308-cf80b7687d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:35.165279 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80048f94-6004-4267-b308-cf80b7687d44 admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:35.166138 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80048f94-6004-4267-b308-cf80b7687d44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:35.168231 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80048f94-6004-4267-b308-cf80b7687d44 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:35.220554 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 998/1991] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:52:34 2022] POST /identity/v3/users => generated 286 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:52:35.225328 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f647b-d7f0-46ad-b1e3-c4fe8efb8870 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:35.226445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-1b1f647b-d7f0-46ad-b1e3-c4fe8efb8870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:35.249687 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f647b-d7f0-46ad-b1e3-c4fe8efb8870 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:35.263345 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ef55f-f88b-40b1-ac2a-ddf7069cbf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:35.268491 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ef55f-f88b-40b1-ac2a-ddf7069cbf53 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:35.268491 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ef55f-f88b-40b1-ac2a-ddf7069cbf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:35.268491 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ef55f-f88b-40b1-ac2a-ddf7069cbf53 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:35.268491 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ef55f-f88b-40b1-ac2a-ddf7069cbf53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:35.268491 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ef55f-f88b-40b1-ac2a-ddf7069cbf53 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:35.283385 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 994/1992] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:52:35.287700 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80048f94-6004-4267-b308-cf80b7687d44 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:35.299740 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80048f94-6004-4267-b308-cf80b7687d44 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:35.307245 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7f298-d184-4b7c-b1d5-044e152c8bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:35.307945 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7f298-d184-4b7c-b1d5-044e152c8bfb admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:35.308332 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7f298-d184-4b7c-b1d5-044e152c8bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:35.308792 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7f298-d184-4b7c-b1d5-044e152c8bfb admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:35.309663 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb7f298-d184-4b7c-b1d5-044e152c8bfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:35.312466 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb7f298-d184-4b7c-b1d5-044e152c8bfb admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:35.331353 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ef55f-f88b-40b1-ac2a-ddf7069cbf53 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:35.336372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 999/1993] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:52:35.341891 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ef55f-f88b-40b1-ac2a-ddf7069cbf53 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:35.360416 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed4a37-0bf9-4549-b062-72d721f06c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:35.361114 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed4a37-0bf9-4549-b062-72d721f06c23 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:35.361402 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed4a37-0bf9-4549-b062-72d721f06c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:35.361716 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed4a37-0bf9-4549-b062-72d721f06c23 admin admin] PATH_INFO: `/v3/projects/1e1206d9079d4b2aab99745d1381efe6/users/e439f267ed75482aa8d5501ebfad9541/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:35.383834 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed4a37-0bf9-4549-b062-72d721f06c23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e1206d9079d4b2aab99745d1381efe6, user_id=e439f267ed75482aa8d5501ebfad9541, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:35.386865 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed4a37-0bf9-4549-b062-72d721f06c23 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:35.413725 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7ec1d-26e4-4554-bd5a-5c29e4d9ff33 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:35.414122 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7ec1d-26e4-4554-bd5a-5c29e4d9ff33 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:35.415223 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7ec1d-26e4-4554-bd5a-5c29e4d9ff33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:35.421910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 995/1994] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:52:35 2022] PUT /identity/v3/projects/1e1206d9079d4b2aab99745d1381efe6/users/e439f267ed75482aa8d5501ebfad9541/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:35.447270 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-f7d7ec1d-26e4-4554-bd5a-5c29e4d9ff33 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:35.448782 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-f7d7ec1d-26e4-4554-bd5a-5c29e4d9ff33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:35.576119 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1000/1995] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:35.585971 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed4a37-0bf9-4549-b062-72d721f06c23 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:35.587702 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-3fed4a37-0bf9-4549-b062-72d721f06c23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:35.655171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed4a37-0bf9-4549-b062-72d721f06c23 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:35.658942 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf04bc-a8f9-4c80-9475-dafc1ae792af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:35.659628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf04bc-a8f9-4c80-9475-dafc1ae792af service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:35.659970 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf04bc-a8f9-4c80-9475-dafc1ae792af service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:35.660343 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf04bc-a8f9-4c80-9475-dafc1ae792af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:35.670506 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf04bc-a8f9-4c80-9475-dafc1ae792af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:35.671934 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf04bc-a8f9-4c80-9475-dafc1ae792af service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:35.682685 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 996/1996] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:36.593621 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d94957-6d0e-4bb5-be09-55e25ab546aa None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:36.594143 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d94957-6d0e-4bb5-be09-55e25ab546aa None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:36.594252 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d94957-6d0e-4bb5-be09-55e25ab546aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:36.637482 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-67d94957-6d0e-4bb5-be09-55e25ab546aa None None] MFA Rules not processed for user `e439f267ed75482aa8d5501ebfad9541`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:36.638764 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-67d94957-6d0e-4bb5-be09-55e25ab546aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:36.642943 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:36.726751 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1001/1997] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:36.731447 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf04bc-a8f9-4c80-9475-dafc1ae792af service neutron] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:36.742462 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf04bc-a8f9-4c80-9475-dafc1ae792af service neutron] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:36.748349 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5dfce-dbb6-4ada-9258-afd8948d71e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:36.749429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5dfce-dbb6-4ada-9258-afd8948d71e2 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:36.750181 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5dfce-dbb6-4ada-9258-afd8948d71e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:36.750615 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5dfce-dbb6-4ada-9258-afd8948d71e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:36.751624 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc5dfce-dbb6-4ada-9258-afd8948d71e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:36.754259 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc5dfce-dbb6-4ada-9258-afd8948d71e2 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:36.771112 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:36.797851 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d94957-6d0e-4bb5-be09-55e25ab546aa None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:36.799897 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 997/1998] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:52:36 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:52:36.810980 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d94957-6d0e-4bb5-be09-55e25ab546aa None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:36.889614 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353b75e-baa1-4366-b74b-c4cc871ff713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:36.890759 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353b75e-baa1-4366-b74b-c4cc871ff713 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:36.891407 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353b75e-baa1-4366-b74b-c4cc871ff713 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:36.891887 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353b75e-baa1-4366-b74b-c4cc871ff713 admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:36.893390 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9353b75e-baa1-4366-b74b-c4cc871ff713 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:36.895377 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9353b75e-baa1-4366-b74b-c4cc871ff713 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:36.922914 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1002/1999] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:52:36 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:52:36.927194 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5dfce-dbb6-4ada-9258-afd8948d71e2 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:36.940250 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5dfce-dbb6-4ada-9258-afd8948d71e2 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:36.945862 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c58b8-a57e-4063-a4ef-a1387452f20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:36.946740 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c58b8-a57e-4063-a4ef-a1387452f20e admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:36.947085 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c58b8-a57e-4063-a4ef-a1387452f20e admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:36.947876 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c58b8-a57e-4063-a4ef-a1387452f20e admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:36.948230 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c58b8-a57e-4063-a4ef-a1387452f20e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:36.955241 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c58b8-a57e-4063-a4ef-a1387452f20e admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:36.971339 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 998/2000] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:52:36.972262 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353b75e-baa1-4366-b74b-c4cc871ff713 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:36.983431 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353b75e-baa1-4366-b74b-c4cc871ff713 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:36.988505 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ea11e-244d-450e-95f9-a66bbcd0c911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:36.989185 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ea11e-244d-450e-95f9-a66bbcd0c911 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:36.989699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ea11e-244d-450e-95f9-a66bbcd0c911 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:36.990095 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ea11e-244d-450e-95f9-a66bbcd0c911 admin admin] PATH_INFO: `/v3/projects/8b5c0096299e46d9b6f493a708e54087/users/25072c3120524f208d19c356840b1f67/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:37.014626 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ea11e-244d-450e-95f9-a66bbcd0c911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b5c0096299e46d9b6f493a708e54087, user_id=25072c3120524f208d19c356840b1f67, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:37.017674 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ea11e-244d-450e-95f9-a66bbcd0c911 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:37.034431 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1003/2001] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:52:36 2022] PUT /identity/v3/projects/8b5c0096299e46d9b6f493a708e54087/users/25072c3120524f208d19c356840b1f67/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:52:37.039087 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c58b8-a57e-4063-a4ef-a1387452f20e admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:37.055501 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c58b8-a57e-4063-a4ef-a1387452f20e admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:37.198324 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95194238-af1c-45fe-b909-8da0e658ddfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:37.199440 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95194238-af1c-45fe-b909-8da0e658ddfc admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:37.199878 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95194238-af1c-45fe-b909-8da0e658ddfc admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:37.200371 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95194238-af1c-45fe-b909-8da0e658ddfc admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:37.201018 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95194238-af1c-45fe-b909-8da0e658ddfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:37.210601 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95194238-af1c-45fe-b909-8da0e658ddfc admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:37.233866 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ea11e-244d-450e-95f9-a66bbcd0c911 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:37.247045 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 999/2002] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:52:37.251629 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ea11e-244d-450e-95f9-a66bbcd0c911 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:37.271458 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54597f6b-4d22-42fa-b1dd-b43c9a008b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:37.272354 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54597f6b-4d22-42fa-b1dd-b43c9a008b0d admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:37.272562 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54597f6b-4d22-42fa-b1dd-b43c9a008b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:37.272968 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54597f6b-4d22-42fa-b1dd-b43c9a008b0d admin admin] PATH_INFO: `/v3/projects/8b5c0096299e46d9b6f493a708e54087/users/25072c3120524f208d19c356840b1f67/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:37.277116 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54597f6b-4d22-42fa-b1dd-b43c9a008b0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b5c0096299e46d9b6f493a708e54087, user_id=25072c3120524f208d19c356840b1f67, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:37.280734 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54597f6b-4d22-42fa-b1dd-b43c9a008b0d admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:37.298456 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1004/2003] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:52:37 2022] PUT /identity/v3/projects/8b5c0096299e46d9b6f493a708e54087/users/25072c3120524f208d19c356840b1f67/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:52:38.776287 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c0fde-0307-4426-8743-8c6a17701f75 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:38.777175 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c0fde-0307-4426-8743-8c6a17701f75 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:38.777733 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c0fde-0307-4426-8743-8c6a17701f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:38.830032 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-de5c0fde-0307-4426-8743-8c6a17701f75 None None] MFA Rules not processed for user `25072c3120524f208d19c356840b1f67`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:38.831614 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-de5c0fde-0307-4426-8743-8c6a17701f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:38.926960 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1000/2004] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:38 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:38.939140 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c841b-0b96-4d09-afb0-95813d56b5fd None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:38.939657 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c841b-0b96-4d09-afb0-95813d56b5fd None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:38.939733 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c841b-0b96-4d09-afb0-95813d56b5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:38.968429 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-9e0c841b-0b96-4d09-afb0-95813d56b5fd None None] MFA Rules not processed for user `e439f267ed75482aa8d5501ebfad9541`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:52:38.969839 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-9e0c841b-0b96-4d09-afb0-95813d56b5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:39.047289 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1005/2005] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:52:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:52:39.244195 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c0fde-0307-4426-8743-8c6a17701f75 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:52:39.245667 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-de5c0fde-0307-4426-8743-8c6a17701f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:52:39.328114 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:39.334868 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c0fde-0307-4426-8743-8c6a17701f75 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:52:39.342028 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16099c-c13d-4a8c-8c12-c1618b424664 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:52:39.342932 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16099c-c13d-4a8c-8c12-c1618b424664 service nova] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:52:39.343218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16099c-c13d-4a8c-8c12-c1618b424664 service nova] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:52:39.343497 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16099c-c13d-4a8c-8c12-c1618b424664 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:52:39.352189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d16099c-c13d-4a8c-8c12-c1618b424664 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:52:39.353913 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d16099c-c13d-4a8c-8c12-c1618b424664 service nova] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:52:39.368586 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1001/2006] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:52:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:52:49.040482 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=94,keystone:INSERT=5 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:52:49.359878 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=5 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:06.035010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189cb8e-46f2-40ec-a3c6-d1a5b677b898 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:06.035497 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189cb8e-46f2-40ec-a3c6-d1a5b677b898 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:06.035497 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189cb8e-46f2-40ec-a3c6-d1a5b677b898 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:06.036948 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1006/2007] 10.222.0.46 () {54 vars in 921 bytes} [Wed Aug 3 12:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:53:06.046435 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77016fa5-6356-4015-9f31-1ca0e075d2a2 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:06.046889 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77016fa5-6356-4015-9f31-1ca0e075d2a2 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:06.047042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77016fa5-6356-4015-9f31-1ca0e075d2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:06.067487 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-77016fa5-6356-4015-9f31-1ca0e075d2a2 None None] MFA Rules not processed for user `a56847173abb48d39c0ee6fb9cdbbbaa`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:06.068882 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-77016fa5-6356-4015-9f31-1ca0e075d2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:06.097997 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189cb8e-46f2-40ec-a3c6-d1a5b677b898 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:06.099947 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-8189cb8e-46f2-40ec-a3c6-d1a5b677b898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:06.152553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1002/2008] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Aug 3 12:53:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:06.165206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77016fa5-6356-4015-9f31-1ca0e075d2a2 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:06.166634 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-77016fa5-6356-4015-9f31-1ca0e075d2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:06.174553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189cb8e-46f2-40ec-a3c6-d1a5b677b898 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:06.179259 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510681e-24f1-4262-8bec-329c5316a051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:06.179926 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510681e-24f1-4262-8bec-329c5316a051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:06.180154 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77016fa5-6356-4015-9f31-1ca0e075d2a2 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:06.180286 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510681e-24f1-4262-8bec-329c5316a051 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:06.180480 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510681e-24f1-4262-8bec-329c5316a051 admin admin] PATH_INFO: `/v3/users/29005524946d44308e4f7e8f783f504e` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:06.181728 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510681e-24f1-4262-8bec-329c5316a051 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29005524946d44308e4f7e8f783f504e)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:06.183647 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510681e-24f1-4262-8bec-329c5316a051 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:06.185366 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973ca72-4877-4ade-96d4-dcde1a3afa6d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56847173abb48d39c0ee6fb9cdbbbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:06.186022 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973ca72-4877-4ade-96d4-dcde1a3afa6d service placement] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:06.186304 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973ca72-4877-4ade-96d4-dcde1a3afa6d service placement] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:06.186579 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973ca72-4877-4ade-96d4-dcde1a3afa6d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:06.195960 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973ca72-4877-4ade-96d4-dcde1a3afa6d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:06.197772 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973ca72-4877-4ade-96d4-dcde1a3afa6d service placement] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:06.208009 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1003/2009] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:53:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:53:06.238952 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-8510681e-24f1-4262-8bec-329c5316a051 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29005524946d44308e4f7e8f783f504e'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:06.240866 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-8510681e-24f1-4262-8bec-329c5316a051 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29005524946d44308e4f7e8f783f504e'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:06.242321 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-8510681e-24f1-4262-8bec-329c5316a051 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29005524946d44308e4f7e8f783f504e'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:06.255359 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-8510681e-24f1-4262-8bec-329c5316a051 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29005524946d44308e4f7e8f783f504e'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:06.263637 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-8510681e-24f1-4262-8bec-329c5316a051 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29005524946d44308e4f7e8f783f504e'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:06.280887 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1007/2010] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:53:06 2022] DELETE /identity/v3/users/29005524946d44308e4f7e8f783f504e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:53:06.457461 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973ca72-4877-4ade-96d4-dcde1a3afa6d service placement] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:06.474301 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973ca72-4877-4ade-96d4-dcde1a3afa6d service placement] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:06.477827 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a84f3-8537-48a9-b730-6e00d6a56b9d None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:06.478125 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a84f3-8537-48a9-b730-6e00d6a56b9d None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:06.478409 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a84f3-8537-48a9-b730-6e00d6a56b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:06.498961 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-cf7a84f3-8537-48a9-b730-6e00d6a56b9d None None] MFA Rules not processed for user `e10d580c2d244cd5addb0a88de7689c8`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:06.500172 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-cf7a84f3-8537-48a9-b730-6e00d6a56b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:06.533157 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446320e-111d-4868-a370-c62e378871c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:06.533834 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446320e-111d-4868-a370-c62e378871c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:06.534110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446320e-111d-4868-a370-c62e378871c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:06.534381 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446320e-111d-4868-a370-c62e378871c7 admin admin] PATH_INFO: `/v3/projects/1e769eec7d784321a1fcf7896983d022` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:06.535595 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446320e-111d-4868-a370-c62e378871c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e769eec7d784321a1fcf7896983d022)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:06.537575 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446320e-111d-4868-a370-c62e378871c7 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:06.558080 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1008/2011] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:53:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:53:06.592709 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-8446320e-111d-4868-a370-c62e378871c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e769eec7d784321a1fcf7896983d022', 'request_id': 'req-8446320e-111d-4868-a370-c62e378871c7'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:06.599138 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-8446320e-111d-4868-a370-c62e378871c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e769eec7d784321a1fcf7896983d022', 'request_id': 'req-8446320e-111d-4868-a370-c62e378871c7'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:06.605366 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-8446320e-111d-4868-a370-c62e378871c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e769eec7d784321a1fcf7896983d022', 'request_id': 'req-8446320e-111d-4868-a370-c62e378871c7'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:06.620974 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-8446320e-111d-4868-a370-c62e378871c7 admin admin] The token cache is being invalidate because project 1e769eec7d784321a1fcf7896983d022 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:53:06.621263 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-8446320e-111d-4868-a370-c62e378871c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:06.621902 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-8446320e-111d-4868-a370-c62e378871c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:06.623405 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1004/2012] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:53:06 2022] DELETE /identity/v3/projects/1e769eec7d784321a1fcf7896983d022 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:53:06.629480 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74490c52-6384-4ece-87d6-bf6bdcfcae8d None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:06.629798 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74490c52-6384-4ece-87d6-bf6bdcfcae8d None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:06.630076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74490c52-6384-4ece-87d6-bf6bdcfcae8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:06.653279 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-74490c52-6384-4ece-87d6-bf6bdcfcae8d None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:06.654612 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-74490c52-6384-4ece-87d6-bf6bdcfcae8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:06.677874 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:06.743332 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1009/2013] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:53:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:06.745623 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d038b4-8ffe-48a8-84f7-6ede048cbdc3 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:06.745909 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d038b4-8ffe-48a8-84f7-6ede048cbdc3 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:06.746185 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d038b4-8ffe-48a8-84f7-6ede048cbdc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:06.790732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-71d038b4-8ffe-48a8-84f7-6ede048cbdc3 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:06.791973 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-71d038b4-8ffe-48a8-84f7-6ede048cbdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:06.809215 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1005/2014] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:53:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:06.813389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74490c52-6384-4ece-87d6-bf6bdcfcae8d None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:06.824588 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74490c52-6384-4ece-87d6-bf6bdcfcae8d None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:06.830285 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c13f4-ed17-4ced-a3c0-ede01b188d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:06.830907 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c13f4-ed17-4ced-a3c0-ede01b188d38 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:06.831185 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c13f4-ed17-4ced-a3c0-ede01b188d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:06.831458 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c13f4-ed17-4ced-a3c0-ede01b188d38 admin admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:06.832157 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c13f4-ed17-4ced-a3c0-ede01b188d38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:53:06.832458 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c13f4-ed17-4ced-a3c0-ede01b188d38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:06.834099 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c13f4-ed17-4ced-a3c0-ede01b188d38 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:06.847471 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1010/2015] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:53:06.852014 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d038b4-8ffe-48a8-84f7-6ede048cbdc3 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:06.861291 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d038b4-8ffe-48a8-84f7-6ede048cbdc3 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:06.866913 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852b74c-319d-4a9a-a9e2-c3410470b850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:06.867659 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852b74c-319d-4a9a-a9e2-c3410470b850 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:06.867938 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852b74c-319d-4a9a-a9e2-c3410470b850 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:06.868206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852b74c-319d-4a9a-a9e2-c3410470b850 admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:06.868867 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852b74c-319d-4a9a-a9e2-c3410470b850 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:06.870770 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852b74c-319d-4a9a-a9e2-c3410470b850 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:06.875760 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:06.902547 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1006/2016] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:53:06 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:53:06.906549 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c13f4-ed17-4ced-a3c0-ede01b188d38 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:06.917074 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c13f4-ed17-4ced-a3c0-ede01b188d38 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:06.979810 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc39225-3830-416f-b98e-27e760984380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:06.980705 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc39225-3830-416f-b98e-27e760984380 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:06.981084 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc39225-3830-416f-b98e-27e760984380 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:06.981461 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc39225-3830-416f-b98e-27e760984380 admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:06.982296 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc39225-3830-416f-b98e-27e760984380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:06.984452 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc39225-3830-416f-b98e-27e760984380 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:07.011576 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1011/2017] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:53:06 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:53:07.015907 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852b74c-319d-4a9a-a9e2-c3410470b850 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:07.033902 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852b74c-319d-4a9a-a9e2-c3410470b850 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:07.033902 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570a086-eba9-4f05-9603-a41386d883e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:07.033902 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570a086-eba9-4f05-9603-a41386d883e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:07.033902 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570a086-eba9-4f05-9603-a41386d883e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:07.034221 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570a086-eba9-4f05-9603-a41386d883e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:07.034646 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570a086-eba9-4f05-9603-a41386d883e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:07.036448 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570a086-eba9-4f05-9603-a41386d883e5 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:07.047931 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1007/2018] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:53:07.052719 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc39225-3830-416f-b98e-27e760984380 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:07.064056 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc39225-3830-416f-b98e-27e760984380 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:07.069322 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754bcd25-2b02-4a9b-9ef4-d35e25b31a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:07.069980 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754bcd25-2b02-4a9b-9ef4-d35e25b31a12 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:07.070263 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754bcd25-2b02-4a9b-9ef4-d35e25b31a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:07.070540 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754bcd25-2b02-4a9b-9ef4-d35e25b31a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:07.071254 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754bcd25-2b02-4a9b-9ef4-d35e25b31a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:07.072850 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754bcd25-2b02-4a9b-9ef4-d35e25b31a12 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:07.084772 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1012/2019] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:53:07.089167 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570a086-eba9-4f05-9603-a41386d883e5 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:07.101624 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570a086-eba9-4f05-9603-a41386d883e5 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:07.106293 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05281173-1ced-4dd8-aa5b-6952c8021568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:07.107106 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05281173-1ced-4dd8-aa5b-6952c8021568 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:07.107398 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05281173-1ced-4dd8-aa5b-6952c8021568 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:07.107691 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05281173-1ced-4dd8-aa5b-6952c8021568 admin admin] PATH_INFO: `/v3/projects/9c65b2fcc2f34acf83a81dfd7598c0b9/users/7dc16ee3d48f4dceac1032309b17a289/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:07.124209 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05281173-1ced-4dd8-aa5b-6952c8021568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c65b2fcc2f34acf83a81dfd7598c0b9, user_id=7dc16ee3d48f4dceac1032309b17a289, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:07.127278 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05281173-1ced-4dd8-aa5b-6952c8021568 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:07.142303 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1008/2020] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:53:07 2022] PUT /identity/v3/projects/9c65b2fcc2f34acf83a81dfd7598c0b9/users/7dc16ee3d48f4dceac1032309b17a289/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:53:07.152548 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc64b6-ad54-4d76-a817-869089080b10 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:07.152863 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc64b6-ad54-4d76-a817-869089080b10 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:07.153144 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc64b6-ad54-4d76-a817-869089080b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:07.185194 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-05cc64b6-ad54-4d76-a817-869089080b10 None None] MFA Rules not processed for user `7dc16ee3d48f4dceac1032309b17a289`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:07.186567 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-05cc64b6-ad54-4d76-a817-869089080b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:07.277636 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1013/2021] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:53:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:53:07.285763 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05281173-1ced-4dd8-aa5b-6952c8021568 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:07.288412 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-05281173-1ced-4dd8-aa5b-6952c8021568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:07.373047 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05281173-1ced-4dd8-aa5b-6952c8021568 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:07.379135 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822937e-f74b-4f03-b5a2-68dc7c6b5c8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:07.379960 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822937e-f74b-4f03-b5a2-68dc7c6b5c8d service nova] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:07.380076 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822937e-f74b-4f03-b5a2-68dc7c6b5c8d service nova] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:07.380284 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822937e-f74b-4f03-b5a2-68dc7c6b5c8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:07.388849 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822937e-f74b-4f03-b5a2-68dc7c6b5c8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:07.390841 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822937e-f74b-4f03-b5a2-68dc7c6b5c8d service nova] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:07.409477 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1009/2022] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:53:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:53:07.484688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc64b6-ad54-4d76-a817-869089080b10 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:07.486156 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-05cc64b6-ad54-4d76-a817-869089080b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:07.512716 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:07.557289 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc64b6-ad54-4d76-a817-869089080b10 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:07.561576 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15d0f5-6750-4963-9ace-a4adb84b5144 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:07.562400 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15d0f5-6750-4963-9ace-a4adb84b5144 service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:07.562788 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15d0f5-6750-4963-9ace-a4adb84b5144 service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:07.563245 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15d0f5-6750-4963-9ace-a4adb84b5144 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:07.565973 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-de15d0f5-6750-4963-9ace-a4adb84b5144 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:07.647711 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15d0f5-6750-4963-9ace-a4adb84b5144 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:07.649393 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15d0f5-6750-4963-9ace-a4adb84b5144 service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:07.659835 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1014/2023] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:53:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:53:10.155287 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822937e-f74b-4f03-b5a2-68dc7c6b5c8d service nova] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:10.221260 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822937e-f74b-4f03-b5a2-68dc7c6b5c8d service nova] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:10.226414 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cada675-1ae5-464e-a914-110c7dbb65fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:10.227062 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cada675-1ae5-464e-a914-110c7dbb65fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:10.227376 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cada675-1ae5-464e-a914-110c7dbb65fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:10.227653 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cada675-1ae5-464e-a914-110c7dbb65fa admin admin] PATH_INFO: `/v3/users/7dc16ee3d48f4dceac1032309b17a289` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:10.228835 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cada675-1ae5-464e-a914-110c7dbb65fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dc16ee3d48f4dceac1032309b17a289)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:10.231108 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cada675-1ae5-464e-a914-110c7dbb65fa admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:10.274195 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:10.286422 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-7cada675-1ae5-464e-a914-110c7dbb65fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dc16ee3d48f4dceac1032309b17a289'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:10.296454 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-7cada675-1ae5-464e-a914-110c7dbb65fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dc16ee3d48f4dceac1032309b17a289'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:10.297182 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-7cada675-1ae5-464e-a914-110c7dbb65fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dc16ee3d48f4dceac1032309b17a289'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:10.298106 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-7cada675-1ae5-464e-a914-110c7dbb65fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dc16ee3d48f4dceac1032309b17a289'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:10.311798 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-7cada675-1ae5-464e-a914-110c7dbb65fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dc16ee3d48f4dceac1032309b17a289'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:10.329143 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1010/2024] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:53:10 2022] DELETE /identity/v3/users/7dc16ee3d48f4dceac1032309b17a289 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:53:10.334391 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0114732-57b7-4b7c-bf60-45b1c272dc22 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:10.334881 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0114732-57b7-4b7c-bf60-45b1c272dc22 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:10.334968 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0114732-57b7-4b7c-bf60-45b1c272dc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:10.355122 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-b0114732-57b7-4b7c-bf60-45b1c272dc22 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:10.356390 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-b0114732-57b7-4b7c-bf60-45b1c272dc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:10.424587 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1015/2025] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:53:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:10.435286 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cada675-1ae5-464e-a914-110c7dbb65fa admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:10.436711 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-7cada675-1ae5-464e-a914-110c7dbb65fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:10.499718 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cada675-1ae5-464e-a914-110c7dbb65fa admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:10.503749 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57116194-25d0-4194-8c36-d17886a91349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:10.504374 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57116194-25d0-4194-8c36-d17886a91349 service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:10.504654 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57116194-25d0-4194-8c36-d17886a91349 service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:10.504930 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57116194-25d0-4194-8c36-d17886a91349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:10.515075 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57116194-25d0-4194-8c36-d17886a91349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:10.517218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57116194-25d0-4194-8c36-d17886a91349 service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:10.527992 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1011/2026] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:53:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:53:10.838483 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0114732-57b7-4b7c-bf60-45b1c272dc22 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:10.840092 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-b0114732-57b7-4b7c-bf60-45b1c272dc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:10.855527 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0114732-57b7-4b7c-bf60-45b1c272dc22 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:10.861120 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716b332-a3d2-4dc5-945a-552993da82e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:10.861903 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716b332-a3d2-4dc5-945a-552993da82e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:10.862284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716b332-a3d2-4dc5-945a-552993da82e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:10.862659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716b332-a3d2-4dc5-945a-552993da82e9 admin admin] PATH_INFO: `/v3/projects/9c65b2fcc2f34acf83a81dfd7598c0b9` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:10.864115 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716b332-a3d2-4dc5-945a-552993da82e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c65b2fcc2f34acf83a81dfd7598c0b9)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:10.866163 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716b332-a3d2-4dc5-945a-552993da82e9 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:10.920205 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-8716b332-a3d2-4dc5-945a-552993da82e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c65b2fcc2f34acf83a81dfd7598c0b9', 'request_id': 'req-8716b332-a3d2-4dc5-945a-552993da82e9'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:10.926965 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-8716b332-a3d2-4dc5-945a-552993da82e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c65b2fcc2f34acf83a81dfd7598c0b9', 'request_id': 'req-8716b332-a3d2-4dc5-945a-552993da82e9'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:10.936508 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-8716b332-a3d2-4dc5-945a-552993da82e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c65b2fcc2f34acf83a81dfd7598c0b9', 'request_id': 'req-8716b332-a3d2-4dc5-945a-552993da82e9'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:10.941315 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:10.955012 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-8716b332-a3d2-4dc5-945a-552993da82e9 admin admin] The token cache is being invalidate because project 9c65b2fcc2f34acf83a81dfd7598c0b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:53:10.957669 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-8716b332-a3d2-4dc5-945a-552993da82e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:10.962098 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-8716b332-a3d2-4dc5-945a-552993da82e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:10.964263 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1016/2027] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:53:10 2022] DELETE /identity/v3/projects/9c65b2fcc2f34acf83a81dfd7598c0b9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:53:10.969779 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b25216-fdc9-4f0c-924a-3ef0a2e48ffc None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:10.970244 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b25216-fdc9-4f0c-924a-3ef0a2e48ffc None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:10.970668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b25216-fdc9-4f0c-924a-3ef0a2e48ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:10.992377 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-d4b25216-fdc9-4f0c-924a-3ef0a2e48ffc None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:10.994091 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-d4b25216-fdc9-4f0c-924a-3ef0a2e48ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:11.067720 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1012/2028] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:53:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:53:11.078149 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5966e-8666-4e50-9e7c-a4ead90c51f5 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:11.078330 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5966e-8666-4e50-9e7c-a4ead90c51f5 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:11.078866 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5966e-8666-4e50-9e7c-a4ead90c51f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:11.100188 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-1ff5966e-8666-4e50-9e7c-a4ead90c51f5 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:11.102207 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-1ff5966e-8666-4e50-9e7c-a4ead90c51f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:11.118841 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1017/2029] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:53:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:11.120527 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b25216-fdc9-4f0c-924a-3ef0a2e48ffc None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:11.134738 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b25216-fdc9-4f0c-924a-3ef0a2e48ffc None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:11.148957 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec3ce0-25a9-415e-8b27-257e5f63b929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:11.149704 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec3ce0-25a9-415e-8b27-257e5f63b929 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:11.149989 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec3ce0-25a9-415e-8b27-257e5f63b929 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:11.150267 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec3ce0-25a9-415e-8b27-257e5f63b929 admin admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:11.150981 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec3ce0-25a9-415e-8b27-257e5f63b929 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:53:11.151288 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec3ce0-25a9-415e-8b27-257e5f63b929 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:11.152894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec3ce0-25a9-415e-8b27-257e5f63b929 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:11.166903 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1013/2030] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:53:11.171196 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5966e-8666-4e50-9e7c-a4ead90c51f5 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:11.182393 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5966e-8666-4e50-9e7c-a4ead90c51f5 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:11.187477 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40f155-e8a4-4667-bac4-09735769a053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:11.188106 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40f155-e8a4-4667-bac4-09735769a053 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:11.188390 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40f155-e8a4-4667-bac4-09735769a053 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:11.188669 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40f155-e8a4-4667-bac4-09735769a053 admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:11.189343 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40f155-e8a4-4667-bac4-09735769a053 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:11.191474 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40f155-e8a4-4667-bac4-09735769a053 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:11.225544 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1018/2031] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:53:11 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:53:11.227086 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec3ce0-25a9-415e-8b27-257e5f63b929 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:11.239547 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec3ce0-25a9-415e-8b27-257e5f63b929 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:11.297320 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:11.319822 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63723fa3-c211-4254-82f3-8139ddb59de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:11.320363 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63723fa3-c211-4254-82f3-8139ddb59de7 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:11.321129 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63723fa3-c211-4254-82f3-8139ddb59de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:11.321129 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63723fa3-c211-4254-82f3-8139ddb59de7 admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:11.321631 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63723fa3-c211-4254-82f3-8139ddb59de7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:11.323572 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63723fa3-c211-4254-82f3-8139ddb59de7 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:11.361558 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1014/2032] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:53:11 2022] POST /identity/v3/users => generated 285 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:53:11.365323 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40f155-e8a4-4667-bac4-09735769a053 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:11.378638 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40f155-e8a4-4667-bac4-09735769a053 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:11.385558 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c978638-255b-4a47-8b27-7f3a3d93aaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:11.386451 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c978638-255b-4a47-8b27-7f3a3d93aaef admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:11.386917 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c978638-255b-4a47-8b27-7f3a3d93aaef admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:11.387373 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c978638-255b-4a47-8b27-7f3a3d93aaef admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:11.388285 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c978638-255b-4a47-8b27-7f3a3d93aaef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:11.390253 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c978638-255b-4a47-8b27-7f3a3d93aaef admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:11.402117 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1019/2033] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:53:11.406201 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63723fa3-c211-4254-82f3-8139ddb59de7 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:11.418220 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63723fa3-c211-4254-82f3-8139ddb59de7 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:11.423748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf3c16-9f73-4230-ab39-9b927c046106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:11.425100 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf3c16-9f73-4230-ab39-9b927c046106 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:11.425417 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf3c16-9f73-4230-ab39-9b927c046106 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:11.425724 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf3c16-9f73-4230-ab39-9b927c046106 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:11.426642 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf3c16-9f73-4230-ab39-9b927c046106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:11.428790 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf3c16-9f73-4230-ab39-9b927c046106 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:11.443525 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1015/2034] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:53:11.445673 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c978638-255b-4a47-8b27-7f3a3d93aaef admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:11.458253 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c978638-255b-4a47-8b27-7f3a3d93aaef admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:11.464341 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008c07b-67c7-40e3-b72b-912d69a59e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:11.465755 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008c07b-67c7-40e3-b72b-912d69a59e6e admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:11.465755 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008c07b-67c7-40e3-b72b-912d69a59e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:11.465755 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008c07b-67c7-40e3-b72b-912d69a59e6e admin admin] PATH_INFO: `/v3/projects/4480938b82c24ba7b671fdd624b598e1/users/4e6d3045fe7b4980924d2b0a048dd705/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:11.486650 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008c07b-67c7-40e3-b72b-912d69a59e6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4480938b82c24ba7b671fdd624b598e1, user_id=4e6d3045fe7b4980924d2b0a048dd705, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:11.489617 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008c07b-67c7-40e3-b72b-912d69a59e6e admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:11.517548 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1020/2035] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:53:11 2022] PUT /identity/v3/projects/4480938b82c24ba7b671fdd624b598e1/users/4e6d3045fe7b4980924d2b0a048dd705/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:53:11.524013 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e02ba-3a86-43e4-9891-6ba9288a4cf6 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:11.524300 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e02ba-3a86-43e4-9891-6ba9288a4cf6 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:11.524600 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e02ba-3a86-43e4-9891-6ba9288a4cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:11.556376 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-8a3e02ba-3a86-43e4-9891-6ba9288a4cf6 None None] MFA Rules not processed for user `4e6d3045fe7b4980924d2b0a048dd705`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:11.557871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-8a3e02ba-3a86-43e4-9891-6ba9288a4cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:11.651278 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1016/2036] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:53:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:11.655879 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008c07b-67c7-40e3-b72b-912d69a59e6e admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:11.725998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008c07b-67c7-40e3-b72b-912d69a59e6e admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:11.731554 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208e46f-a20f-407d-9c34-11e8be38ae61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:11.732980 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208e46f-a20f-407d-9c34-11e8be38ae61 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:11.733471 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208e46f-a20f-407d-9c34-11e8be38ae61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:11.733785 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208e46f-a20f-407d-9c34-11e8be38ae61 admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:11.734626 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208e46f-a20f-407d-9c34-11e8be38ae61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:11.737671 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208e46f-a20f-407d-9c34-11e8be38ae61 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:11.777421 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1021/2037] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:53:11 2022] POST /identity/v3/projects => generated 369 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:53:11.778634 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e02ba-3a86-43e4-9891-6ba9288a4cf6 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:11.793336 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e02ba-3a86-43e4-9891-6ba9288a4cf6 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:11.853116 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e573a0-72a8-4a45-a513-7e249d1fd4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:11.853807 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e573a0-72a8-4a45-a513-7e249d1fd4d8 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:11.854090 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e573a0-72a8-4a45-a513-7e249d1fd4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:11.854368 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e573a0-72a8-4a45-a513-7e249d1fd4d8 admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:11.855036 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e573a0-72a8-4a45-a513-7e249d1fd4d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:11.856955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e573a0-72a8-4a45-a513-7e249d1fd4d8 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:11.879347 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1017/2038] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:53:11 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:53:11.883634 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208e46f-a20f-407d-9c34-11e8be38ae61 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:11.894772 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208e46f-a20f-407d-9c34-11e8be38ae61 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:11.900547 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51f554-cc50-4179-a3ce-24deea4038ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:11.901219 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51f554-cc50-4179-a3ce-24deea4038ec admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:11.901527 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51f554-cc50-4179-a3ce-24deea4038ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:11.901804 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51f554-cc50-4179-a3ce-24deea4038ec admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:11.902511 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c51f554-cc50-4179-a3ce-24deea4038ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:11.904111 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c51f554-cc50-4179-a3ce-24deea4038ec admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:11.919379 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1022/2039] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:53:11.920621 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e573a0-72a8-4a45-a513-7e249d1fd4d8 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:11.930803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e573a0-72a8-4a45-a513-7e249d1fd4d8 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:11.935870 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3007bb-f21a-44c1-9d77-c0c319529575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:11.936555 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3007bb-f21a-44c1-9d77-c0c319529575 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:11.936869 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3007bb-f21a-44c1-9d77-c0c319529575 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:11.937149 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3007bb-f21a-44c1-9d77-c0c319529575 admin admin] PATH_INFO: `/v3/projects/a34a7a14b0cb4497a709fba72c61bbee/users/e993cc19aca94b55b60f6794aae3f92b/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:11.953774 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3007bb-f21a-44c1-9d77-c0c319529575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a34a7a14b0cb4497a709fba72c61bbee, user_id=e993cc19aca94b55b60f6794aae3f92b, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:11.956742 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3007bb-f21a-44c1-9d77-c0c319529575 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:11.971151 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1018/2040] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:53:11 2022] PUT /identity/v3/projects/a34a7a14b0cb4497a709fba72c61bbee/users/e993cc19aca94b55b60f6794aae3f92b/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:53:11.975847 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51f554-cc50-4179-a3ce-24deea4038ec admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:11.986088 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51f554-cc50-4179-a3ce-24deea4038ec admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:12.044277 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b11249-a215-4808-aed2-358b554d22a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:12.044893 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b11249-a215-4808-aed2-358b554d22a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:12.045288 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b11249-a215-4808-aed2-358b554d22a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:12.045598 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b11249-a215-4808-aed2-358b554d22a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:12.046322 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b11249-a215-4808-aed2-358b554d22a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:12.047928 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b11249-a215-4808-aed2-358b554d22a6 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:12.052899 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:12.058734 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1023/2041] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:53:12.062841 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3007bb-f21a-44c1-9d77-c0c319529575 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:12.073011 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3007bb-f21a-44c1-9d77-c0c319529575 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:12.077663 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1e743-333c-45f1-bd70-41461ceab796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:12.078376 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1e743-333c-45f1-bd70-41461ceab796 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:12.078608 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1e743-333c-45f1-bd70-41461ceab796 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:12.078887 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1e743-333c-45f1-bd70-41461ceab796 admin admin] PATH_INFO: `/v3/projects/a34a7a14b0cb4497a709fba72c61bbee/users/e993cc19aca94b55b60f6794aae3f92b/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:12.080799 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1e743-333c-45f1-bd70-41461ceab796 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a34a7a14b0cb4497a709fba72c61bbee, user_id=e993cc19aca94b55b60f6794aae3f92b, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:12.083444 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1e743-333c-45f1-bd70-41461ceab796 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:12.094485 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1019/2042] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:53:12 2022] PUT /identity/v3/projects/a34a7a14b0cb4497a709fba72c61bbee/users/e993cc19aca94b55b60f6794aae3f92b/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:53:12.105177 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd55e3-d4f5-4108-b31f-673a55b5a939 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:12.105472 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd55e3-d4f5-4108-b31f-673a55b5a939 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:12.105780 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd55e3-d4f5-4108-b31f-673a55b5a939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:12.134342 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-ebbd55e3-d4f5-4108-b31f-673a55b5a939 None None] MFA Rules not processed for user `e993cc19aca94b55b60f6794aae3f92b`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:12.135573 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-ebbd55e3-d4f5-4108-b31f-673a55b5a939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:12.203989 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1024/2043] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:53:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:12.215914 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1e743-333c-45f1-bd70-41461ceab796 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:12.217736 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-f2c1e743-333c-45f1-bd70-41461ceab796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:12.224140 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:12.276591 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1e743-333c-45f1-bd70-41461ceab796 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:12.280362 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77298e4a-3242-4219-8115-09b4e4af86f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:12.280979 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77298e4a-3242-4219-8115-09b4e4af86f2 service cinder] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:12.281262 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77298e4a-3242-4219-8115-09b4e4af86f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:12.281566 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77298e4a-3242-4219-8115-09b4e4af86f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:12.290852 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77298e4a-3242-4219-8115-09b4e4af86f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:12.292280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77298e4a-3242-4219-8115-09b4e4af86f2 service cinder] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:12.301643 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1020/2044] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:53:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:53:12.347105 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd55e3-d4f5-4108-b31f-673a55b5a939 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:12.348548 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-ebbd55e3-d4f5-4108-b31f-673a55b5a939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:12.360432 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd55e3-d4f5-4108-b31f-673a55b5a939 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:12.364033 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bf6a7-f983-4f5c-970a-b8416446fc52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:12.364661 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bf6a7-f983-4f5c-970a-b8416446fc52 service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:12.364937 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bf6a7-f983-4f5c-970a-b8416446fc52 service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:12.365205 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bf6a7-f983-4f5c-970a-b8416446fc52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:12.421800 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3bf6a7-f983-4f5c-970a-b8416446fc52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:12.423232 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3bf6a7-f983-4f5c-970a-b8416446fc52 service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:12.432406 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1025/2045] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:53:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:53:15.774459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77298e4a-3242-4219-8115-09b4e4af86f2 service cinder] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:15.836315 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77298e4a-3242-4219-8115-09b4e4af86f2 service cinder] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:15.840919 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d319f9-5dc7-4d64-8890-72fd2e155b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:15.841579 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d319f9-5dc7-4d64-8890-72fd2e155b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:15.841861 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d319f9-5dc7-4d64-8890-72fd2e155b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:15.842137 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d319f9-5dc7-4d64-8890-72fd2e155b98 admin admin] PATH_INFO: `/v3/users/4e6d3045fe7b4980924d2b0a048dd705` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:15.843278 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d319f9-5dc7-4d64-8890-72fd2e155b98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e6d3045fe7b4980924d2b0a048dd705)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:15.845199 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d319f9-5dc7-4d64-8890-72fd2e155b98 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:15.893941 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-96d319f9-5dc7-4d64-8890-72fd2e155b98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e6d3045fe7b4980924d2b0a048dd705'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:15.901383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-96d319f9-5dc7-4d64-8890-72fd2e155b98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e6d3045fe7b4980924d2b0a048dd705'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:15.902199 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-96d319f9-5dc7-4d64-8890-72fd2e155b98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e6d3045fe7b4980924d2b0a048dd705'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:15.902816 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-96d319f9-5dc7-4d64-8890-72fd2e155b98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e6d3045fe7b4980924d2b0a048dd705'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:15.915106 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-96d319f9-5dc7-4d64-8890-72fd2e155b98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e6d3045fe7b4980924d2b0a048dd705'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:15.927212 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1021/2046] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:53:15 2022] DELETE /identity/v3/users/4e6d3045fe7b4980924d2b0a048dd705 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:53:15.932365 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5e69b-a825-4a57-97aa-245490e264c5 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:15.932816 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5e69b-a825-4a57-97aa-245490e264c5 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:15.932903 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5e69b-a825-4a57-97aa-245490e264c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:15.952038 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-2bd5e69b-a825-4a57-97aa-245490e264c5 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:15.953267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-2bd5e69b-a825-4a57-97aa-245490e264c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:16.013191 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1026/2047] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:53:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:16.022799 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d319f9-5dc7-4d64-8890-72fd2e155b98 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:16.024236 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-96d319f9-5dc7-4d64-8890-72fd2e155b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:16.062987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:16.091597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d319f9-5dc7-4d64-8890-72fd2e155b98 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:16.095245 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ccc137-0719-4894-bb8f-3a3224e3a551 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:16.095870 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccc137-0719-4894-bb8f-3a3224e3a551 service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:16.096153 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccc137-0719-4894-bb8f-3a3224e3a551 service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:16.096430 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccc137-0719-4894-bb8f-3a3224e3a551 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:16.106730 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ccc137-0719-4894-bb8f-3a3224e3a551 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:16.108196 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ccc137-0719-4894-bb8f-3a3224e3a551 service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:16.118689 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1022/2048] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:53:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:53:16.417783 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5e69b-a825-4a57-97aa-245490e264c5 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:16.419252 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-2bd5e69b-a825-4a57-97aa-245490e264c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:16.432522 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5e69b-a825-4a57-97aa-245490e264c5 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:16.437599 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be66c2-1485-49ed-9e7a-2fbd66475fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:16.438241 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be66c2-1485-49ed-9e7a-2fbd66475fd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:16.438520 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be66c2-1485-49ed-9e7a-2fbd66475fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:16.438790 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be66c2-1485-49ed-9e7a-2fbd66475fd3 admin admin] PATH_INFO: `/v3/projects/4480938b82c24ba7b671fdd624b598e1` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:16.439958 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be66c2-1485-49ed-9e7a-2fbd66475fd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4480938b82c24ba7b671fdd624b598e1)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:16.441905 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be66c2-1485-49ed-9e7a-2fbd66475fd3 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:16.468412 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:16.502528 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-29be66c2-1485-49ed-9e7a-2fbd66475fd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4480938b82c24ba7b671fdd624b598e1', 'request_id': 'req-29be66c2-1485-49ed-9e7a-2fbd66475fd3'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:16.511628 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-29be66c2-1485-49ed-9e7a-2fbd66475fd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4480938b82c24ba7b671fdd624b598e1', 'request_id': 'req-29be66c2-1485-49ed-9e7a-2fbd66475fd3'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:16.522643 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-29be66c2-1485-49ed-9e7a-2fbd66475fd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4480938b82c24ba7b671fdd624b598e1', 'request_id': 'req-29be66c2-1485-49ed-9e7a-2fbd66475fd3'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:16.535808 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-29be66c2-1485-49ed-9e7a-2fbd66475fd3 admin admin] The token cache is being invalidate because project 4480938b82c24ba7b671fdd624b598e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:53:16.536670 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-29be66c2-1485-49ed-9e7a-2fbd66475fd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:16.536873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-29be66c2-1485-49ed-9e7a-2fbd66475fd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:16.538767 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1027/2049] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:53:16 2022] DELETE /identity/v3/projects/4480938b82c24ba7b671fdd624b598e1 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:53:16.542433 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ccc137-0719-4894-bb8f-3a3224e3a551 service neutron] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:16.554866 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ccc137-0719-4894-bb8f-3a3224e3a551 service neutron] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:16.621277 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429fe343-fb7c-443f-bdad-518de2ce0b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:16.621958 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fe343-fb7c-443f-bdad-518de2ce0b8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:16.622236 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fe343-fb7c-443f-bdad-518de2ce0b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:16.622514 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fe343-fb7c-443f-bdad-518de2ce0b8d admin admin] PATH_INFO: `/v3/users/e993cc19aca94b55b60f6794aae3f92b` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:16.623683 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429fe343-fb7c-443f-bdad-518de2ce0b8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e993cc19aca94b55b60f6794aae3f92b)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:16.625901 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429fe343-fb7c-443f-bdad-518de2ce0b8d admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:16.676470 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-429fe343-fb7c-443f-bdad-518de2ce0b8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e993cc19aca94b55b60f6794aae3f92b'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:16.684927 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-429fe343-fb7c-443f-bdad-518de2ce0b8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e993cc19aca94b55b60f6794aae3f92b'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:16.685651 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-429fe343-fb7c-443f-bdad-518de2ce0b8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e993cc19aca94b55b60f6794aae3f92b'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:16.686307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-429fe343-fb7c-443f-bdad-518de2ce0b8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e993cc19aca94b55b60f6794aae3f92b'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:16.701134 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-429fe343-fb7c-443f-bdad-518de2ce0b8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e993cc19aca94b55b60f6794aae3f92b'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:16.717545 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1023/2050] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:53:16 2022] DELETE /identity/v3/users/e993cc19aca94b55b60f6794aae3f92b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:53:16.987393 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be66c2-1485-49ed-9e7a-2fbd66475fd3 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:16.989390 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-29be66c2-1485-49ed-9e7a-2fbd66475fd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:17.003942 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be66c2-1485-49ed-9e7a-2fbd66475fd3 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:17.063809 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ceffb-77c0-4bfa-b4c8-ba55f8c0cdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:17.064368 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ceffb-77c0-4bfa-b4c8-ba55f8c0cdf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:17.064648 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ceffb-77c0-4bfa-b4c8-ba55f8c0cdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:17.064924 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ceffb-77c0-4bfa-b4c8-ba55f8c0cdf9 admin admin] PATH_INFO: `/v3/projects/a34a7a14b0cb4497a709fba72c61bbee` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:17.066220 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ceffb-77c0-4bfa-b4c8-ba55f8c0cdf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a34a7a14b0cb4497a709fba72c61bbee)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:17.068217 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ceffb-77c0-4bfa-b4c8-ba55f8c0cdf9 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:17.113421 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-d85ceffb-77c0-4bfa-b4c8-ba55f8c0cdf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a34a7a14b0cb4497a709fba72c61bbee', 'request_id': 'req-d85ceffb-77c0-4bfa-b4c8-ba55f8c0cdf9'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:17.120509 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-d85ceffb-77c0-4bfa-b4c8-ba55f8c0cdf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a34a7a14b0cb4497a709fba72c61bbee', 'request_id': 'req-d85ceffb-77c0-4bfa-b4c8-ba55f8c0cdf9'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:17.128598 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-d85ceffb-77c0-4bfa-b4c8-ba55f8c0cdf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a34a7a14b0cb4497a709fba72c61bbee', 'request_id': 'req-d85ceffb-77c0-4bfa-b4c8-ba55f8c0cdf9'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:17.139507 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-d85ceffb-77c0-4bfa-b4c8-ba55f8c0cdf9 admin admin] The token cache is being invalidate because project a34a7a14b0cb4497a709fba72c61bbee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:53:17.139796 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-d85ceffb-77c0-4bfa-b4c8-ba55f8c0cdf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:17.140419 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-d85ceffb-77c0-4bfa-b4c8-ba55f8c0cdf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:17.141982 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1028/2051] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:53:16 2022] DELETE /identity/v3/projects/a34a7a14b0cb4497a709fba72c61bbee => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:53:17.147612 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3900c-c653-4d5c-a059-7744a142f637 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:17.148071 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3900c-c653-4d5c-a059-7744a142f637 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:17.148159 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3900c-c653-4d5c-a059-7744a142f637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:17.168889 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-76f3900c-c653-4d5c-a059-7744a142f637 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:17.170651 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-76f3900c-c653-4d5c-a059-7744a142f637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:17.216668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:17.236169 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1024/2052] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:53:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:17.250888 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd6bba-d30c-4b0a-a134-ce0103bf2e13 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:17.251961 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd6bba-d30c-4b0a-a134-ce0103bf2e13 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:17.252748 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd6bba-d30c-4b0a-a134-ce0103bf2e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:17.282168 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-d0bd6bba-d30c-4b0a-a134-ce0103bf2e13 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:17.283392 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-d0bd6bba-d30c-4b0a-a134-ce0103bf2e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:17.292533 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1029/2053] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:53:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:17.296870 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3900c-c653-4d5c-a059-7744a142f637 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:17.306660 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3900c-c653-4d5c-a059-7744a142f637 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:17.311274 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454de3a-51b7-4504-a78f-883aff7f49af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:17.311886 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454de3a-51b7-4504-a78f-883aff7f49af admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:17.312162 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454de3a-51b7-4504-a78f-883aff7f49af admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:17.312430 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454de3a-51b7-4504-a78f-883aff7f49af admin admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:17.313171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8454de3a-51b7-4504-a78f-883aff7f49af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:53:17.313431 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8454de3a-51b7-4504-a78f-883aff7f49af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:17.315163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8454de3a-51b7-4504-a78f-883aff7f49af admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:17.329531 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1025/2054] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:53:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:53:17.332204 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd6bba-d30c-4b0a-a134-ce0103bf2e13 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:17.343342 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd6bba-d30c-4b0a-a134-ce0103bf2e13 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:17.354870 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c786e-5863-44df-90aa-5d3bcc356b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:17.355571 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c786e-5863-44df-90aa-5d3bcc356b30 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:17.355862 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c786e-5863-44df-90aa-5d3bcc356b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:17.356140 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c786e-5863-44df-90aa-5d3bcc356b30 admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:17.356816 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c786e-5863-44df-90aa-5d3bcc356b30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:17.358875 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c786e-5863-44df-90aa-5d3bcc356b30 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:17.396441 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1030/2055] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:53:17 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:53:17.410604 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454de3a-51b7-4504-a78f-883aff7f49af admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:17.426544 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454de3a-51b7-4504-a78f-883aff7f49af admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:17.492823 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da473020-8feb-4d47-975a-9abf5159102f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:17.493441 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da473020-8feb-4d47-975a-9abf5159102f admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:17.493756 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da473020-8feb-4d47-975a-9abf5159102f admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:17.494028 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da473020-8feb-4d47-975a-9abf5159102f admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:17.494684 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da473020-8feb-4d47-975a-9abf5159102f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:17.496649 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da473020-8feb-4d47-975a-9abf5159102f admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:17.518935 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1026/2056] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:53:17 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:53:17.523763 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c786e-5863-44df-90aa-5d3bcc356b30 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:17.535125 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c786e-5863-44df-90aa-5d3bcc356b30 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:17.540331 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c9221-6f6a-43e5-b368-9b62da522758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:17.540952 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c9221-6f6a-43e5-b368-9b62da522758 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:17.541233 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c9221-6f6a-43e5-b368-9b62da522758 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:17.541538 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c9221-6f6a-43e5-b368-9b62da522758 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:17.542233 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c9221-6f6a-43e5-b368-9b62da522758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:17.543829 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c9221-6f6a-43e5-b368-9b62da522758 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:17.547981 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:17.561432 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1031/2057] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:53:17.561895 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da473020-8feb-4d47-975a-9abf5159102f admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:17.572961 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da473020-8feb-4d47-975a-9abf5159102f admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:17.577793 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0663ce8-b1bf-4594-9e1b-8d738bbc47dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:17.578503 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0663ce8-b1bf-4594-9e1b-8d738bbc47dd admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:17.578862 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0663ce8-b1bf-4594-9e1b-8d738bbc47dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:17.579205 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0663ce8-b1bf-4594-9e1b-8d738bbc47dd admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:17.579934 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0663ce8-b1bf-4594-9e1b-8d738bbc47dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:17.581539 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0663ce8-b1bf-4594-9e1b-8d738bbc47dd admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:17.593420 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1027/2058] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:53:17.597967 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c9221-6f6a-43e5-b368-9b62da522758 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:17.609070 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c9221-6f6a-43e5-b368-9b62da522758 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:17.613784 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a09e7b-6cfd-44b2-8f24-1a04d526c913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:17.614496 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a09e7b-6cfd-44b2-8f24-1a04d526c913 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:17.614729 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a09e7b-6cfd-44b2-8f24-1a04d526c913 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:17.615008 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a09e7b-6cfd-44b2-8f24-1a04d526c913 admin admin] PATH_INFO: `/v3/projects/f9771457cac94563a494f3d772d8eecc/users/9eb4d4c4f3294db385d8b2ebecdaaa4b/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:17.633665 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a09e7b-6cfd-44b2-8f24-1a04d526c913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9771457cac94563a494f3d772d8eecc, user_id=9eb4d4c4f3294db385d8b2ebecdaaa4b, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:17.636330 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a09e7b-6cfd-44b2-8f24-1a04d526c913 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:17.655047 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1032/2059] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:53:17 2022] PUT /identity/v3/projects/f9771457cac94563a494f3d772d8eecc/users/9eb4d4c4f3294db385d8b2ebecdaaa4b/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:53:17.665676 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ea478-3532-47cf-b967-086ca1caad5e None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:17.665966 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ea478-3532-47cf-b967-086ca1caad5e None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:17.666245 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ea478-3532-47cf-b967-086ca1caad5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:17.694260 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-4c1ea478-3532-47cf-b967-086ca1caad5e None None] MFA Rules not processed for user `9eb4d4c4f3294db385d8b2ebecdaaa4b`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:17.695482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-4c1ea478-3532-47cf-b967-086ca1caad5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:17.762022 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1028/2060] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:53:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:17.766687 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a09e7b-6cfd-44b2-8f24-1a04d526c913 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:17.845182 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a09e7b-6cfd-44b2-8f24-1a04d526c913 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:17.850220 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72376f-8ee6-4d90-8926-60a811a743cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:17.850922 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72376f-8ee6-4d90-8926-60a811a743cb admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:17.851270 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72376f-8ee6-4d90-8926-60a811a743cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:17.851612 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72376f-8ee6-4d90-8926-60a811a743cb admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:17.852340 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72376f-8ee6-4d90-8926-60a811a743cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:17.854286 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72376f-8ee6-4d90-8926-60a811a743cb admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:17.884580 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1033/2061] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:53:17 2022] POST /identity/v3/projects => generated 389 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:53:17.889094 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ea478-3532-47cf-b967-086ca1caad5e None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:17.901435 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ea478-3532-47cf-b967-086ca1caad5e None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:17.960455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:17.976672 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cad47b-e420-4161-9f8b-bf2fe3c468d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:17.977347 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cad47b-e420-4161-9f8b-bf2fe3c468d7 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:17.977671 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cad47b-e420-4161-9f8b-bf2fe3c468d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:17.977952 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cad47b-e420-4161-9f8b-bf2fe3c468d7 admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:17.978657 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cad47b-e420-4161-9f8b-bf2fe3c468d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:17.980674 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cad47b-e420-4161-9f8b-bf2fe3c468d7 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:18.008590 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1029/2062] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:53:17 2022] POST /identity/v3/users => generated 301 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:53:18.009907 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72376f-8ee6-4d90-8926-60a811a743cb admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:18.020250 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72376f-8ee6-4d90-8926-60a811a743cb admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:18.024902 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7041c91-f481-492e-8495-f3b6e922e519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:18.025526 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7041c91-f481-492e-8495-f3b6e922e519 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:18.025823 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7041c91-f481-492e-8495-f3b6e922e519 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:18.026098 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7041c91-f481-492e-8495-f3b6e922e519 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:18.026792 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7041c91-f481-492e-8495-f3b6e922e519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:18.028454 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7041c91-f481-492e-8495-f3b6e922e519 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:18.040174 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1034/2063] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:53:18.044242 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cad47b-e420-4161-9f8b-bf2fe3c468d7 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:18.054813 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cad47b-e420-4161-9f8b-bf2fe3c468d7 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:18.059736 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376deb1-7573-43ba-a242-50fb4452b6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:18.060394 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376deb1-7573-43ba-a242-50fb4452b6e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:18.060676 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376deb1-7573-43ba-a242-50fb4452b6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:18.060954 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376deb1-7573-43ba-a242-50fb4452b6e7 admin admin] PATH_INFO: `/v3/projects/ccbb0246592f4f089ab7c9d2362a1960/users/0d1b219cc17f489d9bf72f36ede38e19/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:18.076776 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376deb1-7573-43ba-a242-50fb4452b6e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccbb0246592f4f089ab7c9d2362a1960, user_id=0d1b219cc17f489d9bf72f36ede38e19, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:18.079406 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376deb1-7573-43ba-a242-50fb4452b6e7 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:18.092887 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1030/2064] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:53:18 2022] PUT /identity/v3/projects/ccbb0246592f4f089ab7c9d2362a1960/users/0d1b219cc17f489d9bf72f36ede38e19/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:53:18.096969 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7041c91-f481-492e-8495-f3b6e922e519 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:18.107170 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7041c91-f481-492e-8495-f3b6e922e519 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:18.162842 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b30e5-09c3-4b13-90e4-993077cbb1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:18.163637 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b30e5-09c3-4b13-90e4-993077cbb1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:18.163958 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b30e5-09c3-4b13-90e4-993077cbb1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:18.164235 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b30e5-09c3-4b13-90e4-993077cbb1a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:18.164961 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b30e5-09c3-4b13-90e4-993077cbb1a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:18.166581 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b30e5-09c3-4b13-90e4-993077cbb1a8 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:18.176289 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1035/2065] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:53:18.180941 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376deb1-7573-43ba-a242-50fb4452b6e7 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:18.191123 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376deb1-7573-43ba-a242-50fb4452b6e7 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:18.196691 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a09f99-03ac-41be-a2fc-73d5a65cf903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:18.197336 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a09f99-03ac-41be-a2fc-73d5a65cf903 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:18.197656 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a09f99-03ac-41be-a2fc-73d5a65cf903 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:18.197957 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a09f99-03ac-41be-a2fc-73d5a65cf903 admin admin] PATH_INFO: `/v3/projects/ccbb0246592f4f089ab7c9d2362a1960/users/0d1b219cc17f489d9bf72f36ede38e19/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:18.199859 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a09f99-03ac-41be-a2fc-73d5a65cf903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccbb0246592f4f089ab7c9d2362a1960, user_id=0d1b219cc17f489d9bf72f36ede38e19, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:18.202483 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a09f99-03ac-41be-a2fc-73d5a65cf903 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:18.212558 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1031/2066] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:53:18 2022] PUT /identity/v3/projects/ccbb0246592f4f089ab7c9d2362a1960/users/0d1b219cc17f489d9bf72f36ede38e19/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:53:18.223967 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3af83-0bac-406d-93ba-20a48ed6fd30 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:18.224286 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3af83-0bac-406d-93ba-20a48ed6fd30 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:18.224597 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3af83-0bac-406d-93ba-20a48ed6fd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:18.253794 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-efc3af83-0bac-406d-93ba-20a48ed6fd30 None None] MFA Rules not processed for user `0d1b219cc17f489d9bf72f36ede38e19`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:18.255010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-efc3af83-0bac-406d-93ba-20a48ed6fd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:18.290754 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:18.328450 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1036/2067] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:53:18 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:18.338905 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a09f99-03ac-41be-a2fc-73d5a65cf903 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:18.340634 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-47a09f99-03ac-41be-a2fc-73d5a65cf903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:18.398186 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a09f99-03ac-41be-a2fc-73d5a65cf903 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:18.401848 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbf1f9-baba-44e8-a120-a6634c2226c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:18.402451 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbf1f9-baba-44e8-a120-a6634c2226c3 service cinder] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:18.402732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbf1f9-baba-44e8-a120-a6634c2226c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:18.403006 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbf1f9-baba-44e8-a120-a6634c2226c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:18.411807 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfbf1f9-baba-44e8-a120-a6634c2226c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:18.413784 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfbf1f9-baba-44e8-a120-a6634c2226c3 service cinder] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:18.422985 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1032/2068] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:53:18 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:53:18.557385 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3af83-0bac-406d-93ba-20a48ed6fd30 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:18.621128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3af83-0bac-406d-93ba-20a48ed6fd30 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:18.625937 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28b9f7-6087-4dbd-abb5-c2399380bc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:18.626572 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28b9f7-6087-4dbd-abb5-c2399380bc99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:18.626854 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28b9f7-6087-4dbd-abb5-c2399380bc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:18.627130 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28b9f7-6087-4dbd-abb5-c2399380bc99 admin admin] PATH_INFO: `/v3/users/9eb4d4c4f3294db385d8b2ebecdaaa4b` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:18.628302 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28b9f7-6087-4dbd-abb5-c2399380bc99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eb4d4c4f3294db385d8b2ebecdaaa4b)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:18.630268 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28b9f7-6087-4dbd-abb5-c2399380bc99 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:18.680767 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-ad28b9f7-6087-4dbd-abb5-c2399380bc99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eb4d4c4f3294db385d8b2ebecdaaa4b'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:18.681354 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-ad28b9f7-6087-4dbd-abb5-c2399380bc99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eb4d4c4f3294db385d8b2ebecdaaa4b'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:18.682051 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-ad28b9f7-6087-4dbd-abb5-c2399380bc99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eb4d4c4f3294db385d8b2ebecdaaa4b'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:18.696989 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-ad28b9f7-6087-4dbd-abb5-c2399380bc99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eb4d4c4f3294db385d8b2ebecdaaa4b'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:18.704223 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-ad28b9f7-6087-4dbd-abb5-c2399380bc99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eb4d4c4f3294db385d8b2ebecdaaa4b'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:18.718685 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1037/2069] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:53:18 2022] DELETE /identity/v3/users/9eb4d4c4f3294db385d8b2ebecdaaa4b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:53:18.723268 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17626afb-fc34-4fe9-9d6f-3b27ab7499e6 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:18.723610 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17626afb-fc34-4fe9-9d6f-3b27ab7499e6 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:18.723889 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17626afb-fc34-4fe9-9d6f-3b27ab7499e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:18.743232 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-17626afb-fc34-4fe9-9d6f-3b27ab7499e6 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:18.744535 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-17626afb-fc34-4fe9-9d6f-3b27ab7499e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:18.808625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1033/2070] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:53:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:18.818680 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28b9f7-6087-4dbd-abb5-c2399380bc99 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:18.820122 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-ad28b9f7-6087-4dbd-abb5-c2399380bc99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:18.880805 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:18.887816 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28b9f7-6087-4dbd-abb5-c2399380bc99 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:18.901722 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601f8d0-4763-4585-95f1-e1758519d549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:18.901722 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601f8d0-4763-4585-95f1-e1758519d549 service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:18.901722 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601f8d0-4763-4585-95f1-e1758519d549 service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:18.901722 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601f8d0-4763-4585-95f1-e1758519d549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:18.905646 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601f8d0-4763-4585-95f1-e1758519d549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:18.907489 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601f8d0-4763-4585-95f1-e1758519d549 service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:18.922064 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1038/2071] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:53:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:53:19.218980 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17626afb-fc34-4fe9-9d6f-3b27ab7499e6 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:19.221095 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-17626afb-fc34-4fe9-9d6f-3b27ab7499e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:19.238122 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17626afb-fc34-4fe9-9d6f-3b27ab7499e6 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:19.244571 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6c8ec-48be-4633-b494-843f9efcd758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:19.245421 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6c8ec-48be-4633-b494-843f9efcd758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:19.245734 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6c8ec-48be-4633-b494-843f9efcd758 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:19.246007 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6c8ec-48be-4633-b494-843f9efcd758 admin admin] PATH_INFO: `/v3/projects/f9771457cac94563a494f3d772d8eecc` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:19.247271 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6c8ec-48be-4633-b494-843f9efcd758 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9771457cac94563a494f3d772d8eecc)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:19.249190 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6c8ec-48be-4633-b494-843f9efcd758 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:19.296424 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:19.309040 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-36d6c8ec-48be-4633-b494-843f9efcd758 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9771457cac94563a494f3d772d8eecc', 'request_id': 'req-36d6c8ec-48be-4633-b494-843f9efcd758'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:19.315709 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-36d6c8ec-48be-4633-b494-843f9efcd758 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9771457cac94563a494f3d772d8eecc', 'request_id': 'req-36d6c8ec-48be-4633-b494-843f9efcd758'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:19.322278 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-36d6c8ec-48be-4633-b494-843f9efcd758 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9771457cac94563a494f3d772d8eecc', 'request_id': 'req-36d6c8ec-48be-4633-b494-843f9efcd758'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:19.335691 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-36d6c8ec-48be-4633-b494-843f9efcd758 admin admin] The token cache is being invalidate because project f9771457cac94563a494f3d772d8eecc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:53:19.335971 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-36d6c8ec-48be-4633-b494-843f9efcd758 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:19.336600 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-36d6c8ec-48be-4633-b494-843f9efcd758 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:19.338198 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1034/2072] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:53:19 2022] DELETE /identity/v3/projects/f9771457cac94563a494f3d772d8eecc => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:53:19.342385 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601f8d0-4763-4585-95f1-e1758519d549 service neutron] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:19.352462 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601f8d0-4763-4585-95f1-e1758519d549 service neutron] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:19.416185 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46483dc2-1524-4a61-aa20-2e9dce28a8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:19.416837 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46483dc2-1524-4a61-aa20-2e9dce28a8c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:19.417114 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46483dc2-1524-4a61-aa20-2e9dce28a8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:19.417384 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46483dc2-1524-4a61-aa20-2e9dce28a8c7 admin admin] PATH_INFO: `/v3/users/0d1b219cc17f489d9bf72f36ede38e19` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:19.418616 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46483dc2-1524-4a61-aa20-2e9dce28a8c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d1b219cc17f489d9bf72f36ede38e19)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:19.420573 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46483dc2-1524-4a61-aa20-2e9dce28a8c7 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:19.471732 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-46483dc2-1524-4a61-aa20-2e9dce28a8c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d1b219cc17f489d9bf72f36ede38e19'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:19.472657 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-46483dc2-1524-4a61-aa20-2e9dce28a8c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d1b219cc17f489d9bf72f36ede38e19'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:19.473258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-46483dc2-1524-4a61-aa20-2e9dce28a8c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d1b219cc17f489d9bf72f36ede38e19'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:19.485116 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-46483dc2-1524-4a61-aa20-2e9dce28a8c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d1b219cc17f489d9bf72f36ede38e19'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:19.492320 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-46483dc2-1524-4a61-aa20-2e9dce28a8c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d1b219cc17f489d9bf72f36ede38e19'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:19.506858 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1039/2073] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:53:19 2022] DELETE /identity/v3/users/0d1b219cc17f489d9bf72f36ede38e19 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:53:19.777986 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6c8ec-48be-4633-b494-843f9efcd758 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:19.779515 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-36d6c8ec-48be-4633-b494-843f9efcd758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:19.793258 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6c8ec-48be-4633-b494-843f9efcd758 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:19.851099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0333fd1a-028d-4968-b97f-e9342ea81dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:19.851732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333fd1a-028d-4968-b97f-e9342ea81dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:19.852008 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333fd1a-028d-4968-b97f-e9342ea81dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:19.852278 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333fd1a-028d-4968-b97f-e9342ea81dfe admin admin] PATH_INFO: `/v3/projects/ccbb0246592f4f089ab7c9d2362a1960` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:19.853407 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0333fd1a-028d-4968-b97f-e9342ea81dfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccbb0246592f4f089ab7c9d2362a1960)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:19.855345 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0333fd1a-028d-4968-b97f-e9342ea81dfe admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:19.900954 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-0333fd1a-028d-4968-b97f-e9342ea81dfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccbb0246592f4f089ab7c9d2362a1960', 'request_id': 'req-0333fd1a-028d-4968-b97f-e9342ea81dfe'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:19.906867 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-0333fd1a-028d-4968-b97f-e9342ea81dfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccbb0246592f4f089ab7c9d2362a1960', 'request_id': 'req-0333fd1a-028d-4968-b97f-e9342ea81dfe'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:19.912882 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-0333fd1a-028d-4968-b97f-e9342ea81dfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccbb0246592f4f089ab7c9d2362a1960', 'request_id': 'req-0333fd1a-028d-4968-b97f-e9342ea81dfe'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:19.924670 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-0333fd1a-028d-4968-b97f-e9342ea81dfe admin admin] The token cache is being invalidate because project ccbb0246592f4f089ab7c9d2362a1960 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:53:19.924953 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-0333fd1a-028d-4968-b97f-e9342ea81dfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:19.925650 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-0333fd1a-028d-4968-b97f-e9342ea81dfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:19.927122 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1035/2074] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:53:19 2022] DELETE /identity/v3/projects/ccbb0246592f4f089ab7c9d2362a1960 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:53:19.932713 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c8774-8875-4dc0-b10a-3c2a41d3774a None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:19.933025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c8774-8875-4dc0-b10a-3c2a41d3774a None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:19.933287 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c8774-8875-4dc0-b10a-3c2a41d3774a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:19.952633 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-4f3c8774-8875-4dc0-b10a-3c2a41d3774a None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:19.953872 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-4f3c8774-8875-4dc0-b10a-3c2a41d3774a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:20.016153 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1040/2075] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:53:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:20.024087 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac236629-c3f1-4dfe-99b4-5d685546a9db None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:20.024430 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac236629-c3f1-4dfe-99b4-5d685546a9db None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:20.024735 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac236629-c3f1-4dfe-99b4-5d685546a9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:20.049156 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-ac236629-c3f1-4dfe-99b4-5d685546a9db None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:20.050408 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-ac236629-c3f1-4dfe-99b4-5d685546a9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:20.059286 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1036/2076] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:53:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:20.063872 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c8774-8875-4dc0-b10a-3c2a41d3774a None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:20.073723 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c8774-8875-4dc0-b10a-3c2a41d3774a None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:20.080053 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed7860-be94-44ea-8528-1a6f4e9cd229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:20.080053 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed7860-be94-44ea-8528-1a6f4e9cd229 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:20.080053 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed7860-be94-44ea-8528-1a6f4e9cd229 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:20.080053 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed7860-be94-44ea-8528-1a6f4e9cd229 admin admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:20.080397 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed7860-be94-44ea-8528-1a6f4e9cd229 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:53:20.080626 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed7860-be94-44ea-8528-1a6f4e9cd229 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:20.082297 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed7860-be94-44ea-8528-1a6f4e9cd229 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:20.089901 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:20.096120 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1041/2077] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:53:20.101123 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac236629-c3f1-4dfe-99b4-5d685546a9db None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:20.110712 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac236629-c3f1-4dfe-99b4-5d685546a9db None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:20.116306 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6168219-0797-4e9f-9507-77ac68c8ac68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:20.116964 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6168219-0797-4e9f-9507-77ac68c8ac68 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:20.117245 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6168219-0797-4e9f-9507-77ac68c8ac68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:20.117533 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6168219-0797-4e9f-9507-77ac68c8ac68 admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:20.118225 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6168219-0797-4e9f-9507-77ac68c8ac68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:20.120226 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6168219-0797-4e9f-9507-77ac68c8ac68 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:20.151789 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1037/2078] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:53:20 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:53:20.153016 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed7860-be94-44ea-8528-1a6f4e9cd229 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:20.164326 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed7860-be94-44ea-8528-1a6f4e9cd229 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:20.229356 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173836cc-edcc-4141-983c-873297dd1811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:20.230279 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173836cc-edcc-4141-983c-873297dd1811 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:20.230457 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173836cc-edcc-4141-983c-873297dd1811 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:20.230706 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173836cc-edcc-4141-983c-873297dd1811 admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:20.231429 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173836cc-edcc-4141-983c-873297dd1811 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:20.234158 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173836cc-edcc-4141-983c-873297dd1811 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:20.269113 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1042/2079] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:53:20 2022] POST /identity/v3/users => generated 291 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:53:20.271149 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6168219-0797-4e9f-9507-77ac68c8ac68 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:20.286891 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6168219-0797-4e9f-9507-77ac68c8ac68 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:20.294026 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26cd007-a8d8-47de-afea-c07e94327320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:20.294665 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cd007-a8d8-47de-afea-c07e94327320 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:20.294952 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cd007-a8d8-47de-afea-c07e94327320 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:20.295229 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cd007-a8d8-47de-afea-c07e94327320 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:20.295936 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26cd007-a8d8-47de-afea-c07e94327320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:20.297555 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26cd007-a8d8-47de-afea-c07e94327320 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:20.308168 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1038/2080] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:53:20.312188 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173836cc-edcc-4141-983c-873297dd1811 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:20.322454 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173836cc-edcc-4141-983c-873297dd1811 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:20.327115 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c413d2-277e-4e38-892f-a420b1059794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:20.327706 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c413d2-277e-4e38-892f-a420b1059794 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:20.327984 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c413d2-277e-4e38-892f-a420b1059794 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:20.328253 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c413d2-277e-4e38-892f-a420b1059794 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:20.328942 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c413d2-277e-4e38-892f-a420b1059794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:20.330575 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c413d2-277e-4e38-892f-a420b1059794 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:20.342829 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1043/2081] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:53:20.346999 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26cd007-a8d8-47de-afea-c07e94327320 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:20.357755 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26cd007-a8d8-47de-afea-c07e94327320 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:20.362530 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d065cf-8f0e-478a-acc9-af09bf084023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:20.363189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d065cf-8f0e-478a-acc9-af09bf084023 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:20.363471 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d065cf-8f0e-478a-acc9-af09bf084023 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:20.363795 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d065cf-8f0e-478a-acc9-af09bf084023 admin admin] PATH_INFO: `/v3/projects/96965c9899094e60b898ec7036d132cd/users/a6712fd019db4f3193ebd622b1976fb1/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:20.376021 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:20.380587 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d065cf-8f0e-478a-acc9-af09bf084023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96965c9899094e60b898ec7036d132cd, user_id=a6712fd019db4f3193ebd622b1976fb1, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:20.383619 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d065cf-8f0e-478a-acc9-af09bf084023 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:20.399330 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1039/2082] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:53:20 2022] PUT /identity/v3/projects/96965c9899094e60b898ec7036d132cd/users/a6712fd019db4f3193ebd622b1976fb1/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:53:20.409875 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee7f62-332c-405b-b183-4e3dc497f60a None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:20.410091 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee7f62-332c-405b-b183-4e3dc497f60a None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:20.410369 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee7f62-332c-405b-b183-4e3dc497f60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:20.439964 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-c7ee7f62-332c-405b-b183-4e3dc497f60a None None] MFA Rules not processed for user `a6712fd019db4f3193ebd622b1976fb1`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:20.441186 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-c7ee7f62-332c-405b-b183-4e3dc497f60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:20.522524 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1044/2083] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:53:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:20.527131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d065cf-8f0e-478a-acc9-af09bf084023 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:20.593718 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d065cf-8f0e-478a-acc9-af09bf084023 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:20.598631 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f0962-c9b4-4387-a0f4-0b29a1319bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:20.599248 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f0962-c9b4-4387-a0f4-0b29a1319bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:20.599550 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f0962-c9b4-4387-a0f4-0b29a1319bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:20.599928 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f0962-c9b4-4387-a0f4-0b29a1319bb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:20.600611 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f0962-c9b4-4387-a0f4-0b29a1319bb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:20.602644 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f0962-c9b4-4387-a0f4-0b29a1319bb3 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:20.634934 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1040/2084] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:53:20 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:53:20.636833 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee7f62-332c-405b-b183-4e3dc497f60a None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:20.654712 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee7f62-332c-405b-b183-4e3dc497f60a None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:20.719010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776b1c4-1d0e-4282-9c73-9ab772886212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:20.719647 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776b1c4-1d0e-4282-9c73-9ab772886212 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:20.719932 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776b1c4-1d0e-4282-9c73-9ab772886212 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:20.720213 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776b1c4-1d0e-4282-9c73-9ab772886212 admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:20.720881 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c776b1c4-1d0e-4282-9c73-9ab772886212 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:20.722887 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c776b1c4-1d0e-4282-9c73-9ab772886212 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:20.734023 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:20.751360 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1045/2085] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:53:20 2022] POST /identity/v3/users => generated 298 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:53:20.755256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f0962-c9b4-4387-a0f4-0b29a1319bb3 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:20.766258 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f0962-c9b4-4387-a0f4-0b29a1319bb3 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:20.771362 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b80e1-4742-4198-8168-f424fd679b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:20.772816 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b80e1-4742-4198-8168-f424fd679b56 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:20.773164 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b80e1-4742-4198-8168-f424fd679b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:20.773448 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b80e1-4742-4198-8168-f424fd679b56 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:20.774202 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b80e1-4742-4198-8168-f424fd679b56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:20.775804 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b80e1-4742-4198-8168-f424fd679b56 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:20.787171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1041/2086] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:53:20.791738 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776b1c4-1d0e-4282-9c73-9ab772886212 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:20.801823 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776b1c4-1d0e-4282-9c73-9ab772886212 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:20.806608 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32642e7a-b812-4b77-92e1-b0f315ddf4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:20.807271 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32642e7a-b812-4b77-92e1-b0f315ddf4bf admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:20.807548 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32642e7a-b812-4b77-92e1-b0f315ddf4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:20.807821 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32642e7a-b812-4b77-92e1-b0f315ddf4bf admin admin] PATH_INFO: `/v3/projects/2fb9d79de9ef4d1d80d10f8e4315a321/users/64bd19f40c30472f87d014cb89df8229/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:20.823729 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32642e7a-b812-4b77-92e1-b0f315ddf4bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fb9d79de9ef4d1d80d10f8e4315a321, user_id=64bd19f40c30472f87d014cb89df8229, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:20.826407 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32642e7a-b812-4b77-92e1-b0f315ddf4bf admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:20.841369 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1046/2087] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:53:20 2022] PUT /identity/v3/projects/2fb9d79de9ef4d1d80d10f8e4315a321/users/64bd19f40c30472f87d014cb89df8229/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:53:20.845594 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b80e1-4742-4198-8168-f424fd679b56 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:20.857937 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b80e1-4742-4198-8168-f424fd679b56 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:20.928680 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8c933-01d7-4227-aa68-3a19dd8bdf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:20.929845 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8c933-01d7-4227-aa68-3a19dd8bdf75 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:20.930125 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8c933-01d7-4227-aa68-3a19dd8bdf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:20.930692 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8c933-01d7-4227-aa68-3a19dd8bdf75 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:20.931397 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8c933-01d7-4227-aa68-3a19dd8bdf75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:20.933224 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8c933-01d7-4227-aa68-3a19dd8bdf75 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:20.948056 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1042/2088] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:53:20.953387 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32642e7a-b812-4b77-92e1-b0f315ddf4bf admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:20.967765 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32642e7a-b812-4b77-92e1-b0f315ddf4bf admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:20.973198 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3c1f3-6e57-404e-b647-2f4e735f13ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:20.974031 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3c1f3-6e57-404e-b647-2f4e735f13ae admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:20.974316 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3c1f3-6e57-404e-b647-2f4e735f13ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:20.974750 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3c1f3-6e57-404e-b647-2f4e735f13ae admin admin] PATH_INFO: `/v3/projects/2fb9d79de9ef4d1d80d10f8e4315a321/users/64bd19f40c30472f87d014cb89df8229/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:20.977167 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d3c1f3-6e57-404e-b647-2f4e735f13ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fb9d79de9ef4d1d80d10f8e4315a321, user_id=64bd19f40c30472f87d014cb89df8229, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:20.979859 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d3c1f3-6e57-404e-b647-2f4e735f13ae admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:20.992230 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1047/2089] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:53:20 2022] PUT /identity/v3/projects/2fb9d79de9ef4d1d80d10f8e4315a321/users/64bd19f40c30472f87d014cb89df8229/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:53:21.003851 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224306d9-b08a-4bbe-963a-42eef0f28ce8 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:21.004146 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224306d9-b08a-4bbe-963a-42eef0f28ce8 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:21.004423 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224306d9-b08a-4bbe-963a-42eef0f28ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:21.036921 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-224306d9-b08a-4bbe-963a-42eef0f28ce8 None None] MFA Rules not processed for user `64bd19f40c30472f87d014cb89df8229`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:21.038704 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-224306d9-b08a-4bbe-963a-42eef0f28ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:21.094890 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:21.122178 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1043/2090] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:53:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:21.147070 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3c1f3-6e57-404e-b647-2f4e735f13ae admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:21.150150 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-40d3c1f3-6e57-404e-b647-2f4e735f13ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:21.238698 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3c1f3-6e57-404e-b647-2f4e735f13ae admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:21.243739 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae20cf-0e06-41d2-96ba-e06a1a825117 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:21.244465 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae20cf-0e06-41d2-96ba-e06a1a825117 service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:21.244820 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae20cf-0e06-41d2-96ba-e06a1a825117 service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:21.245168 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae20cf-0e06-41d2-96ba-e06a1a825117 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:21.325315 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae20cf-0e06-41d2-96ba-e06a1a825117 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:21.326763 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae20cf-0e06-41d2-96ba-e06a1a825117 service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:21.336208 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1048/2091] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:53:21 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:53:26.805422 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224306d9-b08a-4bbe-963a-42eef0f28ce8 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:26.814981 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224306d9-b08a-4bbe-963a-42eef0f28ce8 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:26.818825 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e33e0d-0fd2-47b8-ae3c-0e0bc944168b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:26.819450 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e33e0d-0fd2-47b8-ae3c-0e0bc944168b service cinder] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:26.819721 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e33e0d-0fd2-47b8-ae3c-0e0bc944168b service cinder] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:26.819996 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e33e0d-0fd2-47b8-ae3c-0e0bc944168b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:26.829317 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e33e0d-0fd2-47b8-ae3c-0e0bc944168b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:26.830782 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e33e0d-0fd2-47b8-ae3c-0e0bc944168b service cinder] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:26.841457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1044/2092] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:53:26 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:53:27.101731 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b2c62-de38-48bc-8b7e-c301fc697092 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:27.102298 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b2c62-de38-48bc-8b7e-c301fc697092 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:27.102403 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b2c62-de38-48bc-8b7e-c301fc697092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:27.122450 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-264b2c62-de38-48bc-8b7e-c301fc697092 None None] MFA Rules not processed for user `a994c976b95744ed9723bf9c4386bde1`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:27.123637 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-264b2c62-de38-48bc-8b7e-c301fc697092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:27.207546 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1049/2093] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Aug 3 12:53:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:27.260319 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e33e0d-0fd2-47b8-ae3c-0e0bc944168b service cinder] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:27.261793 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-b5e33e0d-0fd2-47b8-ae3c-0e0bc944168b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:27.343323 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e33e0d-0fd2-47b8-ae3c-0e0bc944168b service cinder] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:27.348580 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0119db-3395-42d0-b37b-95c4760732f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67df369737ea4c83bae134f4bf2de20d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:27.349363 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0119db-3395-42d0-b37b-95c4760732f0 service swift] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:27.349744 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0119db-3395-42d0-b37b-95c4760732f0 service swift] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:27.350027 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0119db-3395-42d0-b37b-95c4760732f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:27.359674 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0119db-3395-42d0-b37b-95c4760732f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:27.361406 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0119db-3395-42d0-b37b-95c4760732f0 service swift] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:27.370429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1045/2094] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Aug 3 12:53:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 12:53:32.053212 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b2c62-de38-48bc-8b7e-c301fc697092 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:32.078578 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:32.168164 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b2c62-de38-48bc-8b7e-c301fc697092 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:32.175341 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc70337-2f4f-44ab-a117-a23b46214584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:32.176022 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc70337-2f4f-44ab-a117-a23b46214584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:32.176309 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc70337-2f4f-44ab-a117-a23b46214584 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:32.176591 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc70337-2f4f-44ab-a117-a23b46214584 admin admin] PATH_INFO: `/v3/users/a6712fd019db4f3193ebd622b1976fb1` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:32.178452 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc70337-2f4f-44ab-a117-a23b46214584 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6712fd019db4f3193ebd622b1976fb1)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:32.182265 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc70337-2f4f-44ab-a117-a23b46214584 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:32.301001 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-9cc70337-2f4f-44ab-a117-a23b46214584 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6712fd019db4f3193ebd622b1976fb1'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:32.301770 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-9cc70337-2f4f-44ab-a117-a23b46214584 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6712fd019db4f3193ebd622b1976fb1'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:32.302426 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-9cc70337-2f4f-44ab-a117-a23b46214584 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6712fd019db4f3193ebd622b1976fb1'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:32.319676 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-9cc70337-2f4f-44ab-a117-a23b46214584 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6712fd019db4f3193ebd622b1976fb1'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:32.337763 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-9cc70337-2f4f-44ab-a117-a23b46214584 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6712fd019db4f3193ebd622b1976fb1'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:32.358583 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1050/2095] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:53:32 2022] DELETE /identity/v3/users/a6712fd019db4f3193ebd622b1976fb1 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:53:32.363065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c727df2-529a-4921-ace2-9b5d1d5c0cf2 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:32.363609 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c727df2-529a-4921-ace2-9b5d1d5c0cf2 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:32.363609 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c727df2-529a-4921-ace2-9b5d1d5c0cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:32.397435 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-3c727df2-529a-4921-ace2-9b5d1d5c0cf2 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:32.399096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-3c727df2-529a-4921-ace2-9b5d1d5c0cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:32.484415 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1046/2096] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:53:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:53:32.485210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc70337-2f4f-44ab-a117-a23b46214584 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:32.488447 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-9cc70337-2f4f-44ab-a117-a23b46214584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:32.579997 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc70337-2f4f-44ab-a117-a23b46214584 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:32.586443 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8227b-e132-4515-8429-f1d9c7dc6203 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:32.586443 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8227b-e132-4515-8429-f1d9c7dc6203 service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:32.586727 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8227b-e132-4515-8429-f1d9c7dc6203 service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:32.587100 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8227b-e132-4515-8429-f1d9c7dc6203 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:32.587633 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c727df2-529a-4921-ace2-9b5d1d5c0cf2 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:32.589156 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-3c727df2-529a-4921-ace2-9b5d1d5c0cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:32.602611 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8227b-e132-4515-8429-f1d9c7dc6203 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:32.605610 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8227b-e132-4515-8429-f1d9c7dc6203 service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:32.620269 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1051/2097] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:53:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:53:32.622738 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c727df2-529a-4921-ace2-9b5d1d5c0cf2 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:32.636000 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a864c-d972-43d3-a224-a0cd78675026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:32.636692 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a864c-d972-43d3-a224-a0cd78675026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:32.636983 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a864c-d972-43d3-a224-a0cd78675026 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:32.637228 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a864c-d972-43d3-a224-a0cd78675026 admin admin] PATH_INFO: `/v3/users/e439f267ed75482aa8d5501ebfad9541` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:32.640791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a864c-d972-43d3-a224-a0cd78675026 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e439f267ed75482aa8d5501ebfad9541)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:32.644691 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a864c-d972-43d3-a224-a0cd78675026 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:32.722239 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-292a864c-d972-43d3-a224-a0cd78675026 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e439f267ed75482aa8d5501ebfad9541'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:32.740174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-292a864c-d972-43d3-a224-a0cd78675026 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e439f267ed75482aa8d5501ebfad9541'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:32.742530 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-292a864c-d972-43d3-a224-a0cd78675026 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e439f267ed75482aa8d5501ebfad9541'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:32.743162 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-292a864c-d972-43d3-a224-a0cd78675026 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e439f267ed75482aa8d5501ebfad9541'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:32.747151 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:32.763735 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-292a864c-d972-43d3-a224-a0cd78675026 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e439f267ed75482aa8d5501ebfad9541'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:32.780298 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1047/2098] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:53:32 2022] DELETE /identity/v3/users/e439f267ed75482aa8d5501ebfad9541 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:53:32.983080 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8227b-e132-4515-8429-f1d9c7dc6203 service neutron] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:32.985710 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-06f8227b-e132-4515-8429-f1d9c7dc6203 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:33.037312 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8227b-e132-4515-8429-f1d9c7dc6203 service neutron] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:33.102728 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:33.125249 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a864c-d972-43d3-a224-a0cd78675026 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:33.127493 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-292a864c-d972-43d3-a224-a0cd78675026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:33.138781 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619740b4-d425-4bf4-92a7-adea7debb314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:33.139785 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619740b4-d425-4bf4-92a7-adea7debb314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:33.140205 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619740b4-d425-4bf4-92a7-adea7debb314 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:33.140795 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619740b4-d425-4bf4-92a7-adea7debb314 admin admin] PATH_INFO: `/v3/projects/96965c9899094e60b898ec7036d132cd` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:33.142280 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619740b4-d425-4bf4-92a7-adea7debb314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96965c9899094e60b898ec7036d132cd)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:33.145646 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619740b4-d425-4bf4-92a7-adea7debb314 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:33.232132 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-619740b4-d425-4bf4-92a7-adea7debb314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96965c9899094e60b898ec7036d132cd', 'request_id': 'req-619740b4-d425-4bf4-92a7-adea7debb314'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:33.235942 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a864c-d972-43d3-a224-a0cd78675026 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:33.239640 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-619740b4-d425-4bf4-92a7-adea7debb314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96965c9899094e60b898ec7036d132cd', 'request_id': 'req-619740b4-d425-4bf4-92a7-adea7debb314'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:33.253446 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-619740b4-d425-4bf4-92a7-adea7debb314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96965c9899094e60b898ec7036d132cd', 'request_id': 'req-619740b4-d425-4bf4-92a7-adea7debb314'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:33.277028 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-619740b4-d425-4bf4-92a7-adea7debb314 admin admin] The token cache is being invalidate because project 96965c9899094e60b898ec7036d132cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:53:33.277222 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-619740b4-d425-4bf4-92a7-adea7debb314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:33.279068 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-619740b4-d425-4bf4-92a7-adea7debb314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:33.281246 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1052/2099] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:53:32 2022] DELETE /identity/v3/projects/96965c9899094e60b898ec7036d132cd => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:53:33.285287 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619740b4-d425-4bf4-92a7-adea7debb314 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:33.288654 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-619740b4-d425-4bf4-92a7-adea7debb314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:33.321633 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0bb8c-c9b7-4844-a076-79722333da18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:33.322694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0bb8c-c9b7-4844-a076-79722333da18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:33.323138 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0bb8c-c9b7-4844-a076-79722333da18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:33.323526 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0bb8c-c9b7-4844-a076-79722333da18 admin admin] PATH_INFO: `/v3/projects/1e1206d9079d4b2aab99745d1381efe6` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:33.325607 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0bb8c-c9b7-4844-a076-79722333da18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e1206d9079d4b2aab99745d1381efe6)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:33.328250 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0bb8c-c9b7-4844-a076-79722333da18 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:33.387905 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619740b4-d425-4bf4-92a7-adea7debb314 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:33.395803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a9a0bb8c-c9b7-4844-a076-79722333da18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e1206d9079d4b2aab99745d1381efe6', 'request_id': 'req-a9a0bb8c-c9b7-4844-a076-79722333da18'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:33.405525 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a9a0bb8c-c9b7-4844-a076-79722333da18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e1206d9079d4b2aab99745d1381efe6', 'request_id': 'req-a9a0bb8c-c9b7-4844-a076-79722333da18'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:33.412453 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a9a0bb8c-c9b7-4844-a076-79722333da18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e1206d9079d4b2aab99745d1381efe6', 'request_id': 'req-a9a0bb8c-c9b7-4844-a076-79722333da18'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:33.429043 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a9a0bb8c-c9b7-4844-a076-79722333da18 admin admin] The token cache is being invalidate because project 1e1206d9079d4b2aab99745d1381efe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:53:33.429043 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a9a0bb8c-c9b7-4844-a076-79722333da18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:33.430085 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a9a0bb8c-c9b7-4844-a076-79722333da18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:33.435338 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1048/2100] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:53:33 2022] DELETE /identity/v3/projects/1e1206d9079d4b2aab99745d1381efe6 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:53:33.437013 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0bb8c-c9b7-4844-a076-79722333da18 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:33.439593 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-a9a0bb8c-c9b7-4844-a076-79722333da18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:33.462852 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:33.496924 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d119c-9dfc-4e30-9e1d-948480f6d689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:33.497792 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d119c-9dfc-4e30-9e1d-948480f6d689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:33.498177 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d119c-9dfc-4e30-9e1d-948480f6d689 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:33.498553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d119c-9dfc-4e30-9e1d-948480f6d689 admin admin] PATH_INFO: `/v3/users/64bd19f40c30472f87d014cb89df8229` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:33.499926 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d119c-9dfc-4e30-9e1d-948480f6d689 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64bd19f40c30472f87d014cb89df8229)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:33.502897 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d119c-9dfc-4e30-9e1d-948480f6d689 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:33.529537 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:33.578040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-537d119c-9dfc-4e30-9e1d-948480f6d689 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64bd19f40c30472f87d014cb89df8229'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:33.579657 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-537d119c-9dfc-4e30-9e1d-948480f6d689 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64bd19f40c30472f87d014cb89df8229'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:33.581759 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-537d119c-9dfc-4e30-9e1d-948480f6d689 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64bd19f40c30472f87d014cb89df8229'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:33.594430 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0bb8c-c9b7-4844-a076-79722333da18 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:33.603600 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-537d119c-9dfc-4e30-9e1d-948480f6d689 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64bd19f40c30472f87d014cb89df8229'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:33.605559 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134e275-1a3c-4665-8ae3-dc0a7ad95cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:33.607352 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134e275-1a3c-4665-8ae3-dc0a7ad95cf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:33.607641 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134e275-1a3c-4665-8ae3-dc0a7ad95cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:33.607938 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134e275-1a3c-4665-8ae3-dc0a7ad95cf2 admin admin] PATH_INFO: `/v3/users/25072c3120524f208d19c356840b1f67` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:33.612441 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134e275-1a3c-4665-8ae3-dc0a7ad95cf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25072c3120524f208d19c356840b1f67)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:33.616304 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134e275-1a3c-4665-8ae3-dc0a7ad95cf2 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:33.618312 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-537d119c-9dfc-4e30-9e1d-948480f6d689 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64bd19f40c30472f87d014cb89df8229'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:33.640645 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1053/2101] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:53:33 2022] DELETE /identity/v3/users/64bd19f40c30472f87d014cb89df8229 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:53:33.718969 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a134e275-1a3c-4665-8ae3-dc0a7ad95cf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25072c3120524f208d19c356840b1f67'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:33.729207 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a134e275-1a3c-4665-8ae3-dc0a7ad95cf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25072c3120524f208d19c356840b1f67'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:33.730003 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a134e275-1a3c-4665-8ae3-dc0a7ad95cf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25072c3120524f208d19c356840b1f67'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:33.730707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a134e275-1a3c-4665-8ae3-dc0a7ad95cf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25072c3120524f208d19c356840b1f67'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:33.749382 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a134e275-1a3c-4665-8ae3-dc0a7ad95cf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25072c3120524f208d19c356840b1f67'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:33.771753 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1049/2102] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:53:33 2022] DELETE /identity/v3/users/25072c3120524f208d19c356840b1f67 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:53:34.019896 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d119c-9dfc-4e30-9e1d-948480f6d689 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:34.021836 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-537d119c-9dfc-4e30-9e1d-948480f6d689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:34.096364 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134e275-1a3c-4665-8ae3-dc0a7ad95cf2 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:34.097918 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-a134e275-1a3c-4665-8ae3-dc0a7ad95cf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:34.134935 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d119c-9dfc-4e30-9e1d-948480f6d689 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:34.203317 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134e275-1a3c-4665-8ae3-dc0a7ad95cf2 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:34.209860 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d78f5f-5d79-4011-80ba-d8ddb642cc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:34.210806 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d78f5f-5d79-4011-80ba-d8ddb642cc3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:34.211097 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d78f5f-5d79-4011-80ba-d8ddb642cc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:34.211384 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d78f5f-5d79-4011-80ba-d8ddb642cc3e admin admin] PATH_INFO: `/v3/projects/2fb9d79de9ef4d1d80d10f8e4315a321` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:34.212686 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d78f5f-5d79-4011-80ba-d8ddb642cc3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fb9d79de9ef4d1d80d10f8e4315a321)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:34.215668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d78f5f-5d79-4011-80ba-d8ddb642cc3e admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:34.216791 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9ed88-e378-48c5-8ddd-b6148f8d9bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:34.217578 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9ed88-e378-48c5-8ddd-b6148f8d9bd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:34.217938 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9ed88-e378-48c5-8ddd-b6148f8d9bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:34.218288 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9ed88-e378-48c5-8ddd-b6148f8d9bd6 admin admin] PATH_INFO: `/v3/projects/8b5c0096299e46d9b6f493a708e54087` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:34.219569 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec9ed88-e378-48c5-8ddd-b6148f8d9bd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b5c0096299e46d9b6f493a708e54087)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:34.221594 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec9ed88-e378-48c5-8ddd-b6148f8d9bd6 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:34.263848 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:34.286088 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:34.292527 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-7ec9ed88-e378-48c5-8ddd-b6148f8d9bd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b5c0096299e46d9b6f493a708e54087', 'request_id': 'req-7ec9ed88-e378-48c5-8ddd-b6148f8d9bd6'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:34.294340 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-d8d78f5f-5d79-4011-80ba-d8ddb642cc3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fb9d79de9ef4d1d80d10f8e4315a321', 'request_id': 'req-d8d78f5f-5d79-4011-80ba-d8ddb642cc3e'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:34.302501 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-7ec9ed88-e378-48c5-8ddd-b6148f8d9bd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b5c0096299e46d9b6f493a708e54087', 'request_id': 'req-7ec9ed88-e378-48c5-8ddd-b6148f8d9bd6'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:34.302983 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-d8d78f5f-5d79-4011-80ba-d8ddb642cc3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fb9d79de9ef4d1d80d10f8e4315a321', 'request_id': 'req-d8d78f5f-5d79-4011-80ba-d8ddb642cc3e'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:34.312129 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-7ec9ed88-e378-48c5-8ddd-b6148f8d9bd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b5c0096299e46d9b6f493a708e54087', 'request_id': 'req-7ec9ed88-e378-48c5-8ddd-b6148f8d9bd6'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:34.313124 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-d8d78f5f-5d79-4011-80ba-d8ddb642cc3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fb9d79de9ef4d1d80d10f8e4315a321', 'request_id': 'req-d8d78f5f-5d79-4011-80ba-d8ddb642cc3e'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:34.330231 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-7ec9ed88-e378-48c5-8ddd-b6148f8d9bd6 admin admin] The token cache is being invalidate because project 8b5c0096299e46d9b6f493a708e54087 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:53:34.330469 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-d8d78f5f-5d79-4011-80ba-d8ddb642cc3e admin admin] The token cache is being invalidate because project 2fb9d79de9ef4d1d80d10f8e4315a321 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:53:34.330554 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-7ec9ed88-e378-48c5-8ddd-b6148f8d9bd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:34.330886 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-d8d78f5f-5d79-4011-80ba-d8ddb642cc3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:34.331490 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-7ec9ed88-e378-48c5-8ddd-b6148f8d9bd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:34.331696 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-d8d78f5f-5d79-4011-80ba-d8ddb642cc3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:34.333823 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1050/2104] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:53:34 2022] DELETE /identity/v3/projects/2fb9d79de9ef4d1d80d10f8e4315a321 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:53:34.334482 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1054/2104] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:53:34 2022] DELETE /identity/v3/projects/8b5c0096299e46d9b6f493a708e54087 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:53:34.343969 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfe71c-0967-4cf0-8f1c-e33eb5ce7ec3 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:34.344250 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfe71c-0967-4cf0-8f1c-e33eb5ce7ec3 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:34.344645 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12435a-ba2b-43d9-8529-70dcc9e68f2f None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:34.344780 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfe71c-0967-4cf0-8f1c-e33eb5ce7ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:34.344871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12435a-ba2b-43d9-8529-70dcc9e68f2f None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:34.345032 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12435a-ba2b-43d9-8529-70dcc9e68f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:34.368815 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-ee12435a-ba2b-43d9-8529-70dcc9e68f2f None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:34.369543 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-ee12435a-ba2b-43d9-8529-70dcc9e68f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:34.371491 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-91dfe71c-0967-4cf0-8f1c-e33eb5ce7ec3 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:34.373010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-91dfe71c-0967-4cf0-8f1c-e33eb5ce7ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:34.446753 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1051/2105] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:53:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:34.455403 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436461f-3bb3-47c5-848f-3365d82e3281 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:34.455685 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436461f-3bb3-47c5-848f-3365d82e3281 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:34.463001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436461f-3bb3-47c5-848f-3365d82e3281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:34.463198 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1055/2106] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:53:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:34.470058 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fbf9d-4e1d-4028-8e06-27a0b2632b1e None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:34.470498 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fbf9d-4e1d-4028-8e06-27a0b2632b1e None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:34.471021 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fbf9d-4e1d-4028-8e06-27a0b2632b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:34.476626 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-1436461f-3bb3-47c5-848f-3365d82e3281 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:34.478101 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-1436461f-3bb3-47c5-848f-3365d82e3281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:34.491854 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1052/2107] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:53:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:34.492995 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436461f-3bb3-47c5-848f-3365d82e3281 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:34.496399 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-d23fbf9d-4e1d-4028-8e06-27a0b2632b1e None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:34.498250 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-d23fbf9d-4e1d-4028-8e06-27a0b2632b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:34.507156 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436461f-3bb3-47c5-848f-3365d82e3281 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:34.513405 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1056/2108] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:53:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:34.513852 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022faf3-023c-403d-bd43-b8ef4ae4117f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:34.514478 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022faf3-023c-403d-bd43-b8ef4ae4117f admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:34.514762 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022faf3-023c-403d-bd43-b8ef4ae4117f admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:34.515035 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022faf3-023c-403d-bd43-b8ef4ae4117f admin admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:34.515742 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022faf3-023c-403d-bd43-b8ef4ae4117f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:53:34.516045 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022faf3-023c-403d-bd43-b8ef4ae4117f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:34.517754 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022faf3-023c-403d-bd43-b8ef4ae4117f admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:34.518619 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fbf9d-4e1d-4028-8e06-27a0b2632b1e None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:34.536959 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1053/2109] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:53:34.537183 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fbf9d-4e1d-4028-8e06-27a0b2632b1e None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:34.540850 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2d413-6195-4b33-8982-8251e7d7d734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:34.541421 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022faf3-023c-403d-bd43-b8ef4ae4117f admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:34.541743 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2d413-6195-4b33-8982-8251e7d7d734 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:34.542249 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2d413-6195-4b33-8982-8251e7d7d734 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:34.542632 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2d413-6195-4b33-8982-8251e7d7d734 admin admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:34.543457 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2d413-6195-4b33-8982-8251e7d7d734 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:53:34.543869 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2d413-6195-4b33-8982-8251e7d7d734 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:34.545731 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2d413-6195-4b33-8982-8251e7d7d734 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:34.556733 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022faf3-023c-403d-bd43-b8ef4ae4117f admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:34.561655 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1057/2110] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:53:34.563056 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91992a-77b4-4199-b995-dee4a2cd7ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:34.563907 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91992a-77b4-4199-b995-dee4a2cd7ffe admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:34.564230 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91992a-77b4-4199-b995-dee4a2cd7ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:34.564598 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91992a-77b4-4199-b995-dee4a2cd7ffe admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:34.565535 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a91992a-77b4-4199-b995-dee4a2cd7ffe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:34.566410 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2d413-6195-4b33-8982-8251e7d7d734 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:34.567828 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a91992a-77b4-4199-b995-dee4a2cd7ffe admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:34.578626 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2d413-6195-4b33-8982-8251e7d7d734 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:34.587433 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f9abf-43f3-4f91-8483-2c135c2b3e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:34.588330 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f9abf-43f3-4f91-8483-2c135c2b3e71 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:34.588815 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f9abf-43f3-4f91-8483-2c135c2b3e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:34.589060 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f9abf-43f3-4f91-8483-2c135c2b3e71 admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:34.589972 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f9abf-43f3-4f91-8483-2c135c2b3e71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:34.592051 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f9abf-43f3-4f91-8483-2c135c2b3e71 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:34.609143 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1054/2111] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:53:34 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:53:34.613600 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91992a-77b4-4199-b995-dee4a2cd7ffe admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:34.639488 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1058/2112] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:53:34 2022] POST /identity/v3/projects => generated 375 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:53:34.643720 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f9abf-43f3-4f91-8483-2c135c2b3e71 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:34.714102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91992a-77b4-4199-b995-dee4a2cd7ffe admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:34.759138 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f9abf-43f3-4f91-8483-2c135c2b3e71 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:34.761291 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:34.776419 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7bf25-5d75-41a9-9f3c-0a6f812397fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:34.777204 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7bf25-5d75-41a9-9f3c-0a6f812397fe admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:34.777589 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7bf25-5d75-41a9-9f3c-0a6f812397fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:34.777906 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7bf25-5d75-41a9-9f3c-0a6f812397fe admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:34.778551 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7bf25-5d75-41a9-9f3c-0a6f812397fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:34.782006 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7bf25-5d75-41a9-9f3c-0a6f812397fe admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:34.825777 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1059/2113] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:53:34 2022] POST /identity/v3/users => generated 288 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:53:34.838664 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7bf25-5d75-41a9-9f3c-0a6f812397fe admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:34.858353 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d336d-156c-4282-8066-74f469e2be13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:34.859431 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d336d-156c-4282-8066-74f469e2be13 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:34.859898 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d336d-156c-4282-8066-74f469e2be13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:34.860885 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d336d-156c-4282-8066-74f469e2be13 admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:34.861903 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d336d-156c-4282-8066-74f469e2be13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:34.862677 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7bf25-5d75-41a9-9f3c-0a6f812397fe admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:34.864705 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d336d-156c-4282-8066-74f469e2be13 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:34.880508 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51427f-d136-42c2-9526-dc115c917ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:34.881203 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51427f-d136-42c2-9526-dc115c917ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:34.881486 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51427f-d136-42c2-9526-dc115c917ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:34.881790 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51427f-d136-42c2-9526-dc115c917ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:34.887926 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b51427f-d136-42c2-9526-dc115c917ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:34.895349 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b51427f-d136-42c2-9526-dc115c917ff6 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:34.950048 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1060/2114] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:53:34.953693 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1055/2115] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:53:34 2022] POST /identity/v3/users => generated 292 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:53:34.954887 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51427f-d136-42c2-9526-dc115c917ff6 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:34.958235 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d336d-156c-4282-8066-74f469e2be13 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:35.001880 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51427f-d136-42c2-9526-dc115c917ff6 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:35.007801 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d336d-156c-4282-8066-74f469e2be13 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:35.018136 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb5791-c2fa-468d-9209-06a0f6439e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:35.022926 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb5791-c2fa-468d-9209-06a0f6439e2a admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:35.023785 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb5791-c2fa-468d-9209-06a0f6439e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:35.024476 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb5791-c2fa-468d-9209-06a0f6439e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:35.026244 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb5791-c2fa-468d-9209-06a0f6439e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:35.036293 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7bc4f-2090-474c-8354-03127711b2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:35.036293 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7bc4f-2090-474c-8354-03127711b2cc admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:35.036293 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7bc4f-2090-474c-8354-03127711b2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:35.036293 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7bc4f-2090-474c-8354-03127711b2cc admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:35.036754 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7bc4f-2090-474c-8354-03127711b2cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:35.036754 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7bc4f-2090-474c-8354-03127711b2cc admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:35.037446 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb5791-c2fa-468d-9209-06a0f6439e2a admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:35.075707 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:35.088589 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1061/2117] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:53:35.088930 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1056/2117] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:53:35.092956 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7bc4f-2090-474c-8354-03127711b2cc admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:35.094377 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb5791-c2fa-468d-9209-06a0f6439e2a admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:35.136107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb5791-c2fa-468d-9209-06a0f6439e2a admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:35.141030 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7bc4f-2090-474c-8354-03127711b2cc admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:35.143419 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06cd8d-737c-4abc-8e65-891594b8012a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:35.144354 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06cd8d-737c-4abc-8e65-891594b8012a admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:35.144800 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06cd8d-737c-4abc-8e65-891594b8012a admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:35.145235 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06cd8d-737c-4abc-8e65-891594b8012a admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:35.146140 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c06cd8d-737c-4abc-8e65-891594b8012a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:35.150726 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c06cd8d-737c-4abc-8e65-891594b8012a admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:35.161786 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c5563-5407-4dc3-ac6f-432b8c77ab87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:35.166536 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c5563-5407-4dc3-ac6f-432b8c77ab87 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:35.166766 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1062/2118] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:53:35.166883 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c5563-5407-4dc3-ac6f-432b8c77ab87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:35.166883 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c5563-5407-4dc3-ac6f-432b8c77ab87 admin admin] PATH_INFO: `/v3/projects/2effb224a235480b954950207a483382/users/3aac5622022548acbf554375d3ae2cb5/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:35.175015 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06cd8d-737c-4abc-8e65-891594b8012a admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:35.195577 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c5563-5407-4dc3-ac6f-432b8c77ab87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2effb224a235480b954950207a483382, user_id=3aac5622022548acbf554375d3ae2cb5, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:35.203812 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c5563-5407-4dc3-ac6f-432b8c77ab87 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:35.204052 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06cd8d-737c-4abc-8e65-891594b8012a admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:35.209442 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdafb5-8bed-44df-b72d-7241a0346658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:35.210422 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdafb5-8bed-44df-b72d-7241a0346658 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:35.210704 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdafb5-8bed-44df-b72d-7241a0346658 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:35.210999 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdafb5-8bed-44df-b72d-7241a0346658 admin admin] PATH_INFO: `/v3/projects/554fa4f3e07c412c84e57de6c2388e01/users/b2872ce6212c487699e3e32cc7421399/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:35.218836 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1057/2119] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:53:35 2022] PUT /identity/v3/projects/2effb224a235480b954950207a483382/users/3aac5622022548acbf554375d3ae2cb5/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:53:35.229310 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4d83e-5a10-4254-bfef-f016c670f793 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:35.229624 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4d83e-5a10-4254-bfef-f016c670f793 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:35.229922 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4d83e-5a10-4254-bfef-f016c670f793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:35.232494 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fdafb5-8bed-44df-b72d-7241a0346658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=554fa4f3e07c412c84e57de6c2388e01, user_id=b2872ce6212c487699e3e32cc7421399, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:35.235419 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fdafb5-8bed-44df-b72d-7241a0346658 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:35.256900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1063/2120] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:53:35 2022] PUT /identity/v3/projects/554fa4f3e07c412c84e57de6c2388e01/users/b2872ce6212c487699e3e32cc7421399/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:53:35.272535 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed2528-cfba-4d93-b6f3-52cfdd8d6a58 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:35.273064 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed2528-cfba-4d93-b6f3-52cfdd8d6a58 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:35.273583 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed2528-cfba-4d93-b6f3-52cfdd8d6a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:35.283905 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-ddd4d83e-5a10-4254-bfef-f016c670f793 None None] MFA Rules not processed for user `3aac5622022548acbf554375d3ae2cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:35.285247 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-ddd4d83e-5a10-4254-bfef-f016c670f793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:35.316671 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-02ed2528-cfba-4d93-b6f3-52cfdd8d6a58 None None] MFA Rules not processed for user `b2872ce6212c487699e3e32cc7421399`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:35.319200 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-02ed2528-cfba-4d93-b6f3-52cfdd8d6a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:35.398368 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1058/2121] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:53:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:53:35.410887 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4d83e-5a10-4254-bfef-f016c670f793 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:35.413275 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-ddd4d83e-5a10-4254-bfef-f016c670f793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:35.423132 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1064/2122] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:53:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:35.436424 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed2528-cfba-4d93-b6f3-52cfdd8d6a58 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:35.438564 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-02ed2528-cfba-4d93-b6f3-52cfdd8d6a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:35.524343 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed2528-cfba-4d93-b6f3-52cfdd8d6a58 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:35.530560 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4290a4-5b75-4523-9204-79fa158b0815 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:35.531338 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4290a4-5b75-4523-9204-79fa158b0815 service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:35.531922 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4290a4-5b75-4523-9204-79fa158b0815 service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:35.532122 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4290a4-5b75-4523-9204-79fa158b0815 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:35.535708 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4d83e-5a10-4254-bfef-f016c670f793 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:35.544796 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74980ac1-ff87-45d5-88bc-df43856d1d1a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2f23f4936684b63afc095986e43ec37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:35.545839 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74980ac1-ff87-45d5-88bc-df43856d1d1a service glance] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:35.546292 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74980ac1-ff87-45d5-88bc-df43856d1d1a service glance] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:35.546737 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74980ac1-ff87-45d5-88bc-df43856d1d1a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:35.546867 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4290a4-5b75-4523-9204-79fa158b0815 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:35.549014 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4290a4-5b75-4523-9204-79fa158b0815 service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:35.554839 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:35.561276 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74980ac1-ff87-45d5-88bc-df43856d1d1a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:35.563035 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74980ac1-ff87-45d5-88bc-df43856d1d1a service glance] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:35.564145 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1065/2123] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:53:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:53:35.588064 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4290a4-5b75-4523-9204-79fa158b0815 service cinder] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:35.588244 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1059/2124] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:53:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:53:35.661515 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:35.667913 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4290a4-5b75-4523-9204-79fa158b0815 service cinder] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:35.675560 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cad6d-5b07-4463-9dbd-59f5870421e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:35.676361 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cad6d-5b07-4463-9dbd-59f5870421e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:35.676685 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cad6d-5b07-4463-9dbd-59f5870421e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:35.676935 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cad6d-5b07-4463-9dbd-59f5870421e6 admin admin] PATH_INFO: `/v3/users/b2872ce6212c487699e3e32cc7421399` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:35.678426 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217cad6d-5b07-4463-9dbd-59f5870421e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2872ce6212c487699e3e32cc7421399)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:35.680464 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217cad6d-5b07-4463-9dbd-59f5870421e6 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:35.738591 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-217cad6d-5b07-4463-9dbd-59f5870421e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2872ce6212c487699e3e32cc7421399'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:35.739660 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-217cad6d-5b07-4463-9dbd-59f5870421e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2872ce6212c487699e3e32cc7421399'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:35.741207 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-217cad6d-5b07-4463-9dbd-59f5870421e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2872ce6212c487699e3e32cc7421399'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:35.759688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-217cad6d-5b07-4463-9dbd-59f5870421e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2872ce6212c487699e3e32cc7421399'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:35.768739 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-217cad6d-5b07-4463-9dbd-59f5870421e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2872ce6212c487699e3e32cc7421399'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:35.791390 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1066/2125] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:53:35 2022] DELETE /identity/v3/users/b2872ce6212c487699e3e32cc7421399 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:53:35.795876 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c44769-5f2a-40da-b9c9-ab26d1aac92e None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:35.796150 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c44769-5f2a-40da-b9c9-ab26d1aac92e None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:35.796443 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c44769-5f2a-40da-b9c9-ab26d1aac92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:35.821757 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-a6c44769-5f2a-40da-b9c9-ab26d1aac92e None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:35.823139 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-a6c44769-5f2a-40da-b9c9-ab26d1aac92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:35.904599 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1060/2126] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:35.915483 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cad6d-5b07-4463-9dbd-59f5870421e6 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:35.916917 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-217cad6d-5b07-4463-9dbd-59f5870421e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:36.038341 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cad6d-5b07-4463-9dbd-59f5870421e6 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:36.041843 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e955713-10b8-470f-b4c2-7d2254eb3fe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:36.042558 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e955713-10b8-470f-b4c2-7d2254eb3fe6 service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:36.042920 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e955713-10b8-470f-b4c2-7d2254eb3fe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:36.043037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e955713-10b8-470f-b4c2-7d2254eb3fe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:36.058822 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e955713-10b8-470f-b4c2-7d2254eb3fe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:36.060525 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e955713-10b8-470f-b4c2-7d2254eb3fe6 service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:36.074251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1067/2127] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:53:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:53:36.592777 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c44769-5f2a-40da-b9c9-ab26d1aac92e None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:36.594479 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-a6c44769-5f2a-40da-b9c9-ab26d1aac92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:36.635354 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c44769-5f2a-40da-b9c9-ab26d1aac92e None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:36.650672 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb313840-13c8-4f6f-8fa8-1d1a4d6d4fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:36.651533 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb313840-13c8-4f6f-8fa8-1d1a4d6d4fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:36.651913 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb313840-13c8-4f6f-8fa8-1d1a4d6d4fce admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:36.652228 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb313840-13c8-4f6f-8fa8-1d1a4d6d4fce admin admin] PATH_INFO: `/v3/projects/554fa4f3e07c412c84e57de6c2388e01` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:36.653680 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb313840-13c8-4f6f-8fa8-1d1a4d6d4fce admin admin] RBAC: Authorizing `identity:delete_project(project_id=554fa4f3e07c412c84e57de6c2388e01)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:36.655597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb313840-13c8-4f6f-8fa8-1d1a4d6d4fce admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:36.723214 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-cb313840-13c8-4f6f-8fa8-1d1a4d6d4fce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '554fa4f3e07c412c84e57de6c2388e01', 'request_id': 'req-cb313840-13c8-4f6f-8fa8-1d1a4d6d4fce'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:36.730883 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-cb313840-13c8-4f6f-8fa8-1d1a4d6d4fce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '554fa4f3e07c412c84e57de6c2388e01', 'request_id': 'req-cb313840-13c8-4f6f-8fa8-1d1a4d6d4fce'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:36.736454 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-cb313840-13c8-4f6f-8fa8-1d1a4d6d4fce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '554fa4f3e07c412c84e57de6c2388e01', 'request_id': 'req-cb313840-13c8-4f6f-8fa8-1d1a4d6d4fce'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:36.748749 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-cb313840-13c8-4f6f-8fa8-1d1a4d6d4fce admin admin] The token cache is being invalidate because project 554fa4f3e07c412c84e57de6c2388e01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:53:36.749021 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-cb313840-13c8-4f6f-8fa8-1d1a4d6d4fce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:36.749674 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-cb313840-13c8-4f6f-8fa8-1d1a4d6d4fce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:36.751513 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1061/2128] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:53:36 2022] DELETE /identity/v3/projects/554fa4f3e07c412c84e57de6c2388e01 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:53:36.756758 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c615cc4-9e0d-4440-822e-a3b481af710a None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:36.757233 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c615cc4-9e0d-4440-822e-a3b481af710a None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:36.757330 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c615cc4-9e0d-4440-822e-a3b481af710a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:36.777309 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-1c615cc4-9e0d-4440-822e-a3b481af710a None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:36.778567 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-1c615cc4-9e0d-4440-822e-a3b481af710a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:36.872934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1068/2129] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:36.883194 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037c47a-94ed-4478-b0d9-2f53a0728059 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:36.883526 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037c47a-94ed-4478-b0d9-2f53a0728059 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:36.883776 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037c47a-94ed-4478-b0d9-2f53a0728059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:36.910969 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-2037c47a-94ed-4478-b0d9-2f53a0728059 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:36.913122 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-2037c47a-94ed-4478-b0d9-2f53a0728059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:36.927069 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1062/2130] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:36.928523 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c615cc4-9e0d-4440-822e-a3b481af710a None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:36.939337 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c615cc4-9e0d-4440-822e-a3b481af710a None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:36.949379 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793e1a4-8559-45bf-8b78-35cb7448dfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:36.956685 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793e1a4-8559-45bf-8b78-35cb7448dfe8 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:36.957040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793e1a4-8559-45bf-8b78-35cb7448dfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:36.958262 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793e1a4-8559-45bf-8b78-35cb7448dfe8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:36.959854 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793e1a4-8559-45bf-8b78-35cb7448dfe8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:53:36.960292 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793e1a4-8559-45bf-8b78-35cb7448dfe8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:36.963166 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793e1a4-8559-45bf-8b78-35cb7448dfe8 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:36.977737 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1069/2131] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:53:36.982365 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037c47a-94ed-4478-b0d9-2f53a0728059 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:36.992946 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037c47a-94ed-4478-b0d9-2f53a0728059 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:36.999007 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bc07e-8a39-49d9-939e-88635bc537cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:36.999909 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bc07e-8a39-49d9-939e-88635bc537cc admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:37.000111 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bc07e-8a39-49d9-939e-88635bc537cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:37.000616 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bc07e-8a39-49d9-939e-88635bc537cc admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:37.001679 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bc07e-8a39-49d9-939e-88635bc537cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:37.004329 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bc07e-8a39-49d9-939e-88635bc537cc admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:37.036524 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1063/2132] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:53:36 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:53:37.041188 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793e1a4-8559-45bf-8b78-35cb7448dfe8 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:37.061371 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793e1a4-8559-45bf-8b78-35cb7448dfe8 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:37.066486 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:37.133941 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e994ea8-c7f1-4438-9b13-fffcdee3068c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:37.134602 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e994ea8-c7f1-4438-9b13-fffcdee3068c admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:37.134893 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e994ea8-c7f1-4438-9b13-fffcdee3068c admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:37.135409 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e994ea8-c7f1-4438-9b13-fffcdee3068c admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:37.135884 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e994ea8-c7f1-4438-9b13-fffcdee3068c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:37.138000 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e994ea8-c7f1-4438-9b13-fffcdee3068c admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:37.163974 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1070/2133] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:53:37 2022] POST /identity/v3/users => generated 283 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:53:37.168803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bc07e-8a39-49d9-939e-88635bc537cc admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:37.182442 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bc07e-8a39-49d9-939e-88635bc537cc admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:37.187976 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7809a-3479-47d9-946f-fc4228700fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:37.188616 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7809a-3479-47d9-946f-fc4228700fda admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:37.189031 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7809a-3479-47d9-946f-fc4228700fda admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:37.189333 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7809a-3479-47d9-946f-fc4228700fda admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:37.190057 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7809a-3479-47d9-946f-fc4228700fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:37.191680 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7809a-3479-47d9-946f-fc4228700fda admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:37.202900 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1064/2134] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:53:37.207294 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e994ea8-c7f1-4438-9b13-fffcdee3068c admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:37.218392 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e994ea8-c7f1-4438-9b13-fffcdee3068c admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:37.223760 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574958b2-cef9-4f6f-82a1-79ca174fc0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:37.224982 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574958b2-cef9-4f6f-82a1-79ca174fc0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:37.225523 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574958b2-cef9-4f6f-82a1-79ca174fc0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:37.225967 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574958b2-cef9-4f6f-82a1-79ca174fc0b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:37.226826 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574958b2-cef9-4f6f-82a1-79ca174fc0b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:37.228646 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574958b2-cef9-4f6f-82a1-79ca174fc0b5 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:37.241462 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1071/2135] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:53:37.245760 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7809a-3479-47d9-946f-fc4228700fda admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:37.257838 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7809a-3479-47d9-946f-fc4228700fda admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:37.262877 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3525744-99ed-4b73-a9ef-5d8c1ea066df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:37.263556 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3525744-99ed-4b73-a9ef-5d8c1ea066df admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:37.264100 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3525744-99ed-4b73-a9ef-5d8c1ea066df admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:37.264663 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3525744-99ed-4b73-a9ef-5d8c1ea066df admin admin] PATH_INFO: `/v3/projects/8ab28fca596e43a3a4522a4fa0a939f0/users/a032c1df21b44cb2b7d4b47870f032b8/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:37.288213 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3525744-99ed-4b73-a9ef-5d8c1ea066df admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ab28fca596e43a3a4522a4fa0a939f0, user_id=a032c1df21b44cb2b7d4b47870f032b8, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:37.291072 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3525744-99ed-4b73-a9ef-5d8c1ea066df admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:37.322280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1065/2136] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:53:37 2022] PUT /identity/v3/projects/8ab28fca596e43a3a4522a4fa0a939f0/users/a032c1df21b44cb2b7d4b47870f032b8/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:53:37.327726 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00863721-68cd-40e4-8d62-94bc75d8eb7d None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:37.328099 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00863721-68cd-40e4-8d62-94bc75d8eb7d None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:37.328382 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00863721-68cd-40e4-8d62-94bc75d8eb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:37.364222 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-00863721-68cd-40e4-8d62-94bc75d8eb7d None None] MFA Rules not processed for user `a032c1df21b44cb2b7d4b47870f032b8`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:37.366249 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-00863721-68cd-40e4-8d62-94bc75d8eb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:37.441649 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1072/2137] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:53:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:37.453464 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3525744-99ed-4b73-a9ef-5d8c1ea066df admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:37.455227 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-f3525744-99ed-4b73-a9ef-5d8c1ea066df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:37.472086 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:37.525967 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3525744-99ed-4b73-a9ef-5d8c1ea066df admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:37.538665 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064206e-3cd7-491f-8398-e7ffe5f76bc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:37.539438 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064206e-3cd7-491f-8398-e7ffe5f76bc4 service cinder] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:37.539876 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064206e-3cd7-491f-8398-e7ffe5f76bc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:37.540165 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064206e-3cd7-491f-8398-e7ffe5f76bc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:37.563347 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064206e-3cd7-491f-8398-e7ffe5f76bc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:37.565131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064206e-3cd7-491f-8398-e7ffe5f76bc4 service cinder] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:37.592456 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1066/2138] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:53:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:53:47.438335 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=63,keystone:INSERT=3 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:47.580822 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbfb33-4fca-4333-938c-45d5217d59c8 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:47.581125 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbfb33-4fca-4333-938c-45d5217d59c8 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:47.581423 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbfb33-4fca-4333-938c-45d5217d59c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:47.582773 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=20 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:47.602554 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-02cbfb33-4fca-4333-938c-45d5217d59c8 None None] MFA Rules not processed for user `539502db204e415c85520d9b7fe77d99`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:47.603847 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-02cbfb33-4fca-4333-938c-45d5217d59c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:47.667674 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1073/2139] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:53:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:54.853338 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6f952-4d9f-44e2-aefc-a488b7a40582 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:54.853947 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6f952-4d9f-44e2-aefc-a488b7a40582 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:54.854272 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6f952-4d9f-44e2-aefc-a488b7a40582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:54.881156 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-04d6f952-4d9f-44e2-aefc-a488b7a40582 None None] MFA Rules not processed for user `a994c976b95744ed9723bf9c4386bde1`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:54.882976 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-04d6f952-4d9f-44e2-aefc-a488b7a40582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:54.945986 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1067/2140] 10.222.0.46 () {58 vars in 967 bytes} [Wed Aug 3 12:53:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:54.958666 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cbfb33-4fca-4333-938c-45d5217d59c8 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:54.960085 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-02cbfb33-4fca-4333-938c-45d5217d59c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:55.046099 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cbfb33-4fca-4333-938c-45d5217d59c8 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:55.065584 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f4d88-af60-409f-b143-78bcd8c60a4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67df369737ea4c83bae134f4bf2de20d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:55.066228 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f4d88-af60-409f-b143-78bcd8c60a4f service swift] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:55.066511 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f4d88-af60-409f-b143-78bcd8c60a4f service swift] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:55.066786 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f4d88-af60-409f-b143-78bcd8c60a4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:55.076278 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33f4d88-af60-409f-b143-78bcd8c60a4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:55.077941 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33f4d88-af60-409f-b143-78bcd8c60a4f service swift] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:55.086894 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1074/2141] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Aug 3 12:53:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 12:53:57.084606 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6f952-4d9f-44e2-aefc-a488b7a40582 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:57.086503 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-04d6f952-4d9f-44e2-aefc-a488b7a40582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:57.158592 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6f952-4d9f-44e2-aefc-a488b7a40582 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:57.163088 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30346793-d3ff-4893-b5d3-6215e7ccc213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:57.163741 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30346793-d3ff-4893-b5d3-6215e7ccc213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:57.164043 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30346793-d3ff-4893-b5d3-6215e7ccc213 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:57.164295 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30346793-d3ff-4893-b5d3-6215e7ccc213 admin admin] PATH_INFO: `/v3/users/e10d580c2d244cd5addb0a88de7689c8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:57.165447 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30346793-d3ff-4893-b5d3-6215e7ccc213 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e10d580c2d244cd5addb0a88de7689c8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:57.167370 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30346793-d3ff-4893-b5d3-6215e7ccc213 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:57.217705 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-30346793-d3ff-4893-b5d3-6215e7ccc213 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e10d580c2d244cd5addb0a88de7689c8'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:57.226193 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-30346793-d3ff-4893-b5d3-6215e7ccc213 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e10d580c2d244cd5addb0a88de7689c8'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:57.227323 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-30346793-d3ff-4893-b5d3-6215e7ccc213 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e10d580c2d244cd5addb0a88de7689c8'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:57.227935 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-30346793-d3ff-4893-b5d3-6215e7ccc213 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e10d580c2d244cd5addb0a88de7689c8'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:57.241429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-30346793-d3ff-4893-b5d3-6215e7ccc213 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e10d580c2d244cd5addb0a88de7689c8'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:57.255123 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1068/2142] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:53:57 2022] DELETE /identity/v3/users/e10d580c2d244cd5addb0a88de7689c8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:53:57.439785 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f4d88-af60-409f-b143-78bcd8c60a4f service swift] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:57.450955 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f4d88-af60-409f-b143-78bcd8c60a4f service swift] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:57.511736 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe91f91-2aac-4a4a-9fe2-fdeef5d0623c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:57.512382 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe91f91-2aac-4a4a-9fe2-fdeef5d0623c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:57.512656 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe91f91-2aac-4a4a-9fe2-fdeef5d0623c admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:57.512928 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe91f91-2aac-4a4a-9fe2-fdeef5d0623c admin admin] PATH_INFO: `/v3/projects/0ff2495b6df94c0d9d4fe331e780b197` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:57.514109 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe91f91-2aac-4a4a-9fe2-fdeef5d0623c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ff2495b6df94c0d9d4fe331e780b197)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:57.516013 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe91f91-2aac-4a4a-9fe2-fdeef5d0623c admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:57.560150 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:57.569982 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-bbe91f91-2aac-4a4a-9fe2-fdeef5d0623c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ff2495b6df94c0d9d4fe331e780b197', 'request_id': 'req-bbe91f91-2aac-4a4a-9fe2-fdeef5d0623c'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:57.576296 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-bbe91f91-2aac-4a4a-9fe2-fdeef5d0623c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ff2495b6df94c0d9d4fe331e780b197', 'request_id': 'req-bbe91f91-2aac-4a4a-9fe2-fdeef5d0623c'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:57.584812 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-bbe91f91-2aac-4a4a-9fe2-fdeef5d0623c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ff2495b6df94c0d9d4fe331e780b197', 'request_id': 'req-bbe91f91-2aac-4a4a-9fe2-fdeef5d0623c'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:57.597823 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-bbe91f91-2aac-4a4a-9fe2-fdeef5d0623c admin admin] The token cache is being invalidate because project 0ff2495b6df94c0d9d4fe331e780b197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:53:57.598116 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-bbe91f91-2aac-4a4a-9fe2-fdeef5d0623c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:57.598760 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-bbe91f91-2aac-4a4a-9fe2-fdeef5d0623c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:53:57.600615 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1075/2143] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:53:57 2022] DELETE /identity/v3/projects/0ff2495b6df94c0d9d4fe331e780b197 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:53:57.605942 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f7d6b-3475-4eae-b92b-c91b78422e7f None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:57.606268 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f7d6b-3475-4eae-b92b-c91b78422e7f None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:57.606548 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f7d6b-3475-4eae-b92b-c91b78422e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:57.627209 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-e07f7d6b-3475-4eae-b92b-c91b78422e7f None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:57.628438 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-e07f7d6b-3475-4eae-b92b-c91b78422e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:57.647600 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:53:57.691376 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1069/2144] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:57.699141 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc646e4c-8488-4324-9885-43899d63f48d None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:57.699431 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc646e4c-8488-4324-9885-43899d63f48d None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:57.699713 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc646e4c-8488-4324-9885-43899d63f48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:57.720146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-bc646e4c-8488-4324-9885-43899d63f48d None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:57.721373 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-bc646e4c-8488-4324-9885-43899d63f48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:57.731150 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1076/2145] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:57.735321 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f7d6b-3475-4eae-b92b-c91b78422e7f None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:57.746277 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f7d6b-3475-4eae-b92b-c91b78422e7f None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:57.751637 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2701b0f-9729-4774-b099-7fc1711cfe03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:57.752402 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2701b0f-9729-4774-b099-7fc1711cfe03 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:57.752687 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2701b0f-9729-4774-b099-7fc1711cfe03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:57.752965 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2701b0f-9729-4774-b099-7fc1711cfe03 admin admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:57.754282 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2701b0f-9729-4774-b099-7fc1711cfe03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:53:57.754595 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2701b0f-9729-4774-b099-7fc1711cfe03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:57.756225 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2701b0f-9729-4774-b099-7fc1711cfe03 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:57.772596 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1070/2146] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:53:57.777764 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc646e4c-8488-4324-9885-43899d63f48d None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:57.787302 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc646e4c-8488-4324-9885-43899d63f48d None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:57.792734 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80387eee-4ffc-4ceb-bcec-22806dbf74e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:57.793337 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80387eee-4ffc-4ceb-bcec-22806dbf74e6 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:57.793652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80387eee-4ffc-4ceb-bcec-22806dbf74e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:57.793933 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80387eee-4ffc-4ceb-bcec-22806dbf74e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:57.794606 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80387eee-4ffc-4ceb-bcec-22806dbf74e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:57.796514 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80387eee-4ffc-4ceb-bcec-22806dbf74e6 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:57.823239 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1077/2147] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:53:57 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:53:57.829553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2701b0f-9729-4774-b099-7fc1711cfe03 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:57.841022 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2701b0f-9729-4774-b099-7fc1711cfe03 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:57.898800 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c8cae-eaa5-4999-ae9f-304c905dd8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:57.900159 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c8cae-eaa5-4999-ae9f-304c905dd8bf admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:57.900486 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c8cae-eaa5-4999-ae9f-304c905dd8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:57.900759 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c8cae-eaa5-4999-ae9f-304c905dd8bf admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:57.901419 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c8cae-eaa5-4999-ae9f-304c905dd8bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:57.903366 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c8cae-eaa5-4999-ae9f-304c905dd8bf admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:57.929065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1071/2148] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:53:57 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:53:57.930462 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80387eee-4ffc-4ceb-bcec-22806dbf74e6 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:57.949598 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80387eee-4ffc-4ceb-bcec-22806dbf74e6 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:57.954313 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72042cd-0fa9-4019-9f04-4b15442ad804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:57.954933 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72042cd-0fa9-4019-9f04-4b15442ad804 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:57.955220 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72042cd-0fa9-4019-9f04-4b15442ad804 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:57.955498 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72042cd-0fa9-4019-9f04-4b15442ad804 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:57.956202 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72042cd-0fa9-4019-9f04-4b15442ad804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:57.957848 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72042cd-0fa9-4019-9f04-4b15442ad804 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:57.968913 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1078/2149] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:53:57.974144 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c8cae-eaa5-4999-ae9f-304c905dd8bf admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:57.984417 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c8cae-eaa5-4999-ae9f-304c905dd8bf admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:57.989036 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e078a9-f2fa-4287-8189-b262e67559a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:57.989688 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e078a9-f2fa-4287-8189-b262e67559a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:57.989969 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e078a9-f2fa-4287-8189-b262e67559a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:57.990244 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e078a9-f2fa-4287-8189-b262e67559a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:57.990937 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e078a9-f2fa-4287-8189-b262e67559a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:57.992515 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e078a9-f2fa-4287-8189-b262e67559a1 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:58.004320 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1072/2150] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:53:58.009338 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72042cd-0fa9-4019-9f04-4b15442ad804 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:58.019693 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72042cd-0fa9-4019-9f04-4b15442ad804 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:58.024876 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885f0c5-b89d-42ab-badb-5a68cae200e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:58.025730 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885f0c5-b89d-42ab-badb-5a68cae200e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:58.026015 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885f0c5-b89d-42ab-badb-5a68cae200e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:58.026291 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885f0c5-b89d-42ab-badb-5a68cae200e2 admin admin] PATH_INFO: `/v3/projects/b4ef6c78536d4a45890fb790fc90831a/users/84d82b8398eb4d649e76e1ee6c454e8c/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:58.040878 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885f0c5-b89d-42ab-badb-5a68cae200e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4ef6c78536d4a45890fb790fc90831a, user_id=84d82b8398eb4d649e76e1ee6c454e8c, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:58.043560 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885f0c5-b89d-42ab-badb-5a68cae200e2 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:58.056417 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1079/2151] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:53:58 2022] PUT /identity/v3/projects/b4ef6c78536d4a45890fb790fc90831a/users/84d82b8398eb4d649e76e1ee6c454e8c/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:53:58.066439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a30347-2a48-4f3f-8f13-eabfe4bed468 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:58.066728 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a30347-2a48-4f3f-8f13-eabfe4bed468 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:58.067005 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a30347-2a48-4f3f-8f13-eabfe4bed468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:58.099140 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-43a30347-2a48-4f3f-8f13-eabfe4bed468 None None] MFA Rules not processed for user `84d82b8398eb4d649e76e1ee6c454e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:53:58.100383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-43a30347-2a48-4f3f-8f13-eabfe4bed468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:58.167745 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1073/2152] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:53:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:53:58.178914 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885f0c5-b89d-42ab-badb-5a68cae200e2 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:53:58.180697 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-d885f0c5-b89d-42ab-badb-5a68cae200e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:53:58.241441 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885f0c5-b89d-42ab-badb-5a68cae200e2 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:53:58.245573 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8373c844-5c43-4a92-a599-1ebaa145583e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:53:58.246194 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373c844-5c43-4a92-a599-1ebaa145583e service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:53:58.246476 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373c844-5c43-4a92-a599-1ebaa145583e service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:53:58.246751 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373c844-5c43-4a92-a599-1ebaa145583e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:53:58.255309 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8373c844-5c43-4a92-a599-1ebaa145583e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:53:58.256703 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8373c844-5c43-4a92-a599-1ebaa145583e service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:53:58.267023 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1080/2153] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:53:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:54:01.878411 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a30347-2a48-4f3f-8f13-eabfe4bed468 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:01.901039 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:01.945039 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a30347-2a48-4f3f-8f13-eabfe4bed468 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:01.950988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906ab3a-302f-4018-8ad5-8069b04c8f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:01.951640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906ab3a-302f-4018-8ad5-8069b04c8f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:01.951922 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906ab3a-302f-4018-8ad5-8069b04c8f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:01.952198 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906ab3a-302f-4018-8ad5-8069b04c8f21 admin admin] PATH_INFO: `/v3/users/84d82b8398eb4d649e76e1ee6c454e8c` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:01.953393 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906ab3a-302f-4018-8ad5-8069b04c8f21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84d82b8398eb4d649e76e1ee6c454e8c)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:01.955347 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906ab3a-302f-4018-8ad5-8069b04c8f21 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:02.005752 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-3906ab3a-302f-4018-8ad5-8069b04c8f21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84d82b8398eb4d649e76e1ee6c454e8c'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:02.013509 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-3906ab3a-302f-4018-8ad5-8069b04c8f21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84d82b8398eb4d649e76e1ee6c454e8c'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:02.014137 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-3906ab3a-302f-4018-8ad5-8069b04c8f21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84d82b8398eb4d649e76e1ee6c454e8c'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:02.014737 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-3906ab3a-302f-4018-8ad5-8069b04c8f21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84d82b8398eb4d649e76e1ee6c454e8c'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:02.028316 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-3906ab3a-302f-4018-8ad5-8069b04c8f21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84d82b8398eb4d649e76e1ee6c454e8c'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:02.041662 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1074/2154] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:54:01 2022] DELETE /identity/v3/users/84d82b8398eb4d649e76e1ee6c454e8c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:54:02.046278 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28eac37-6def-490a-be55-60859221f3a1 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:02.046740 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28eac37-6def-490a-be55-60859221f3a1 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:02.046845 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28eac37-6def-490a-be55-60859221f3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:02.066590 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-f28eac37-6def-490a-be55-60859221f3a1 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:54:02.067827 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-f28eac37-6def-490a-be55-60859221f3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:02.129686 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1081/2155] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:54:02.141063 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906ab3a-302f-4018-8ad5-8069b04c8f21 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:02.142515 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-3906ab3a-302f-4018-8ad5-8069b04c8f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:02.200574 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906ab3a-302f-4018-8ad5-8069b04c8f21 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:02.204421 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a27da-75f0-46c5-829a-b0c5a87fca3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:02.205039 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a27da-75f0-46c5-829a-b0c5a87fca3e service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:02.205322 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a27da-75f0-46c5-829a-b0c5a87fca3e service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:02.205629 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a27da-75f0-46c5-829a-b0c5a87fca3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:02.215303 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a27da-75f0-46c5-829a-b0c5a87fca3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:02.216814 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a27da-75f0-46c5-829a-b0c5a87fca3e service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:02.227777 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1075/2156] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:54:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:54:02.516080 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28eac37-6def-490a-be55-60859221f3a1 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:02.517678 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-f28eac37-6def-490a-be55-60859221f3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:02.526865 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:02.531224 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28eac37-6def-490a-be55-60859221f3a1 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:02.541136 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c63c8f-47be-4c6b-bec1-bd32b603c999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:02.541850 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c63c8f-47be-4c6b-bec1-bd32b603c999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:02.542404 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c63c8f-47be-4c6b-bec1-bd32b603c999 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:02.543987 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c63c8f-47be-4c6b-bec1-bd32b603c999 admin admin] PATH_INFO: `/v3/projects/b4ef6c78536d4a45890fb790fc90831a` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:02.545368 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c63c8f-47be-4c6b-bec1-bd32b603c999 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4ef6c78536d4a45890fb790fc90831a)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:02.547365 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c63c8f-47be-4c6b-bec1-bd32b603c999 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:02.598111 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-31c63c8f-47be-4c6b-bec1-bd32b603c999 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4ef6c78536d4a45890fb790fc90831a', 'request_id': 'req-31c63c8f-47be-4c6b-bec1-bd32b603c999'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:02.604896 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-31c63c8f-47be-4c6b-bec1-bd32b603c999 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4ef6c78536d4a45890fb790fc90831a', 'request_id': 'req-31c63c8f-47be-4c6b-bec1-bd32b603c999'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:02.612479 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-31c63c8f-47be-4c6b-bec1-bd32b603c999 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4ef6c78536d4a45890fb790fc90831a', 'request_id': 'req-31c63c8f-47be-4c6b-bec1-bd32b603c999'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:02.623344 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-31c63c8f-47be-4c6b-bec1-bd32b603c999 admin admin] The token cache is being invalidate because project b4ef6c78536d4a45890fb790fc90831a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:54:02.623631 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-31c63c8f-47be-4c6b-bec1-bd32b603c999 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:02.624265 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-31c63c8f-47be-4c6b-bec1-bd32b603c999 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:02.625812 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1082/2157] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:54:02 2022] DELETE /identity/v3/projects/b4ef6c78536d4a45890fb790fc90831a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:54:02.630858 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebf861-1509-4c50-b578-93688992fc0c None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:02.631259 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebf861-1509-4c50-b578-93688992fc0c None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:02.631634 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebf861-1509-4c50-b578-93688992fc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:02.651885 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-c8ebf861-1509-4c50-b578-93688992fc0c None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:54:02.653342 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-c8ebf861-1509-4c50-b578-93688992fc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:02.697786 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:02.721318 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1076/2158] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:54:02.729443 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfe257-d6c7-433e-b916-89e5b2649a31 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:02.729845 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfe257-d6c7-433e-b916-89e5b2649a31 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:02.730232 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfe257-d6c7-433e-b916-89e5b2649a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:02.751895 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-30cfe257-d6c7-433e-b916-89e5b2649a31 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:54:02.753312 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-30cfe257-d6c7-433e-b916-89e5b2649a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:02.761460 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1083/2159] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:54:02.765690 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ebf861-1509-4c50-b578-93688992fc0c None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:02.776263 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ebf861-1509-4c50-b578-93688992fc0c None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:02.781053 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455f79c-a521-45d1-a53f-6a37888f8878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:02.781716 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455f79c-a521-45d1-a53f-6a37888f8878 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:02.782003 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455f79c-a521-45d1-a53f-6a37888f8878 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:02.782283 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455f79c-a521-45d1-a53f-6a37888f8878 admin admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:02.782992 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455f79c-a521-45d1-a53f-6a37888f8878 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:54:02.783297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455f79c-a521-45d1-a53f-6a37888f8878 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:02.784898 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455f79c-a521-45d1-a53f-6a37888f8878 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:02.802080 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1077/2160] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:54:02.803633 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfe257-d6c7-433e-b916-89e5b2649a31 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:02.814940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfe257-d6c7-433e-b916-89e5b2649a31 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:02.821162 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16303a-40b0-4886-8e36-632ed2e048ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:02.822095 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16303a-40b0-4886-8e36-632ed2e048ec admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:02.822446 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16303a-40b0-4886-8e36-632ed2e048ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:02.822917 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16303a-40b0-4886-8e36-632ed2e048ec admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:02.823610 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16303a-40b0-4886-8e36-632ed2e048ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:02.825721 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16303a-40b0-4886-8e36-632ed2e048ec admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:02.861540 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1084/2161] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:54:02 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:54:02.863316 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455f79c-a521-45d1-a53f-6a37888f8878 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:02.876959 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455f79c-a521-45d1-a53f-6a37888f8878 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:02.938206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0cbff-873d-4873-8f9e-e926231f9db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:02.938843 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0cbff-873d-4873-8f9e-e926231f9db0 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:02.939126 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0cbff-873d-4873-8f9e-e926231f9db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:02.939402 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0cbff-873d-4873-8f9e-e926231f9db0 admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:02.940069 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0cbff-873d-4873-8f9e-e926231f9db0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:02.942036 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0cbff-873d-4873-8f9e-e926231f9db0 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:02.964774 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1078/2162] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:54:02 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:54:02.968964 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16303a-40b0-4886-8e36-632ed2e048ec admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:02.979991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16303a-40b0-4886-8e36-632ed2e048ec admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:02.988321 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf5993-35f4-43f8-aad7-97a3f92d9654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:02.989097 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf5993-35f4-43f8-aad7-97a3f92d9654 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:02.989384 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf5993-35f4-43f8-aad7-97a3f92d9654 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:02.989770 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf5993-35f4-43f8-aad7-97a3f92d9654 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:02.990562 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf5993-35f4-43f8-aad7-97a3f92d9654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:02.992353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf5993-35f4-43f8-aad7-97a3f92d9654 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:03.005530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1085/2163] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:54:03.008260 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0cbff-873d-4873-8f9e-e926231f9db0 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:03.020253 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0cbff-873d-4873-8f9e-e926231f9db0 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:03.026085 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81551a-ee51-4868-9239-f93a5791a3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:03.026852 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81551a-ee51-4868-9239-f93a5791a3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:03.027065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81551a-ee51-4868-9239-f93a5791a3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:03.027960 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81551a-ee51-4868-9239-f93a5791a3e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:03.028678 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d81551a-ee51-4868-9239-f93a5791a3e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:03.030956 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d81551a-ee51-4868-9239-f93a5791a3e6 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:03.050513 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1079/2164] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:54:03.063754 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf5993-35f4-43f8-aad7-97a3f92d9654 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:03.075183 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf5993-35f4-43f8-aad7-97a3f92d9654 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:03.080473 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d6b21-351d-4738-a44a-53cf58d8d02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:03.081139 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d6b21-351d-4738-a44a-53cf58d8d02b admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:03.081449 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d6b21-351d-4738-a44a-53cf58d8d02b admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:03.081734 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d6b21-351d-4738-a44a-53cf58d8d02b admin admin] PATH_INFO: `/v3/projects/8765fc3a01fc46378274d2c100d0365f/users/2bfff18cfe284b6c880168b5f5878085/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:03.097523 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d6b21-351d-4738-a44a-53cf58d8d02b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8765fc3a01fc46378274d2c100d0365f, user_id=2bfff18cfe284b6c880168b5f5878085, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:03.104821 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d6b21-351d-4738-a44a-53cf58d8d02b admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:03.120436 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1086/2165] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:54:03 2022] PUT /identity/v3/projects/8765fc3a01fc46378274d2c100d0365f/users/2bfff18cfe284b6c880168b5f5878085/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:54:03.132984 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c8e95-61d3-4ff3-81f0-b68be33bf3a7 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:03.133204 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c8e95-61d3-4ff3-81f0-b68be33bf3a7 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:03.134072 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c8e95-61d3-4ff3-81f0-b68be33bf3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:03.163043 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-407c8e95-61d3-4ff3-81f0-b68be33bf3a7 None None] MFA Rules not processed for user `2bfff18cfe284b6c880168b5f5878085`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:54:03.164466 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-407c8e95-61d3-4ff3-81f0-b68be33bf3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:03.235496 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1080/2166] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:54:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:54:03.246694 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d6b21-351d-4738-a44a-53cf58d8d02b admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:03.248384 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-971d6b21-351d-4738-a44a-53cf58d8d02b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:03.306933 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d6b21-351d-4738-a44a-53cf58d8d02b admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:03.310608 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a4945-8283-48f5-8349-698d76d53c88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:03.311225 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a4945-8283-48f5-8349-698d76d53c88 service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:03.311506 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a4945-8283-48f5-8349-698d76d53c88 service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:03.311783 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a4945-8283-48f5-8349-698d76d53c88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:03.320141 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a4945-8283-48f5-8349-698d76d53c88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:03.321644 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a4945-8283-48f5-8349-698d76d53c88 service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:03.330409 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1087/2167] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:54:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:54:05.752191 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c501c-5474-4397-87cb-2842b8d252cd None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:05.752789 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c501c-5474-4397-87cb-2842b8d252cd None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:05.752898 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c501c-5474-4397-87cb-2842b8d252cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:05.776558 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-2e9c501c-5474-4397-87cb-2842b8d252cd None None] MFA Rules not processed for user `2bfff18cfe284b6c880168b5f5878085`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:54:05.777904 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-2e9c501c-5474-4397-87cb-2842b8d252cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:05.785791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1081/2168] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:54:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:54:06.553890 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a4945-8283-48f5-8349-698d76d53c88 service cinder] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:06.555916 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-2c1a4945-8283-48f5-8349-698d76d53c88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:06.595175 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:06.635234 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a4945-8283-48f5-8349-698d76d53c88 service cinder] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:06.639845 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f3cc4-1b15-4e27-9b8b-b7872f5279b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:06.640511 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f3cc4-1b15-4e27-9b8b-b7872f5279b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:06.640794 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f3cc4-1b15-4e27-9b8b-b7872f5279b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:06.641070 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f3cc4-1b15-4e27-9b8b-b7872f5279b8 admin admin] PATH_INFO: `/v3/users/3aac5622022548acbf554375d3ae2cb5` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:06.642281 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f3cc4-1b15-4e27-9b8b-b7872f5279b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aac5622022548acbf554375d3ae2cb5)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:06.644235 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f3cc4-1b15-4e27-9b8b-b7872f5279b8 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:06.701937 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-024f3cc4-1b15-4e27-9b8b-b7872f5279b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aac5622022548acbf554375d3ae2cb5'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:06.702581 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-024f3cc4-1b15-4e27-9b8b-b7872f5279b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aac5622022548acbf554375d3ae2cb5'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:06.703186 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-024f3cc4-1b15-4e27-9b8b-b7872f5279b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aac5622022548acbf554375d3ae2cb5'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:06.716916 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-024f3cc4-1b15-4e27-9b8b-b7872f5279b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aac5622022548acbf554375d3ae2cb5'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:06.724085 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-024f3cc4-1b15-4e27-9b8b-b7872f5279b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aac5622022548acbf554375d3ae2cb5'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:06.738884 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1088/2169] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:54:06 2022] DELETE /identity/v3/users/3aac5622022548acbf554375d3ae2cb5 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:54:06.743445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf36458-2f6c-4e71-aaf7-3b2eb9ed0aee None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:06.743787 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf36458-2f6c-4e71-aaf7-3b2eb9ed0aee None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:06.744049 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf36458-2f6c-4e71-aaf7-3b2eb9ed0aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:06.763185 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-aaf36458-2f6c-4e71-aaf7-3b2eb9ed0aee None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:54:06.765100 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-aaf36458-2f6c-4e71-aaf7-3b2eb9ed0aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:06.794200 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:06.830541 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1082/2170] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:54:06.841230 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f3cc4-1b15-4e27-9b8b-b7872f5279b8 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:06.842685 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-024f3cc4-1b15-4e27-9b8b-b7872f5279b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:06.902990 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f3cc4-1b15-4e27-9b8b-b7872f5279b8 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:06.906732 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50823498-a374-4fda-91c9-bfcea7051fb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:06.907355 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50823498-a374-4fda-91c9-bfcea7051fb0 service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:06.907638 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50823498-a374-4fda-91c9-bfcea7051fb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:06.908046 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50823498-a374-4fda-91c9-bfcea7051fb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:06.918934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50823498-a374-4fda-91c9-bfcea7051fb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:06.920418 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50823498-a374-4fda-91c9-bfcea7051fb0 service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:06.931888 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1089/2171] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:54:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:54:07.231292 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf36458-2f6c-4e71-aaf7-3b2eb9ed0aee None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:07.232724 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-aaf36458-2f6c-4e71-aaf7-3b2eb9ed0aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:07.248330 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf36458-2f6c-4e71-aaf7-3b2eb9ed0aee None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:07.253857 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07017ce1-a8f0-415a-a95f-d921313ad457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:07.254512 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07017ce1-a8f0-415a-a95f-d921313ad457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:07.254819 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07017ce1-a8f0-415a-a95f-d921313ad457 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:07.261734 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07017ce1-a8f0-415a-a95f-d921313ad457 admin admin] PATH_INFO: `/v3/projects/2effb224a235480b954950207a483382` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:07.263149 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07017ce1-a8f0-415a-a95f-d921313ad457 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2effb224a235480b954950207a483382)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:07.269394 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07017ce1-a8f0-415a-a95f-d921313ad457 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:07.324061 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-07017ce1-a8f0-415a-a95f-d921313ad457 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2effb224a235480b954950207a483382', 'request_id': 'req-07017ce1-a8f0-415a-a95f-d921313ad457'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:07.330460 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-07017ce1-a8f0-415a-a95f-d921313ad457 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2effb224a235480b954950207a483382', 'request_id': 'req-07017ce1-a8f0-415a-a95f-d921313ad457'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:07.340781 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-07017ce1-a8f0-415a-a95f-d921313ad457 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2effb224a235480b954950207a483382', 'request_id': 'req-07017ce1-a8f0-415a-a95f-d921313ad457'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:07.357053 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-07017ce1-a8f0-415a-a95f-d921313ad457 admin admin] The token cache is being invalidate because project 2effb224a235480b954950207a483382 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:54:07.357487 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-07017ce1-a8f0-415a-a95f-d921313ad457 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:07.358252 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-07017ce1-a8f0-415a-a95f-d921313ad457 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:07.360071 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1083/2172] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:54:07 2022] DELETE /identity/v3/projects/2effb224a235480b954950207a483382 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:54:07.364991 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4fe08-8ae3-469c-b573-2359348cdbdf None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:07.365286 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4fe08-8ae3-469c-b573-2359348cdbdf None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:07.366921 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4fe08-8ae3-469c-b573-2359348cdbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:07.410521 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-d0f4fe08-8ae3-469c-b573-2359348cdbdf None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:54:07.412611 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-d0f4fe08-8ae3-469c-b573-2359348cdbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:07.522710 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:07.552778 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1090/2173] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:54:07.561795 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35faaea-a047-4337-a9e9-b992b3de503e None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:07.561795 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35faaea-a047-4337-a9e9-b992b3de503e None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:07.561795 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35faaea-a047-4337-a9e9-b992b3de503e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:07.589012 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-c35faaea-a047-4337-a9e9-b992b3de503e None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:54:07.590390 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-c35faaea-a047-4337-a9e9-b992b3de503e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:07.600164 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1084/2174] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:54:07.604923 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4fe08-8ae3-469c-b573-2359348cdbdf None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:07.628314 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4fe08-8ae3-469c-b573-2359348cdbdf None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:07.637526 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf4dc4-5a43-4907-b637-a58951d3ca85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:07.638568 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf4dc4-5a43-4907-b637-a58951d3ca85 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:07.638913 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf4dc4-5a43-4907-b637-a58951d3ca85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:07.639251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf4dc4-5a43-4907-b637-a58951d3ca85 admin admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:07.640137 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf4dc4-5a43-4907-b637-a58951d3ca85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:54:07.640513 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf4dc4-5a43-4907-b637-a58951d3ca85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:07.642286 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf4dc4-5a43-4907-b637-a58951d3ca85 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:07.658881 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1091/2175] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:54:07.660282 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35faaea-a047-4337-a9e9-b992b3de503e None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:07.671710 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35faaea-a047-4337-a9e9-b992b3de503e None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:07.676846 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac0376-d316-4b14-a1fe-951c2fd4157a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:07.677788 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac0376-d316-4b14-a1fe-951c2fd4157a admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:07.678221 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac0376-d316-4b14-a1fe-951c2fd4157a admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:07.678672 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac0376-d316-4b14-a1fe-951c2fd4157a admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:07.679534 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac0376-d316-4b14-a1fe-951c2fd4157a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:07.681959 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac0376-d316-4b14-a1fe-951c2fd4157a admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:07.715033 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1085/2176] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:54:07 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:54:07.718987 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf4dc4-5a43-4907-b637-a58951d3ca85 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:07.730112 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf4dc4-5a43-4907-b637-a58951d3ca85 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:07.800807 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e063c3b-822b-4912-aa04-2ba5cce79d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:07.801441 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e063c3b-822b-4912-aa04-2ba5cce79d99 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:07.801757 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e063c3b-822b-4912-aa04-2ba5cce79d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:07.802335 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e063c3b-822b-4912-aa04-2ba5cce79d99 admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:07.803049 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e063c3b-822b-4912-aa04-2ba5cce79d99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:07.804997 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e063c3b-822b-4912-aa04-2ba5cce79d99 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:07.833765 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1092/2177] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:54:07 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:54:07.838523 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac0376-d316-4b14-a1fe-951c2fd4157a admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:07.855171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac0376-d316-4b14-a1fe-951c2fd4157a admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:07.862670 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60dc15-939d-4e3d-8486-db7c7039d91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:07.863715 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60dc15-939d-4e3d-8486-db7c7039d91c admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:07.864065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60dc15-939d-4e3d-8486-db7c7039d91c admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:07.864557 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60dc15-939d-4e3d-8486-db7c7039d91c admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:07.865489 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c60dc15-939d-4e3d-8486-db7c7039d91c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:07.868858 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c60dc15-939d-4e3d-8486-db7c7039d91c admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:07.882801 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1086/2178] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:54:07.887971 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e063c3b-822b-4912-aa04-2ba5cce79d99 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:07.902364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e063c3b-822b-4912-aa04-2ba5cce79d99 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:07.910409 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc47ca2-46b5-4f2a-abc6-73ba984659bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:07.911046 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc47ca2-46b5-4f2a-abc6-73ba984659bb admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:07.911333 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc47ca2-46b5-4f2a-abc6-73ba984659bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:07.911663 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc47ca2-46b5-4f2a-abc6-73ba984659bb admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:07.912474 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc47ca2-46b5-4f2a-abc6-73ba984659bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:07.915029 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc47ca2-46b5-4f2a-abc6-73ba984659bb admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:07.928233 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1093/2179] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:54:07.932336 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60dc15-939d-4e3d-8486-db7c7039d91c admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:07.944108 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60dc15-939d-4e3d-8486-db7c7039d91c admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:07.953103 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89454da-8486-4a0b-b85a-bac3ca32b67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:07.954084 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89454da-8486-4a0b-b85a-bac3ca32b67d admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:07.954339 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89454da-8486-4a0b-b85a-bac3ca32b67d admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:07.954818 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89454da-8486-4a0b-b85a-bac3ca32b67d admin admin] PATH_INFO: `/v3/projects/fd9b12be01e4433ebccb8cb20bdaf9e1/users/52d96a43d1fa4493929b65914de85062/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:07.972475 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89454da-8486-4a0b-b85a-bac3ca32b67d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd9b12be01e4433ebccb8cb20bdaf9e1, user_id=52d96a43d1fa4493929b65914de85062, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:07.975271 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89454da-8486-4a0b-b85a-bac3ca32b67d admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:08.000381 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1087/2180] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:54:07 2022] PUT /identity/v3/projects/fd9b12be01e4433ebccb8cb20bdaf9e1/users/52d96a43d1fa4493929b65914de85062/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:54:08.006963 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4f08b-0829-4a70-b20e-23bd6fe9170c None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:08.007253 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4f08b-0829-4a70-b20e-23bd6fe9170c None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:08.007586 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4f08b-0829-4a70-b20e-23bd6fe9170c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:08.037817 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-c7f4f08b-0829-4a70-b20e-23bd6fe9170c None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:54:08.039188 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-c7f4f08b-0829-4a70-b20e-23bd6fe9170c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:08.111037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1094/2181] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:54:08.121482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89454da-8486-4a0b-b85a-bac3ca32b67d admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:08.124378 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-b89454da-8486-4a0b-b85a-bac3ca32b67d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:08.192248 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89454da-8486-4a0b-b85a-bac3ca32b67d admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:08.196838 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b30aa2-855e-48e0-8302-47e6d4d7895f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:08.197467 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b30aa2-855e-48e0-8302-47e6d4d7895f service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:08.197790 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b30aa2-855e-48e0-8302-47e6d4d7895f service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:08.198061 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b30aa2-855e-48e0-8302-47e6d4d7895f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:08.204512 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:08.208420 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b30aa2-855e-48e0-8302-47e6d4d7895f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:08.210151 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b30aa2-855e-48e0-8302-47e6d4d7895f service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:08.222419 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1088/2182] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:54:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:54:13.626571 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26caf353-84ff-466e-b57a-1b90ed40d8ee None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:13.627007 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26caf353-84ff-466e-b57a-1b90ed40d8ee None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:13.627161 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26caf353-84ff-466e-b57a-1b90ed40d8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:13.657027 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-26caf353-84ff-466e-b57a-1b90ed40d8ee None None] MFA Rules not processed for user `52d96a43d1fa4493929b65914de85062`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:54:13.658299 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-26caf353-84ff-466e-b57a-1b90ed40d8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:13.714837 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:13.738981 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1095/2183] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:54:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:54:13.743495 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b30aa2-855e-48e0-8302-47e6d4d7895f service neutron] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:13.753846 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b30aa2-855e-48e0-8302-47e6d4d7895f service neutron] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:13.761024 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fc534-32a1-41c3-bb9b-9b4e5f685541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:13.761671 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fc534-32a1-41c3-bb9b-9b4e5f685541 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:13.761960 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fc534-32a1-41c3-bb9b-9b4e5f685541 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:13.762237 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fc534-32a1-41c3-bb9b-9b4e5f685541 admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:13.762934 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fc534-32a1-41c3-bb9b-9b4e5f685541 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:13.764808 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fc534-32a1-41c3-bb9b-9b4e5f685541 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:13.795094 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1089/2184] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:54:13 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:54:13.798969 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26caf353-84ff-466e-b57a-1b90ed40d8ee None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:13.810199 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26caf353-84ff-466e-b57a-1b90ed40d8ee None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:13.875672 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd9aec-fa04-41de-aaf8-8dad1e1b2569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:13.876607 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd9aec-fa04-41de-aaf8-8dad1e1b2569 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:13.876888 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd9aec-fa04-41de-aaf8-8dad1e1b2569 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:13.877164 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd9aec-fa04-41de-aaf8-8dad1e1b2569 admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:13.877879 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd9aec-fa04-41de-aaf8-8dad1e1b2569 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:13.879859 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd9aec-fa04-41de-aaf8-8dad1e1b2569 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:13.910008 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1096/2185] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:54:13 2022] POST /identity/v3/users => generated 299 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:54:13.913704 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fc534-32a1-41c3-bb9b-9b4e5f685541 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:13.924677 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fc534-32a1-41c3-bb9b-9b4e5f685541 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:13.929383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b8107-8fa6-412f-9eed-af0a60b84eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:13.930078 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b8107-8fa6-412f-9eed-af0a60b84eda admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:13.930359 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b8107-8fa6-412f-9eed-af0a60b84eda admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:13.930632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b8107-8fa6-412f-9eed-af0a60b84eda admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:13.931338 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b8107-8fa6-412f-9eed-af0a60b84eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:13.932947 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b8107-8fa6-412f-9eed-af0a60b84eda admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:13.944372 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1090/2186] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:54:13.949319 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd9aec-fa04-41de-aaf8-8dad1e1b2569 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:13.960131 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd9aec-fa04-41de-aaf8-8dad1e1b2569 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:13.965580 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc4231-0454-42d9-8269-61af0ca79170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:13.966336 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc4231-0454-42d9-8269-61af0ca79170 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:13.966642 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc4231-0454-42d9-8269-61af0ca79170 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:13.966929 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc4231-0454-42d9-8269-61af0ca79170 admin admin] PATH_INFO: `/v3/projects/0623a3a7eea04f7fb8fe25ea05871bb1/users/cc9cf230645b49acabf92ae131bfe922/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:13.983289 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc4231-0454-42d9-8269-61af0ca79170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0623a3a7eea04f7fb8fe25ea05871bb1, user_id=cc9cf230645b49acabf92ae131bfe922, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:13.986031 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc4231-0454-42d9-8269-61af0ca79170 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:14.001613 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1097/2187] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:54:13 2022] PUT /identity/v3/projects/0623a3a7eea04f7fb8fe25ea05871bb1/users/cc9cf230645b49acabf92ae131bfe922/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:54:14.006137 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b8107-8fa6-412f-9eed-af0a60b84eda admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:14.018000 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b8107-8fa6-412f-9eed-af0a60b84eda admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:14.077374 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77142cb1-4a3c-4d73-b045-48fe208746fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:14.078071 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77142cb1-4a3c-4d73-b045-48fe208746fc admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:14.078355 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77142cb1-4a3c-4d73-b045-48fe208746fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:14.078633 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77142cb1-4a3c-4d73-b045-48fe208746fc admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:14.079340 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77142cb1-4a3c-4d73-b045-48fe208746fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:14.080998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77142cb1-4a3c-4d73-b045-48fe208746fc admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:14.091986 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1091/2188] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:54:14.096147 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc4231-0454-42d9-8269-61af0ca79170 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:14.107011 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc4231-0454-42d9-8269-61af0ca79170 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:14.111814 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d8611-0a65-4358-bf4a-85290e5db187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:14.112482 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d8611-0a65-4358-bf4a-85290e5db187 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:14.112760 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d8611-0a65-4358-bf4a-85290e5db187 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:14.113031 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d8611-0a65-4358-bf4a-85290e5db187 admin admin] PATH_INFO: `/v3/projects/0623a3a7eea04f7fb8fe25ea05871bb1/users/cc9cf230645b49acabf92ae131bfe922/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:14.115006 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d8611-0a65-4358-bf4a-85290e5db187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0623a3a7eea04f7fb8fe25ea05871bb1, user_id=cc9cf230645b49acabf92ae131bfe922, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:14.118357 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d8611-0a65-4358-bf4a-85290e5db187 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:14.128914 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1098/2189] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:54:14 2022] PUT /identity/v3/projects/0623a3a7eea04f7fb8fe25ea05871bb1/users/cc9cf230645b49acabf92ae131bfe922/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:54:18.827360 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62aa00-1bb6-4749-b77b-b662ca3e3b04 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:18.828274 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62aa00-1bb6-4749-b77b-b662ca3e3b04 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:18.828632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62aa00-1bb6-4749-b77b-b662ca3e3b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:18.880910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-bc62aa00-1bb6-4749-b77b-b662ca3e3b04 None None] MFA Rules not processed for user `cc9cf230645b49acabf92ae131bfe922`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:54:18.882506 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-bc62aa00-1bb6-4749-b77b-b662ca3e3b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:19.035281 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1092/2190] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:54:18 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:54:19.044784 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d8611-0a65-4358-bf4a-85290e5db187 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:19.047407 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-498d8611-0a65-4358-bf4a-85290e5db187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:19.121723 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d8611-0a65-4358-bf4a-85290e5db187 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:19.125622 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d33f8cf-52d0-408e-9145-c40073786433 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2f23f4936684b63afc095986e43ec37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:19.126665 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33f8cf-52d0-408e-9145-c40073786433 service glance] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:19.127091 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33f8cf-52d0-408e-9145-c40073786433 service glance] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:19.127525 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33f8cf-52d0-408e-9145-c40073786433 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:19.177935 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:19.189404 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d33f8cf-52d0-408e-9145-c40073786433 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:19.191223 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d33f8cf-52d0-408e-9145-c40073786433 service glance] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:19.201611 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1099/2191] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:54:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:54:19.350642 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f0a44-f843-420f-ae9a-9994ac534f9e None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:19.350935 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f0a44-f843-420f-ae9a-9994ac534f9e None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:19.351212 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f0a44-f843-420f-ae9a-9994ac534f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:19.372928 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-7a2f0a44-f843-420f-ae9a-9994ac534f9e None None] MFA Rules not processed for user `a994c976b95744ed9723bf9c4386bde1`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:54:19.374415 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-7a2f0a44-f843-420f-ae9a-9994ac534f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:19.418371 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:19.437243 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1093/2192] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Aug 3 12:54:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:54:19.449641 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d33f8cf-52d0-408e-9145-c40073786433 service glance] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:19.451052 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-7d33f8cf-52d0-408e-9145-c40073786433 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:19.526175 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d33f8cf-52d0-408e-9145-c40073786433 service glance] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:19.531267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450a1b9-7f1f-49f5-adf8-46dccf6c8daa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67df369737ea4c83bae134f4bf2de20d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:19.531891 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450a1b9-7f1f-49f5-adf8-46dccf6c8daa service swift] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:19.532170 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450a1b9-7f1f-49f5-adf8-46dccf6c8daa service swift] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:19.532444 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450a1b9-7f1f-49f5-adf8-46dccf6c8daa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:19.541636 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450a1b9-7f1f-49f5-adf8-46dccf6c8daa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:19.543231 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450a1b9-7f1f-49f5-adf8-46dccf6c8daa service swift] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:19.551923 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1100/2193] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Aug 3 12:54:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 12:54:23.839942 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f0a44-f843-420f-ae9a-9994ac534f9e None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:23.841632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-7a2f0a44-f843-420f-ae9a-9994ac534f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:23.947992 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f0a44-f843-420f-ae9a-9994ac534f9e None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:23.956212 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bc068-f5cc-43dc-bec6-7a35d5b0db44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:23.957267 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bc068-f5cc-43dc-bec6-7a35d5b0db44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:23.957819 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bc068-f5cc-43dc-bec6-7a35d5b0db44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:23.958341 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bc068-f5cc-43dc-bec6-7a35d5b0db44 admin admin] PATH_INFO: `/v3/users/a032c1df21b44cb2b7d4b47870f032b8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:23.960323 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bc068-f5cc-43dc-bec6-7a35d5b0db44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a032c1df21b44cb2b7d4b47870f032b8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:23.963454 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bc068-f5cc-43dc-bec6-7a35d5b0db44 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:24.074221 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-b49bc068-f5cc-43dc-bec6-7a35d5b0db44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a032c1df21b44cb2b7d4b47870f032b8'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:24.096698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-b49bc068-f5cc-43dc-bec6-7a35d5b0db44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a032c1df21b44cb2b7d4b47870f032b8'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:24.097767 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-b49bc068-f5cc-43dc-bec6-7a35d5b0db44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a032c1df21b44cb2b7d4b47870f032b8'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:24.101039 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-b49bc068-f5cc-43dc-bec6-7a35d5b0db44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a032c1df21b44cb2b7d4b47870f032b8'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:24.151673 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-b49bc068-f5cc-43dc-bec6-7a35d5b0db44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a032c1df21b44cb2b7d4b47870f032b8'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:24.169908 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1094/2194] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:54:23 2022] DELETE /identity/v3/users/a032c1df21b44cb2b7d4b47870f032b8 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:54:24.175573 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c18e0-7254-4045-b538-fabdb27a1569 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:24.176119 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c18e0-7254-4045-b538-fabdb27a1569 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:24.176119 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c18e0-7254-4045-b538-fabdb27a1569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:24.211609 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-d49c18e0-7254-4045-b538-fabdb27a1569 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:54:24.213113 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-d49c18e0-7254-4045-b538-fabdb27a1569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:24.357688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1101/2195] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:54:24.378893 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bc068-f5cc-43dc-bec6-7a35d5b0db44 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:24.380796 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-b49bc068-f5cc-43dc-bec6-7a35d5b0db44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:24.522309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bc068-f5cc-43dc-bec6-7a35d5b0db44 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:24.551732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60981d-041c-47c4-9d3a-7104b51fd728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:24.552391 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60981d-041c-47c4-9d3a-7104b51fd728 service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:24.552712 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60981d-041c-47c4-9d3a-7104b51fd728 service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:24.553002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60981d-041c-47c4-9d3a-7104b51fd728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:24.565087 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb60981d-041c-47c4-9d3a-7104b51fd728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:24.567924 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb60981d-041c-47c4-9d3a-7104b51fd728 service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:24.584415 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1095/2196] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:54:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:54:25.025379 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c18e0-7254-4045-b538-fabdb27a1569 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:25.028789 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-d49c18e0-7254-4045-b538-fabdb27a1569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:25.083197 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c18e0-7254-4045-b538-fabdb27a1569 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:25.094464 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79499d74-fda0-4b95-9f8b-532c57bf230d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:25.096215 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79499d74-fda0-4b95-9f8b-532c57bf230d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:25.096651 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79499d74-fda0-4b95-9f8b-532c57bf230d admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:25.097458 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79499d74-fda0-4b95-9f8b-532c57bf230d admin admin] PATH_INFO: `/v3/projects/8ab28fca596e43a3a4522a4fa0a939f0` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:25.102080 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79499d74-fda0-4b95-9f8b-532c57bf230d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ab28fca596e43a3a4522a4fa0a939f0)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:25.104202 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79499d74-fda0-4b95-9f8b-532c57bf230d admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:25.215434 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-79499d74-fda0-4b95-9f8b-532c57bf230d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ab28fca596e43a3a4522a4fa0a939f0', 'request_id': 'req-79499d74-fda0-4b95-9f8b-532c57bf230d'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:25.239384 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-79499d74-fda0-4b95-9f8b-532c57bf230d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ab28fca596e43a3a4522a4fa0a939f0', 'request_id': 'req-79499d74-fda0-4b95-9f8b-532c57bf230d'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:25.256446 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-79499d74-fda0-4b95-9f8b-532c57bf230d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ab28fca596e43a3a4522a4fa0a939f0', 'request_id': 'req-79499d74-fda0-4b95-9f8b-532c57bf230d'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:25.279283 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-79499d74-fda0-4b95-9f8b-532c57bf230d admin admin] The token cache is being invalidate because project 8ab28fca596e43a3a4522a4fa0a939f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:54:25.279577 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-79499d74-fda0-4b95-9f8b-532c57bf230d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:25.280592 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-79499d74-fda0-4b95-9f8b-532c57bf230d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:25.283343 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1102/2197] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:54:25 2022] DELETE /identity/v3/projects/8ab28fca596e43a3a4522a4fa0a939f0 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:54:26.938612 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9371d-d4f1-42c9-b62f-255efddfe0eb None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:26.946264 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9371d-d4f1-42c9-b62f-255efddfe0eb None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:26.946555 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9371d-d4f1-42c9-b62f-255efddfe0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:26.976142 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-7aa9371d-d4f1-42c9-b62f-255efddfe0eb None None] MFA Rules not processed for user `a994c976b95744ed9723bf9c4386bde1`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:54:26.979814 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-7aa9371d-d4f1-42c9-b62f-255efddfe0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:26.987724 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:27.082130 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1096/2198] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Aug 3 12:54:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:54:27.099116 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79499d74-fda0-4b95-9f8b-532c57bf230d admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:27.101856 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-79499d74-fda0-4b95-9f8b-532c57bf230d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:27.115033 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:27.245417 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79499d74-fda0-4b95-9f8b-532c57bf230d admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:27.259973 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9285f0-82ca-47f9-aa03-4ebbafdc3a05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67df369737ea4c83bae134f4bf2de20d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:27.261232 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9285f0-82ca-47f9-aa03-4ebbafdc3a05 service swift] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:27.262095 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9285f0-82ca-47f9-aa03-4ebbafdc3a05 service swift] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:27.262817 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9285f0-82ca-47f9-aa03-4ebbafdc3a05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:27.277396 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9285f0-82ca-47f9-aa03-4ebbafdc3a05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:27.280042 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9285f0-82ca-47f9-aa03-4ebbafdc3a05 service swift] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:27.294673 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1103/2199] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Aug 3 12:54:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 12:54:28.321239 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74d572-5bd7-4e2b-855c-89d4c7a2ff97 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:28.321739 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74d572-5bd7-4e2b-855c-89d4c7a2ff97 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:28.321832 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74d572-5bd7-4e2b-855c-89d4c7a2ff97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:28.347540 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-1c74d572-5bd7-4e2b-855c-89d4c7a2ff97 None None] MFA Rules not processed for user `a994c976b95744ed9723bf9c4386bde1`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:54:28.348886 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-1c74d572-5bd7-4e2b-855c-89d4c7a2ff97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:28.360863 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1097/2200] 10.222.0.46 () {58 vars in 967 bytes} [Wed Aug 3 12:54:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:54:28.381653 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9285f0-82ca-47f9-aa03-4ebbafdc3a05 service swift] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:28.394650 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9285f0-82ca-47f9-aa03-4ebbafdc3a05 service swift] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:28.402705 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da041e-66c0-4e56-951e-584e31f63fb8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67df369737ea4c83bae134f4bf2de20d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:28.403320 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da041e-66c0-4e56-951e-584e31f63fb8 service swift] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:28.403600 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da041e-66c0-4e56-951e-584e31f63fb8 service swift] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:28.403878 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da041e-66c0-4e56-951e-584e31f63fb8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:28.433705 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da041e-66c0-4e56-951e-584e31f63fb8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:28.435466 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da041e-66c0-4e56-951e-584e31f63fb8 service swift] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:28.444444 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1104/2201] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Aug 3 12:54:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 12:54:28.757228 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d72051-b44e-49c3-a5e7-fa4c8e643773 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:28.757537 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d72051-b44e-49c3-a5e7-fa4c8e643773 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:28.757899 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d72051-b44e-49c3-a5e7-fa4c8e643773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:28.781434 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-13d72051-b44e-49c3-a5e7-fa4c8e643773 None None] MFA Rules not processed for user `a994c976b95744ed9723bf9c4386bde1`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:54:28.783654 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-13d72051-b44e-49c3-a5e7-fa4c8e643773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:28.793580 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1098/2202] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Aug 3 12:54:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:54:28.807663 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da041e-66c0-4e56-951e-584e31f63fb8 service swift] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:28.827048 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da041e-66c0-4e56-951e-584e31f63fb8 service swift] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:28.838724 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd8359-9a24-4591-843e-75162a83139d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67df369737ea4c83bae134f4bf2de20d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:28.838840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd8359-9a24-4591-843e-75162a83139d service swift] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:28.839120 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd8359-9a24-4591-843e-75162a83139d service swift] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:28.839603 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd8359-9a24-4591-843e-75162a83139d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:28.851294 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd8359-9a24-4591-843e-75162a83139d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:28.853731 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd8359-9a24-4591-843e-75162a83139d service swift] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:28.869654 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1105/2203] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Aug 3 12:54:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 12:54:29.291244 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b2a1c-96b4-4c7c-9625-b10274e63cea None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:29.291801 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b2a1c-96b4-4c7c-9625-b10274e63cea None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:29.292279 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b2a1c-96b4-4c7c-9625-b10274e63cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:29.317327 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-615b2a1c-96b4-4c7c-9625-b10274e63cea None None] MFA Rules not processed for user `a994c976b95744ed9723bf9c4386bde1`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:54:29.319520 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-615b2a1c-96b4-4c7c-9625-b10274e63cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:29.335165 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1099/2204] 10.222.0.46 () {58 vars in 967 bytes} [Wed Aug 3 12:54:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:54:29.344285 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd8359-9a24-4591-843e-75162a83139d service swift] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:29.358825 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd8359-9a24-4591-843e-75162a83139d service swift] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:29.368455 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eaeada-1a5e-4617-9da4-31e28203953e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67df369737ea4c83bae134f4bf2de20d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:29.369363 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eaeada-1a5e-4617-9da4-31e28203953e service swift] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:29.369893 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eaeada-1a5e-4617-9da4-31e28203953e service swift] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:29.370378 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eaeada-1a5e-4617-9da4-31e28203953e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:29.381103 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eaeada-1a5e-4617-9da4-31e28203953e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:29.382981 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eaeada-1a5e-4617-9da4-31e28203953e service swift] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:29.394709 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1106/2205] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Aug 3 12:54:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 12:54:30.913285 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b1b4c-9f3b-49c0-a67e-d27684d405ad None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:30.913864 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b1b4c-9f3b-49c0-a67e-d27684d405ad None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:30.914920 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b1b4c-9f3b-49c0-a67e-d27684d405ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:30.934825 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-b37b1b4c-9f3b-49c0-a67e-d27684d405ad None None] MFA Rules not processed for user `52d96a43d1fa4493929b65914de85062`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:54:30.936048 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-b37b1b4c-9f3b-49c0-a67e-d27684d405ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:30.991134 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1100/2206] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:54:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:54:31.845791 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eaeada-1a5e-4617-9da4-31e28203953e service swift] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:31.847870 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-66eaeada-1a5e-4617-9da4-31e28203953e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:31.934752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eaeada-1a5e-4617-9da4-31e28203953e service swift] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:31.940995 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7fede2-e117-42d7-8926-3a480a0f4491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:31.942110 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fede2-e117-42d7-8926-3a480a0f4491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:31.942479 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fede2-e117-42d7-8926-3a480a0f4491 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:31.942940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fede2-e117-42d7-8926-3a480a0f4491 admin admin] PATH_INFO: `/v3/users/2bfff18cfe284b6c880168b5f5878085` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:31.944292 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7fede2-e117-42d7-8926-3a480a0f4491 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bfff18cfe284b6c880168b5f5878085)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:31.946721 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7fede2-e117-42d7-8926-3a480a0f4491 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:32.014885 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-fd7fede2-e117-42d7-8926-3a480a0f4491 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bfff18cfe284b6c880168b5f5878085'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:32.016103 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-fd7fede2-e117-42d7-8926-3a480a0f4491 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bfff18cfe284b6c880168b5f5878085'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:32.017384 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-fd7fede2-e117-42d7-8926-3a480a0f4491 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bfff18cfe284b6c880168b5f5878085'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:32.027023 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:32.035017 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-fd7fede2-e117-42d7-8926-3a480a0f4491 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bfff18cfe284b6c880168b5f5878085'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:32.055356 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-fd7fede2-e117-42d7-8926-3a480a0f4491 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bfff18cfe284b6c880168b5f5878085'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:32.089521 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1107/2207] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:54:31 2022] DELETE /identity/v3/users/2bfff18cfe284b6c880168b5f5878085 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:54:32.094433 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f77130-4ff8-4e33-bcb1-c746cc4db22f None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:32.094887 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f77130-4ff8-4e33-bcb1-c746cc4db22f None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:32.095011 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f77130-4ff8-4e33-bcb1-c746cc4db22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:32.121955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-16f77130-4ff8-4e33-bcb1-c746cc4db22f None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:54:32.123588 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-16f77130-4ff8-4e33-bcb1-c746cc4db22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:32.198077 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1101/2208] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:54:32.211684 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7fede2-e117-42d7-8926-3a480a0f4491 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:32.213209 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-fd7fede2-e117-42d7-8926-3a480a0f4491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:32.287130 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7fede2-e117-42d7-8926-3a480a0f4491 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:32.291861 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb073f-eebe-4e8c-a0a7-d12d03385076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:32.292651 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb073f-eebe-4e8c-a0a7-d12d03385076 service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:32.293100 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb073f-eebe-4e8c-a0a7-d12d03385076 service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:32.293489 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb073f-eebe-4e8c-a0a7-d12d03385076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:32.304091 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb073f-eebe-4e8c-a0a7-d12d03385076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:32.308238 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb073f-eebe-4e8c-a0a7-d12d03385076 service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:32.319397 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1108/2209] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:54:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:54:32.471583 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f77130-4ff8-4e33-bcb1-c746cc4db22f None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:32.473104 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-16f77130-4ff8-4e33-bcb1-c746cc4db22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:32.518850 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:32.546453 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f77130-4ff8-4e33-bcb1-c746cc4db22f None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:32.551467 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849bc7a2-7428-4b09-a900-bbf07537c594 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56847173abb48d39c0ee6fb9cdbbbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:32.552092 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849bc7a2-7428-4b09-a900-bbf07537c594 service placement] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:32.552998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849bc7a2-7428-4b09-a900-bbf07537c594 service placement] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:32.553286 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849bc7a2-7428-4b09-a900-bbf07537c594 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:32.555759 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-849bc7a2-7428-4b09-a900-bbf07537c594 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:32.570574 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849bc7a2-7428-4b09-a900-bbf07537c594 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:32.572137 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849bc7a2-7428-4b09-a900-bbf07537c594 service placement] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:32.583217 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1102/2210] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:54:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:54:32.628541 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb073f-eebe-4e8c-a0a7-d12d03385076 service neutron] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:32.630061 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-6feb073f-eebe-4e8c-a0a7-d12d03385076 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:32.643917 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb073f-eebe-4e8c-a0a7-d12d03385076 service neutron] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:32.649153 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fdddd9-e347-4bf1-aeb4-a2e3bd3352a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:32.650038 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdddd9-e347-4bf1-aeb4-a2e3bd3352a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:32.650169 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdddd9-e347-4bf1-aeb4-a2e3bd3352a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:32.650366 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdddd9-e347-4bf1-aeb4-a2e3bd3352a9 admin admin] PATH_INFO: `/v3/projects/8765fc3a01fc46378274d2c100d0365f` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:32.651553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fdddd9-e347-4bf1-aeb4-a2e3bd3352a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8765fc3a01fc46378274d2c100d0365f)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:32.653541 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fdddd9-e347-4bf1-aeb4-a2e3bd3352a9 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:32.723783 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-d9fdddd9-e347-4bf1-aeb4-a2e3bd3352a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8765fc3a01fc46378274d2c100d0365f', 'request_id': 'req-d9fdddd9-e347-4bf1-aeb4-a2e3bd3352a9'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:32.732845 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-d9fdddd9-e347-4bf1-aeb4-a2e3bd3352a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8765fc3a01fc46378274d2c100d0365f', 'request_id': 'req-d9fdddd9-e347-4bf1-aeb4-a2e3bd3352a9'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:32.741772 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-d9fdddd9-e347-4bf1-aeb4-a2e3bd3352a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8765fc3a01fc46378274d2c100d0365f', 'request_id': 'req-d9fdddd9-e347-4bf1-aeb4-a2e3bd3352a9'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:32.754044 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-d9fdddd9-e347-4bf1-aeb4-a2e3bd3352a9 admin admin] The token cache is being invalidate because project 8765fc3a01fc46378274d2c100d0365f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:54:32.754337 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-d9fdddd9-e347-4bf1-aeb4-a2e3bd3352a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:32.755157 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-d9fdddd9-e347-4bf1-aeb4-a2e3bd3352a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:54:32.758737 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1109/2211] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:54:32 2022] DELETE /identity/v3/projects/8765fc3a01fc46378274d2c100d0365f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:54:33.106407 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92f937-431b-40e7-8009-93ea00464166 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:33.106868 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92f937-431b-40e7-8009-93ea00464166 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:33.106976 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92f937-431b-40e7-8009-93ea00464166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:33.127840 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-1e92f937-431b-40e7-8009-93ea00464166 None None] MFA Rules not processed for user `831d8776102847efbdae901f2b863226`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:54:33.129061 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-1e92f937-431b-40e7-8009-93ea00464166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:33.195349 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1103/2212] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:54:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:54:33.631891 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86091f74-f6d8-4fe3-90a3-4e5cf687a571 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:33.632402 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86091f74-f6d8-4fe3-90a3-4e5cf687a571 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:33.632819 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86091f74-f6d8-4fe3-90a3-4e5cf687a571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:33.655115 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-86091f74-f6d8-4fe3-90a3-4e5cf687a571 None None] MFA Rules not processed for user `a994c976b95744ed9723bf9c4386bde1`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:54:33.656484 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-86091f74-f6d8-4fe3-90a3-4e5cf687a571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:33.724126 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1110/2213] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Aug 3 12:54:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:54:33.739890 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92f937-431b-40e7-8009-93ea00464166 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:54:33.741399 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-1e92f937-431b-40e7-8009-93ea00464166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:54:33.850792 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92f937-431b-40e7-8009-93ea00464166 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:54:33.856558 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578cf33a-84a2-4cc5-965b-e392153f8149 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67df369737ea4c83bae134f4bf2de20d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:54:33.857297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578cf33a-84a2-4cc5-965b-e392153f8149 service swift] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:54:33.857638 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578cf33a-84a2-4cc5-965b-e392153f8149 service swift] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:54:33.857917 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578cf33a-84a2-4cc5-965b-e392153f8149 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:54:33.868293 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578cf33a-84a2-4cc5-965b-e392153f8149 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:54:33.869928 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578cf33a-84a2-4cc5-965b-e392153f8149 service swift] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:54:33.878995 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1104/2214] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Aug 3 12:54:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 12:54:43.715304 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=2 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:54:43.875744 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=71 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:05.678390 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86091f74-f6d8-4fe3-90a3-4e5cf687a571 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:05.679810 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-86091f74-f6d8-4fe3-90a3-4e5cf687a571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:55:05.735242 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86091f74-f6d8-4fe3-90a3-4e5cf687a571 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:05.738869 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7f312-0e3c-4d90-97ba-7b478f50d324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:05.739480 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7f312-0e3c-4d90-97ba-7b478f50d324 service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:05.739763 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7f312-0e3c-4d90-97ba-7b478f50d324 service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:05.740039 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7f312-0e3c-4d90-97ba-7b478f50d324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:05.741843 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-8db7f312-0e3c-4d90-97ba-7b478f50d324 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:55:05.805889 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db7f312-0e3c-4d90-97ba-7b478f50d324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:05.807316 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db7f312-0e3c-4d90-97ba-7b478f50d324 service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:05.816663 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1111/2215] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:55:05 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:55:10.137786 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a6b5f-e949-4665-8d04-ea496b1034a6 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:10.138315 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a6b5f-e949-4665-8d04-ea496b1034a6 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:10.138504 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a6b5f-e949-4665-8d04-ea496b1034a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:10.158936 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-d47a6b5f-e949-4665-8d04-ea496b1034a6 None None] MFA Rules not processed for user `a994c976b95744ed9723bf9c4386bde1`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:55:10.160157 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-d47a6b5f-e949-4665-8d04-ea496b1034a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:55:10.168111 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1105/2216] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Aug 3 12:55:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:55:10.180684 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7f312-0e3c-4d90-97ba-7b478f50d324 service neutron] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:10.192012 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7f312-0e3c-4d90-97ba-7b478f50d324 service neutron] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:10.198609 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467bc72-916a-46fd-9ca5-eb86743c1127 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67df369737ea4c83bae134f4bf2de20d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:10.199230 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467bc72-916a-46fd-9ca5-eb86743c1127 service swift] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:10.199511 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467bc72-916a-46fd-9ca5-eb86743c1127 service swift] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:10.199787 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467bc72-916a-46fd-9ca5-eb86743c1127 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:10.208541 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467bc72-916a-46fd-9ca5-eb86743c1127 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:10.210187 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467bc72-916a-46fd-9ca5-eb86743c1127 service swift] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:10.219745 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1112/2217] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Aug 3 12:55:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 12:55:20.154055 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:20.216493 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=56 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:25.215862 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f337b9-b751-4f11-b6d5-99fc7ad0305c None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:25.216456 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f337b9-b751-4f11-b6d5-99fc7ad0305c None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:25.216456 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f337b9-b751-4f11-b6d5-99fc7ad0305c None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:25.218036 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1106/2218] 10.222.0.46 () {54 vars in 921 bytes} [Wed Aug 3 12:55:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:55:25.226364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c686dd-e3ef-4252-bd53-6c138debf42f None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:25.226837 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c686dd-e3ef-4252-bd53-6c138debf42f None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:25.226940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c686dd-e3ef-4252-bd53-6c138debf42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:25.248182 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-b2c686dd-e3ef-4252-bd53-6c138debf42f None None] MFA Rules not processed for user `dcf670ff4f62486dbf70cf6ea0f08bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:55:25.249409 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-b2c686dd-e3ef-4252-bd53-6c138debf42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:55:25.320491 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1113/2219] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Aug 3 12:55:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:55:25.332339 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f337b9-b751-4f11-b6d5-99fc7ad0305c None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:25.334062 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-98f337b9-b751-4f11-b6d5-99fc7ad0305c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:55:25.392417 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f337b9-b751-4f11-b6d5-99fc7ad0305c None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:25.395994 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fcf7b1-8d82-4df2-a1a3-90e24a997c8e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2f23f4936684b63afc095986e43ec37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:25.396601 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcf7b1-8d82-4df2-a1a3-90e24a997c8e service glance] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:25.396877 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcf7b1-8d82-4df2-a1a3-90e24a997c8e service glance] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:25.397144 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcf7b1-8d82-4df2-a1a3-90e24a997c8e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:25.407561 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fcf7b1-8d82-4df2-a1a3-90e24a997c8e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:25.408978 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fcf7b1-8d82-4df2-a1a3-90e24a997c8e service glance] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:25.420229 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1107/2220] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:55:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:55:25.488970 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c9d63-de4e-4b33-89a3-7a3e0644e9b7 None None] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:25.489288 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c9d63-de4e-4b33-89a3-7a3e0644e9b7 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:25.489597 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c9d63-de4e-4b33-89a3-7a3e0644e9b7 None None] PATH_INFO: `/` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:25.490981 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1114/2221] 10.222.0.46 () {54 vars in 921 bytes} [Wed Aug 3 12:55:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:55:25.496013 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0df3b-e5a8-4847-b304-3a3c6719f45f None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:25.496347 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0df3b-e5a8-4847-b304-3a3c6719f45f None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:25.496651 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0df3b-e5a8-4847-b304-3a3c6719f45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:25.516340 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-15c0df3b-e5a8-4847-b304-3a3c6719f45f None None] MFA Rules not processed for user `e0cd747cb5f64ff7b5f8d67d3d640fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:55:25.517565 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-15c0df3b-e5a8-4847-b304-3a3c6719f45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:55:25.524431 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1108/2222] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Aug 3 12:55:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:55:25.536028 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c9d63-de4e-4b33-89a3-7a3e0644e9b7 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:25.537751 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-f73c9d63-de4e-4b33-89a3-7a3e0644e9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:55:25.551268 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c9d63-de4e-4b33-89a3-7a3e0644e9b7 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:25.554810 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563a3bd-36ca-4e6c-be2f-4314f4f5813c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:25.555607 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563a3bd-36ca-4e6c-be2f-4314f4f5813c service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:25.555971 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563a3bd-36ca-4e6c-be2f-4314f4f5813c service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:25.556251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563a3bd-36ca-4e6c-be2f-4314f4f5813c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:25.563287 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563a3bd-36ca-4e6c-be2f-4314f4f5813c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:25.564709 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563a3bd-36ca-4e6c-be2f-4314f4f5813c service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:25.572580 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1115/2223] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:55:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:55:25.655900 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9099404-55bd-4701-95e8-f33e35fcb952 None None] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:25.656182 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9099404-55bd-4701-95e8-f33e35fcb952 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:25.656479 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9099404-55bd-4701-95e8-f33e35fcb952 None None] PATH_INFO: `/` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:25.657877 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1109/2224] 10.222.0.46 () {54 vars in 921 bytes} [Wed Aug 3 12:55:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 03 12:55:25.662587 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a7604-1f95-4630-8ea4-62300e95906d None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:25.662878 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a7604-1f95-4630-8ea4-62300e95906d None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:25.663155 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a7604-1f95-4630-8ea4-62300e95906d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:25.682818 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-360a7604-1f95-4630-8ea4-62300e95906d None None] MFA Rules not processed for user `dcf670ff4f62486dbf70cf6ea0f08bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:55:25.684026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-360a7604-1f95-4630-8ea4-62300e95906d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:55:25.693332 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1116/2225] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Aug 3 12:55:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:55:25.704373 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9099404-55bd-4701-95e8-f33e35fcb952 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:25.715842 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9099404-55bd-4701-95e8-f33e35fcb952 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:25.719735 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25296b-6014-4ebd-9759-398664cbf2ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:25.720336 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25296b-6014-4ebd-9759-398664cbf2ec service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:25.720618 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25296b-6014-4ebd-9759-398664cbf2ec service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:25.720898 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25296b-6014-4ebd-9759-398664cbf2ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:25.731275 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a25296b-6014-4ebd-9759-398664cbf2ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:25.732744 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a25296b-6014-4ebd-9759-398664cbf2ec service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:25.743567 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1110/2226] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:55:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:55:28.188734 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a4f0c-1c86-43bc-bf2e-cd800400b9d7 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:28.189237 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a4f0c-1c86-43bc-bf2e-cd800400b9d7 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:28.189353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a4f0c-1c86-43bc-bf2e-cd800400b9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:28.208803 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-483a4f0c-1c86-43bc-bf2e-cd800400b9d7 None None] MFA Rules not processed for user `a994c976b95744ed9723bf9c4386bde1`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:55:28.210084 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-483a4f0c-1c86-43bc-bf2e-cd800400b9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:55:28.217261 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1117/2227] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Aug 3 12:55:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:55:28.238719 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25296b-6014-4ebd-9759-398664cbf2ec service neutron] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:28.250741 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25296b-6014-4ebd-9759-398664cbf2ec service neutron] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:28.256045 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24299e8-1770-4c14-8fd7-66a359151d85 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67df369737ea4c83bae134f4bf2de20d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:28.256649 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24299e8-1770-4c14-8fd7-66a359151d85 service swift] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:28.256931 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24299e8-1770-4c14-8fd7-66a359151d85 service swift] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:28.257207 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24299e8-1770-4c14-8fd7-66a359151d85 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:28.265442 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24299e8-1770-4c14-8fd7-66a359151d85 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:28.267057 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24299e8-1770-4c14-8fd7-66a359151d85 service swift] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:28.276082 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1111/2228] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Aug 3 12:55:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 12:55:38.203774 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=43 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:38.272020 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=41 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:55:53.622466 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d678c-3466-48eb-9c0a-246684d4e293 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:53.623026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d678c-3466-48eb-9c0a-246684d4e293 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:53.623026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d678c-3466-48eb-9c0a-246684d4e293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:53.646902 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-621d678c-3466-48eb-9c0a-246684d4e293 None None] MFA Rules not processed for user `a994c976b95744ed9723bf9c4386bde1`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:55:53.648141 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-621d678c-3466-48eb-9c0a-246684d4e293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:55:53.656435 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1118/2229] 10.222.0.46 () {58 vars in 967 bytes} [Wed Aug 3 12:55:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:55:53.669841 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24299e8-1770-4c14-8fd7-66a359151d85 service swift] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:55:53.681426 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24299e8-1770-4c14-8fd7-66a359151d85 service swift] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:55:53.687447 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99266a0a-525e-431e-8dbe-d13d3df763d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67df369737ea4c83bae134f4bf2de20d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:55:53.688072 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99266a0a-525e-431e-8dbe-d13d3df763d3 service swift] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:55:53.688355 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99266a0a-525e-431e-8dbe-d13d3df763d3 service swift] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:55:53.688640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99266a0a-525e-431e-8dbe-d13d3df763d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:55:53.698439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99266a0a-525e-431e-8dbe-d13d3df763d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:55:53.700123 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99266a0a-525e-431e-8dbe-d13d3df763d3 service swift] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:55:53.709981 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1112/2230] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Aug 3 12:55:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 12:56:03.637593 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=3 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:56:03.705870 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=6 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:56:11.380962 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee6bee-46ba-4b9b-bc14-0cb612eb98b1 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:56:11.381450 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee6bee-46ba-4b9b-bc14-0cb612eb98b1 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:56:11.381450 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee6bee-46ba-4b9b-bc14-0cb612eb98b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:56:11.402078 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-4cee6bee-46ba-4b9b-bc14-0cb612eb98b1 None None] MFA Rules not processed for user `539502db204e415c85520d9b7fe77d99`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:56:11.403325 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-4cee6bee-46ba-4b9b-bc14-0cb612eb98b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:56:11.457554 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1119/2231] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:56:11 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:56:21.450445 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=25 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:56:34.187228 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99266a0a-525e-431e-8dbe-d13d3df763d3 service swift] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:56:34.196318 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99266a0a-525e-431e-8dbe-d13d3df763d3 service swift] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:56:34.200357 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fb85e-11b3-473c-b209-c3e78e195f88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:56:34.200948 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fb85e-11b3-473c-b209-c3e78e195f88 service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:56:34.201222 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fb85e-11b3-473c-b209-c3e78e195f88 service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:56:34.201510 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fb85e-11b3-473c-b209-c3e78e195f88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:56:34.203216 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-a11fb85e-11b3-473c-b209-c3e78e195f88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:56:34.216726 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11fb85e-11b3-473c-b209-c3e78e195f88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:56:34.218165 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11fb85e-11b3-473c-b209-c3e78e195f88 service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:56:34.228844 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1113/2232] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:56:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:56:39.646286 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee6bee-46ba-4b9b-bc14-0cb612eb98b1 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:56:39.656404 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee6bee-46ba-4b9b-bc14-0cb612eb98b1 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:56:39.659969 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a7c5a-cff9-4d33-9d13-8bedec4fd64f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:56:39.660572 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a7c5a-cff9-4d33-9d13-8bedec4fd64f service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:56:39.660851 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a7c5a-cff9-4d33-9d13-8bedec4fd64f service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:56:39.661125 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a7c5a-cff9-4d33-9d13-8bedec4fd64f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:56:39.662903 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-4b2a7c5a-cff9-4d33-9d13-8bedec4fd64f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:56:39.676654 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a7c5a-cff9-4d33-9d13-8bedec4fd64f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:56:39.678122 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a7c5a-cff9-4d33-9d13-8bedec4fd64f service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:56:39.689090 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1120/2233] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:56:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:56:44.224069 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=6 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:56:49.684928 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=6 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:56:50.788988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fb85e-11b3-473c-b209-c3e78e195f88 service neutron] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:56:50.798163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fb85e-11b3-473c-b209-c3e78e195f88 service neutron] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:56:50.801781 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283a8a9-6d4c-4794-9f54-b5b6e8660e44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:56:50.802388 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283a8a9-6d4c-4794-9f54-b5b6e8660e44 service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:56:50.802672 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283a8a9-6d4c-4794-9f54-b5b6e8660e44 service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:56:50.802950 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283a8a9-6d4c-4794-9f54-b5b6e8660e44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:56:50.804835 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-f283a8a9-6d4c-4794-9f54-b5b6e8660e44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:56:50.815884 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283a8a9-6d4c-4794-9f54-b5b6e8660e44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:56:50.817293 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283a8a9-6d4c-4794-9f54-b5b6e8660e44 service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:56:50.826159 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1114/2234] 10.222.0.46 () {60 vars in 1396 bytes} [Wed Aug 3 12:56:50 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3262 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:56:55.023124 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fc3c1-6be0-40f0-878d-a506c185435c None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:56:55.023605 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fc3c1-6be0-40f0-878d-a506c185435c None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:56:55.023696 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fc3c1-6be0-40f0-878d-a506c185435c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:56:55.042671 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-445fc3c1-6be0-40f0-878d-a506c185435c None None] MFA Rules not processed for user `831d8776102847efbdae901f2b863226`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:56:55.044413 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-445fc3c1-6be0-40f0-878d-a506c185435c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:56:55.051325 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1121/2235] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:56:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:56:55.352088 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283a8a9-6d4c-4794-9f54-b5b6e8660e44 service neutron] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:56:55.361425 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283a8a9-6d4c-4794-9f54-b5b6e8660e44 service neutron] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:56:55.365305 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a9fd6-3ac2-4c21-9378-bb2d0c0a86ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:56:55.365971 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a9fd6-3ac2-4c21-9378-bb2d0c0a86ab service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:56:55.366278 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a9fd6-3ac2-4c21-9378-bb2d0c0a86ab service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:56:55.366559 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a9fd6-3ac2-4c21-9378-bb2d0c0a86ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:56:55.368359 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-1d7a9fd6-3ac2-4c21-9378-bb2d0c0a86ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:56:55.382087 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a9fd6-3ac2-4c21-9378-bb2d0c0a86ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:56:55.382236 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a9fd6-3ac2-4c21-9378-bb2d0c0a86ab service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:56:55.390630 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1115/2236] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:56:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:57:02.054546 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fc3c1-6be0-40f0-878d-a506c185435c None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:02.056053 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-445fc3c1-6be0-40f0-878d-a506c185435c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:02.072375 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fc3c1-6be0-40f0-878d-a506c185435c None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:02.078045 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23fe98e-1b60-4dea-82ee-8cf9a412322e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:02.078676 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23fe98e-1b60-4dea-82ee-8cf9a412322e service nova] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:02.078963 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23fe98e-1b60-4dea-82ee-8cf9a412322e service nova] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:02.079239 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23fe98e-1b60-4dea-82ee-8cf9a412322e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:02.081136 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-a23fe98e-1b60-4dea-82ee-8cf9a412322e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:02.149557 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23fe98e-1b60-4dea-82ee-8cf9a412322e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:02.151180 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23fe98e-1b60-4dea-82ee-8cf9a412322e service nova] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:02.162033 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1122/2237] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:57:02 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:57:05.386825 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=12 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:57:10.400785 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a9fd6-3ac2-4c21-9378-bb2d0c0a86ab service neutron] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:10.410189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a9fd6-3ac2-4c21-9378-bb2d0c0a86ab service neutron] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:10.414237 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff25b3a-b048-4658-abcc-9c688295f5bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:10.414866 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff25b3a-b048-4658-abcc-9c688295f5bd service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:10.415148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff25b3a-b048-4658-abcc-9c688295f5bd service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:10.415424 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff25b3a-b048-4658-abcc-9c688295f5bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:10.417218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-eff25b3a-b048-4658-abcc-9c688295f5bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:10.427988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff25b3a-b048-4658-abcc-9c688295f5bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:10.429436 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff25b3a-b048-4658-abcc-9c688295f5bd service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:10.439339 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1116/2238] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:57:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:57:11.523772 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da3832-27ec-44c3-863b-99dc7c97b85d None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:11.524269 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da3832-27ec-44c3-863b-99dc7c97b85d None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:11.524366 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da3832-27ec-44c3-863b-99dc7c97b85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:11.544502 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-73da3832-27ec-44c3-863b-99dc7c97b85d None None] MFA Rules not processed for user `7a109db9f7754b5a8f5b53fa7030691c`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:57:11.545756 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-73da3832-27ec-44c3-863b-99dc7c97b85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:11.552603 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1123/2239] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:57:11 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:57:12.154354 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff25b3a-b048-4658-abcc-9c688295f5bd service neutron] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:12.155820 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-eff25b3a-b048-4658-abcc-9c688295f5bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:12.231650 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff25b3a-b048-4658-abcc-9c688295f5bd service neutron] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:12.236695 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae9954-a95d-4da0-bc5d-a27077de7abb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56847173abb48d39c0ee6fb9cdbbbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:12.237314 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae9954-a95d-4da0-bc5d-a27077de7abb service placement] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:12.237628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae9954-a95d-4da0-bc5d-a27077de7abb service placement] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:12.237907 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae9954-a95d-4da0-bc5d-a27077de7abb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:12.239683 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-9cae9954-a95d-4da0-bc5d-a27077de7abb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:12.251651 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae9954-a95d-4da0-bc5d-a27077de7abb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:12.253281 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae9954-a95d-4da0-bc5d-a27077de7abb service placement] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:12.264093 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1117/2240] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:57:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:57:20.435257 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da3832-27ec-44c3-863b-99dc7c97b85d None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:20.436708 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-73da3832-27ec-44c3-863b-99dc7c97b85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:20.442557 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=35 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:57:20.503915 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da3832-27ec-44c3-863b-99dc7c97b85d None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:20.508146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b390802-bc31-4030-aca9-d78f8ceb39f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:20.508706 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b390802-bc31-4030-aca9-d78f8ceb39f1 service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:20.508986 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b390802-bc31-4030-aca9-d78f8ceb39f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:20.509261 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b390802-bc31-4030-aca9-d78f8ceb39f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:20.511055 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-1b390802-bc31-4030-aca9-d78f8ceb39f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:20.522235 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b390802-bc31-4030-aca9-d78f8ceb39f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:20.523716 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b390802-bc31-4030-aca9-d78f8ceb39f1 service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:20.533378 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1124/2241] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:57:20 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:57:22.259826 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=38 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:57:29.661084 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae9954-a95d-4da0-bc5d-a27077de7abb service placement] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:29.662759 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-9cae9954-a95d-4da0-bc5d-a27077de7abb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:29.692285 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae9954-a95d-4da0-bc5d-a27077de7abb service placement] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:29.700037 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7203fb0-90c4-49b5-8979-376e7e799ad8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:29.700741 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7203fb0-90c4-49b5-8979-376e7e799ad8 service nova] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:29.701103 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7203fb0-90c4-49b5-8979-376e7e799ad8 service nova] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:29.701462 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7203fb0-90c4-49b5-8979-376e7e799ad8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:29.703485 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-a7203fb0-90c4-49b5-8979-376e7e799ad8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:29.717862 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7203fb0-90c4-49b5-8979-376e7e799ad8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:29.719637 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7203fb0-90c4-49b5-8979-376e7e799ad8 service nova] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:29.732463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1118/2242] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:57:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:57:30.528843 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=25 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:57:39.727400 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=6 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:57:41.767329 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b390802-bc31-4030-aca9-d78f8ceb39f1 service cinder] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:41.777283 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b390802-bc31-4030-aca9-d78f8ceb39f1 service cinder] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:41.780937 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c368e-1861-40e7-b1dd-8bebf09e8f38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:41.781576 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c368e-1861-40e7-b1dd-8bebf09e8f38 service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:41.781861 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c368e-1861-40e7-b1dd-8bebf09e8f38 service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:41.782140 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c368e-1861-40e7-b1dd-8bebf09e8f38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:41.783895 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-9f5c368e-1861-40e7-b1dd-8bebf09e8f38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:41.846732 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c368e-1861-40e7-b1dd-8bebf09e8f38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:41.848146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c368e-1861-40e7-b1dd-8bebf09e8f38 service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:41.858252 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1125/2243] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:57:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:57:44.035138 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7203fb0-90c4-49b5-8979-376e7e799ad8 service nova] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:44.036834 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-a7203fb0-90c4-49b5-8979-376e7e799ad8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:44.049592 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7203fb0-90c4-49b5-8979-376e7e799ad8 service nova] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:44.053525 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f0155-75cb-4f8f-b5aa-0801595bc6dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:44.054228 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f0155-75cb-4f8f-b5aa-0801595bc6dc service cinder] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:44.054560 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f0155-75cb-4f8f-b5aa-0801595bc6dc service cinder] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:44.054905 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f0155-75cb-4f8f-b5aa-0801595bc6dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:44.056997 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-938f0155-75cb-4f8f-b5aa-0801595bc6dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:44.138515 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f0155-75cb-4f8f-b5aa-0801595bc6dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:44.140008 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f0155-75cb-4f8f-b5aa-0801595bc6dc service cinder] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:44.149406 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1119/2244] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:57:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:57:45.451768 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c368e-1861-40e7-b1dd-8bebf09e8f38 service neutron] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:45.463083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c368e-1861-40e7-b1dd-8bebf09e8f38 service neutron] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:45.469179 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd68c19-d452-4f42-babc-9776b1981278 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56847173abb48d39c0ee6fb9cdbbbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:45.469827 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd68c19-d452-4f42-babc-9776b1981278 service placement] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:45.470109 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd68c19-d452-4f42-babc-9776b1981278 service placement] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:45.470406 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd68c19-d452-4f42-babc-9776b1981278 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:45.472151 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-ecd68c19-d452-4f42-babc-9776b1981278 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:45.484741 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd68c19-d452-4f42-babc-9776b1981278 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:45.486919 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd68c19-d452-4f42-babc-9776b1981278 service placement] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:45.502451 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1126/2245] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:57:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:57:45.516825 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f0155-75cb-4f8f-b5aa-0801595bc6dc service cinder] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:45.518421 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-938f0155-75cb-4f8f-b5aa-0801595bc6dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:45.538040 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f0155-75cb-4f8f-b5aa-0801595bc6dc service cinder] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:45.543203 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128dd03-a6b6-4add-9b1d-da1369c951d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:45.543971 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128dd03-a6b6-4add-9b1d-da1369c951d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:45.544241 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128dd03-a6b6-4add-9b1d-da1369c951d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:45.544512 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128dd03-a6b6-4add-9b1d-da1369c951d6 admin admin] PATH_INFO: `/v3/users/539502db204e415c85520d9b7fe77d99` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:45.545726 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3128dd03-a6b6-4add-9b1d-da1369c951d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=539502db204e415c85520d9b7fe77d99)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:45.547628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3128dd03-a6b6-4add-9b1d-da1369c951d6 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:45.599915 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-3128dd03-a6b6-4add-9b1d-da1369c951d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '539502db204e415c85520d9b7fe77d99'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:57:45.607862 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-3128dd03-a6b6-4add-9b1d-da1369c951d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '539502db204e415c85520d9b7fe77d99'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:57:45.608598 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-3128dd03-a6b6-4add-9b1d-da1369c951d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '539502db204e415c85520d9b7fe77d99'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:57:45.609283 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-3128dd03-a6b6-4add-9b1d-da1369c951d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '539502db204e415c85520d9b7fe77d99'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:57:45.621254 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-3128dd03-a6b6-4add-9b1d-da1369c951d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '539502db204e415c85520d9b7fe77d99'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:57:45.634266 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1120/2246] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:57:45 2022] DELETE /identity/v3/users/539502db204e415c85520d9b7fe77d99 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:57:45.811615 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd68c19-d452-4f42-babc-9776b1981278 service placement] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:45.829488 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd68c19-d452-4f42-babc-9776b1981278 service placement] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:45.891946 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fa5b2-2b41-422a-b455-63299c7c3300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:45.892591 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fa5b2-2b41-422a-b455-63299c7c3300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:45.892877 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fa5b2-2b41-422a-b455-63299c7c3300 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:45.893156 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fa5b2-2b41-422a-b455-63299c7c3300 admin admin] PATH_INFO: `/v3/projects/b0e23361693d4d7d823e600c73855c3e` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:45.894438 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157fa5b2-2b41-422a-b455-63299c7c3300 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0e23361693d4d7d823e600c73855c3e)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:45.896409 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157fa5b2-2b41-422a-b455-63299c7c3300 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:45.942558 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-157fa5b2-2b41-422a-b455-63299c7c3300 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0e23361693d4d7d823e600c73855c3e', 'request_id': 'req-157fa5b2-2b41-422a-b455-63299c7c3300'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:57:45.949285 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-157fa5b2-2b41-422a-b455-63299c7c3300 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0e23361693d4d7d823e600c73855c3e', 'request_id': 'req-157fa5b2-2b41-422a-b455-63299c7c3300'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:57:45.956667 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-157fa5b2-2b41-422a-b455-63299c7c3300 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0e23361693d4d7d823e600c73855c3e', 'request_id': 'req-157fa5b2-2b41-422a-b455-63299c7c3300'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:57:45.967296 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-157fa5b2-2b41-422a-b455-63299c7c3300 admin admin] The token cache is being invalidate because project b0e23361693d4d7d823e600c73855c3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:57:45.967597 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-157fa5b2-2b41-422a-b455-63299c7c3300 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:57:45.968206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-157fa5b2-2b41-422a-b455-63299c7c3300 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:57:45.969746 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1127/2247] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:57:45 2022] DELETE /identity/v3/projects/b0e23361693d4d7d823e600c73855c3e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:57:45.974640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe642eb7-2d62-4db3-9d8f-69be09e98bbe None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:45.974984 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe642eb7-2d62-4db3-9d8f-69be09e98bbe None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:45.975260 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe642eb7-2d62-4db3-9d8f-69be09e98bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:45.994627 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-fe642eb7-2d62-4db3-9d8f-69be09e98bbe None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:57:45.996048 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-fe642eb7-2d62-4db3-9d8f-69be09e98bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:46.055296 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1121/2248] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:57:46.063226 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13f8b6-37e2-4cf7-9f29-df05b2602f51 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:46.063584 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13f8b6-37e2-4cf7-9f29-df05b2602f51 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:46.063929 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13f8b6-37e2-4cf7-9f29-df05b2602f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:46.084271 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-bc13f8b6-37e2-4cf7-9f29-df05b2602f51 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:57:46.085509 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-bc13f8b6-37e2-4cf7-9f29-df05b2602f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:46.094749 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1128/2249] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:57:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:57:46.099070 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe642eb7-2d62-4db3-9d8f-69be09e98bbe None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:46.108883 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe642eb7-2d62-4db3-9d8f-69be09e98bbe None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:46.113515 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f81cd2-ca50-418d-804b-dabe2c3bbe49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:46.114132 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f81cd2-ca50-418d-804b-dabe2c3bbe49 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:46.114416 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f81cd2-ca50-418d-804b-dabe2c3bbe49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:46.114695 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f81cd2-ca50-418d-804b-dabe2c3bbe49 admin admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:46.115395 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f81cd2-ca50-418d-804b-dabe2c3bbe49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:57:46.115705 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f81cd2-ca50-418d-804b-dabe2c3bbe49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:46.117334 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f81cd2-ca50-418d-804b-dabe2c3bbe49 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:46.124333 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:57:46.131025 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1122/2250] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:57:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:57:46.135479 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13f8b6-37e2-4cf7-9f29-df05b2602f51 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:46.141969 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:57:46.146740 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13f8b6-37e2-4cf7-9f29-df05b2602f51 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:46.153963 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3e90b-35b6-4592-8978-3f0fdf098b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:46.154964 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3e90b-35b6-4592-8978-3f0fdf098b25 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:46.155506 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3e90b-35b6-4592-8978-3f0fdf098b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:46.156175 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3e90b-35b6-4592-8978-3f0fdf098b25 admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:46.156920 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3e90b-35b6-4592-8978-3f0fdf098b25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:46.158947 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3e90b-35b6-4592-8978-3f0fdf098b25 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:46.190842 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1129/2251] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:57:46 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:57:46.192072 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f81cd2-ca50-418d-804b-dabe2c3bbe49 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:46.203332 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f81cd2-ca50-418d-804b-dabe2c3bbe49 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:46.263837 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cd3e9-7322-4b9b-9282-fc7c2a3b897d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:46.264467 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cd3e9-7322-4b9b-9282-fc7c2a3b897d admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:46.264753 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cd3e9-7322-4b9b-9282-fc7c2a3b897d admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:46.265028 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884cd3e9-7322-4b9b-9282-fc7c2a3b897d admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:46.265850 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884cd3e9-7322-4b9b-9282-fc7c2a3b897d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:46.267664 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884cd3e9-7322-4b9b-9282-fc7c2a3b897d admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:46.293356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1123/2252] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:57:46 2022] POST /identity/v3/users => generated 285 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:57:46.294838 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3e90b-35b6-4592-8978-3f0fdf098b25 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:46.305476 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3e90b-35b6-4592-8978-3f0fdf098b25 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:46.311040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923feff1-f5d0-4838-9bf1-f896951ed996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:46.311649 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923feff1-f5d0-4838-9bf1-f896951ed996 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:46.311934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923feff1-f5d0-4838-9bf1-f896951ed996 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:46.312211 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923feff1-f5d0-4838-9bf1-f896951ed996 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:46.312915 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923feff1-f5d0-4838-9bf1-f896951ed996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:46.314553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923feff1-f5d0-4838-9bf1-f896951ed996 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:46.325849 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1130/2253] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:57:46.329920 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cd3e9-7322-4b9b-9282-fc7c2a3b897d admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:46.340119 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884cd3e9-7322-4b9b-9282-fc7c2a3b897d admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:46.345063 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fa665-a0ca-491d-a5b0-8a39b00be694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:46.345716 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fa665-a0ca-491d-a5b0-8a39b00be694 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:46.346001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fa665-a0ca-491d-a5b0-8a39b00be694 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:46.346286 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fa665-a0ca-491d-a5b0-8a39b00be694 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:46.346995 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fa665-a0ca-491d-a5b0-8a39b00be694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:46.348634 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fa665-a0ca-491d-a5b0-8a39b00be694 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:46.361093 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1124/2254] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:57:46.365346 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923feff1-f5d0-4838-9bf1-f896951ed996 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:46.376286 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923feff1-f5d0-4838-9bf1-f896951ed996 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:46.381252 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360fe0b-623a-4790-ba8d-a2f60d3e7586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:46.381966 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360fe0b-623a-4790-ba8d-a2f60d3e7586 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:46.382240 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360fe0b-623a-4790-ba8d-a2f60d3e7586 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:46.382516 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360fe0b-623a-4790-ba8d-a2f60d3e7586 admin admin] PATH_INFO: `/v3/projects/00af340acb184f16b50761edf91d625f/users/32119893e00e4b13b35481da61b9eebe/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:46.398057 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7360fe0b-623a-4790-ba8d-a2f60d3e7586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00af340acb184f16b50761edf91d625f, user_id=32119893e00e4b13b35481da61b9eebe, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:46.400716 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7360fe0b-623a-4790-ba8d-a2f60d3e7586 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:46.415866 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1131/2255] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:57:46 2022] PUT /identity/v3/projects/00af340acb184f16b50761edf91d625f/users/32119893e00e4b13b35481da61b9eebe/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:57:46.427171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0eb323-6f5c-473d-9b74-008d7648f70f None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:46.427476 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0eb323-6f5c-473d-9b74-008d7648f70f None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:46.427745 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0eb323-6f5c-473d-9b74-008d7648f70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:46.460422 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-da0eb323-6f5c-473d-9b74-008d7648f70f None None] MFA Rules not processed for user `32119893e00e4b13b35481da61b9eebe`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:57:46.462012 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-da0eb323-6f5c-473d-9b74-008d7648f70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:46.530918 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1125/2256] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:57:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:57:46.535642 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360fe0b-623a-4790-ba8d-a2f60d3e7586 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:46.613193 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360fe0b-623a-4790-ba8d-a2f60d3e7586 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:46.618385 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2981410-aea9-4d73-8887-5e8399f1d05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:46.619878 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2981410-aea9-4d73-8887-5e8399f1d05f admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:46.620222 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2981410-aea9-4d73-8887-5e8399f1d05f admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:46.621013 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2981410-aea9-4d73-8887-5e8399f1d05f admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:46.621721 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2981410-aea9-4d73-8887-5e8399f1d05f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:46.623681 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2981410-aea9-4d73-8887-5e8399f1d05f admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:46.656652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1132/2257] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:57:46 2022] POST /identity/v3/projects => generated 367 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:57:46.660665 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0eb323-6f5c-473d-9b74-008d7648f70f None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:46.682112 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0eb323-6f5c-473d-9b74-008d7648f70f None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:46.752316 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865eeefa-bad1-48ed-b619-11a628312cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:46.753325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865eeefa-bad1-48ed-b619-11a628312cfb admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:46.753645 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865eeefa-bad1-48ed-b619-11a628312cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:46.753928 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865eeefa-bad1-48ed-b619-11a628312cfb admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:46.754635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865eeefa-bad1-48ed-b619-11a628312cfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:46.756855 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865eeefa-bad1-48ed-b619-11a628312cfb admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:46.773009 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:57:46.793839 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1126/2258] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:57:46 2022] POST /identity/v3/users => generated 290 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:57:46.797553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2981410-aea9-4d73-8887-5e8399f1d05f admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:46.812788 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2981410-aea9-4d73-8887-5e8399f1d05f admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:46.818079 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e0dff-0952-47e3-8be1-b78dafeaf0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:46.819034 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e0dff-0952-47e3-8be1-b78dafeaf0ed admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:46.819321 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e0dff-0952-47e3-8be1-b78dafeaf0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:46.820102 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e0dff-0952-47e3-8be1-b78dafeaf0ed admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:46.820827 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e0dff-0952-47e3-8be1-b78dafeaf0ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:46.822528 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e0dff-0952-47e3-8be1-b78dafeaf0ed admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:46.835018 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1133/2259] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:57:46.839608 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865eeefa-bad1-48ed-b619-11a628312cfb admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:46.849659 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865eeefa-bad1-48ed-b619-11a628312cfb admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:46.854338 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e54a80-9b4d-4af4-9f17-bd5fdb805e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:46.855544 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e54a80-9b4d-4af4-9f17-bd5fdb805e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:46.855825 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e54a80-9b4d-4af4-9f17-bd5fdb805e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:46.856097 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e54a80-9b4d-4af4-9f17-bd5fdb805e01 admin admin] PATH_INFO: `/v3/projects/b7a976f8d69f4a36837bf1e037d18cfe/users/245f0bb8d2f1474891a6b064b6f2f0a0/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:46.871588 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e54a80-9b4d-4af4-9f17-bd5fdb805e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7a976f8d69f4a36837bf1e037d18cfe, user_id=245f0bb8d2f1474891a6b064b6f2f0a0, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:46.874901 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e54a80-9b4d-4af4-9f17-bd5fdb805e01 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:46.892954 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1127/2260] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:57:46 2022] PUT /identity/v3/projects/b7a976f8d69f4a36837bf1e037d18cfe/users/245f0bb8d2f1474891a6b064b6f2f0a0/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:57:46.896477 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e0dff-0952-47e3-8be1-b78dafeaf0ed admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:46.909666 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e0dff-0952-47e3-8be1-b78dafeaf0ed admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:47.000227 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c558ce-7e88-4fe4-893f-f4927995b1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:47.001566 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c558ce-7e88-4fe4-893f-f4927995b1ce admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:47.002064 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c558ce-7e88-4fe4-893f-f4927995b1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:47.002416 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c558ce-7e88-4fe4-893f-f4927995b1ce admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:47.004441 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c558ce-7e88-4fe4-893f-f4927995b1ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:47.006068 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c558ce-7e88-4fe4-893f-f4927995b1ce admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:47.029418 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1134/2261] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:57:47.033401 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e54a80-9b4d-4af4-9f17-bd5fdb805e01 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:47.058243 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e54a80-9b4d-4af4-9f17-bd5fdb805e01 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:47.068952 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818595f0-a2a5-47f3-a13b-c7042794c69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:47.069694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818595f0-a2a5-47f3-a13b-c7042794c69c admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:47.069977 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818595f0-a2a5-47f3-a13b-c7042794c69c admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:47.070375 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818595f0-a2a5-47f3-a13b-c7042794c69c admin admin] PATH_INFO: `/v3/projects/b7a976f8d69f4a36837bf1e037d18cfe/users/245f0bb8d2f1474891a6b064b6f2f0a0/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:47.072496 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818595f0-a2a5-47f3-a13b-c7042794c69c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7a976f8d69f4a36837bf1e037d18cfe, user_id=245f0bb8d2f1474891a6b064b6f2f0a0, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:47.075977 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818595f0-a2a5-47f3-a13b-c7042794c69c admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:47.088100 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1128/2262] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:57:47 2022] PUT /identity/v3/projects/b7a976f8d69f4a36837bf1e037d18cfe/users/245f0bb8d2f1474891a6b064b6f2f0a0/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:57:47.100676 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937d0d8-e9d5-475f-b7b8-65a018bd871e None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:47.100999 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937d0d8-e9d5-475f-b7b8-65a018bd871e None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:47.101273 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937d0d8-e9d5-475f-b7b8-65a018bd871e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:47.133244 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-0937d0d8-e9d5-475f-b7b8-65a018bd871e None None] MFA Rules not processed for user `245f0bb8d2f1474891a6b064b6f2f0a0`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:57:47.134505 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-0937d0d8-e9d5-475f-b7b8-65a018bd871e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:47.141127 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:57:47.222867 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1135/2263] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:57:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:57:47.235678 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818595f0-a2a5-47f3-a13b-c7042794c69c admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:47.237589 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-818595f0-a2a5-47f3-a13b-c7042794c69c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:47.298855 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818595f0-a2a5-47f3-a13b-c7042794c69c admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:47.302652 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ffd7b-9341-42f7-9bd7-d1ef0e549d5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:47.303275 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ffd7b-9341-42f7-9bd7-d1ef0e549d5b service cinder] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:47.303552 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ffd7b-9341-42f7-9bd7-d1ef0e549d5b service cinder] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:47.303826 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ffd7b-9341-42f7-9bd7-d1ef0e549d5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:47.313114 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ffd7b-9341-42f7-9bd7-d1ef0e549d5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:47.314587 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ffd7b-9341-42f7-9bd7-d1ef0e549d5b service cinder] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:47.324539 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1129/2264] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:57:47 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:57:48.774172 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937d0d8-e9d5-475f-b7b8-65a018bd871e None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:48.843720 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937d0d8-e9d5-475f-b7b8-65a018bd871e None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:48.848604 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b6cd5-d75e-4623-bee6-8670b3677bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:48.849275 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b6cd5-d75e-4623-bee6-8670b3677bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:48.849580 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b6cd5-d75e-4623-bee6-8670b3677bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:48.849863 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b6cd5-d75e-4623-bee6-8670b3677bb9 admin admin] PATH_INFO: `/v3/users/32119893e00e4b13b35481da61b9eebe` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:48.851041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b6cd5-d75e-4623-bee6-8670b3677bb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32119893e00e4b13b35481da61b9eebe)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:48.852996 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b6cd5-d75e-4623-bee6-8670b3677bb9 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:48.914088 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-4a1b6cd5-d75e-4623-bee6-8670b3677bb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32119893e00e4b13b35481da61b9eebe'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:57:48.914808 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-4a1b6cd5-d75e-4623-bee6-8670b3677bb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32119893e00e4b13b35481da61b9eebe'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:57:48.915469 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-4a1b6cd5-d75e-4623-bee6-8670b3677bb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32119893e00e4b13b35481da61b9eebe'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:57:48.928870 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-4a1b6cd5-d75e-4623-bee6-8670b3677bb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32119893e00e4b13b35481da61b9eebe'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:57:48.937276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-4a1b6cd5-d75e-4623-bee6-8670b3677bb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32119893e00e4b13b35481da61b9eebe'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:57:48.958759 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1136/2265] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:57:48 2022] DELETE /identity/v3/users/32119893e00e4b13b35481da61b9eebe => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:57:48.963220 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecb636-2d26-4ca6-a109-da23dd76f5e7 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:48.963684 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecb636-2d26-4ca6-a109-da23dd76f5e7 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:48.963797 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecb636-2d26-4ca6-a109-da23dd76f5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:48.985067 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-beecb636-2d26-4ca6-a109-da23dd76f5e7 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:57:48.986327 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-beecb636-2d26-4ca6-a109-da23dd76f5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:49.049262 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1130/2266] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:57:49.060026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b6cd5-d75e-4623-bee6-8670b3677bb9 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:49.061460 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-4a1b6cd5-d75e-4623-bee6-8670b3677bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:49.091924 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:57:49.129878 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b6cd5-d75e-4623-bee6-8670b3677bb9 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:49.134732 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639374f-62cf-428c-b220-8a890ec9749e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:49.135376 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639374f-62cf-428c-b220-8a890ec9749e service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:49.135657 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639374f-62cf-428c-b220-8a890ec9749e service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:49.136456 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639374f-62cf-428c-b220-8a890ec9749e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:49.146072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9639374f-62cf-428c-b220-8a890ec9749e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:49.147513 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9639374f-62cf-428c-b220-8a890ec9749e service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:49.158382 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1137/2267] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:57:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:57:49.604039 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecb636-2d26-4ca6-a109-da23dd76f5e7 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:49.606113 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-beecb636-2d26-4ca6-a109-da23dd76f5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:49.618488 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecb636-2d26-4ca6-a109-da23dd76f5e7 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:49.630936 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eab5c5-b6a6-4761-8852-c6e4d16727ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:49.631709 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eab5c5-b6a6-4761-8852-c6e4d16727ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:49.632063 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eab5c5-b6a6-4761-8852-c6e4d16727ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:49.632411 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eab5c5-b6a6-4761-8852-c6e4d16727ad admin admin] PATH_INFO: `/v3/projects/00af340acb184f16b50761edf91d625f` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:49.633716 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eab5c5-b6a6-4761-8852-c6e4d16727ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=00af340acb184f16b50761edf91d625f)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:49.635764 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eab5c5-b6a6-4761-8852-c6e4d16727ad admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:49.687080 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-c2eab5c5-b6a6-4761-8852-c6e4d16727ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00af340acb184f16b50761edf91d625f', 'request_id': 'req-c2eab5c5-b6a6-4761-8852-c6e4d16727ad'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:57:49.694272 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-c2eab5c5-b6a6-4761-8852-c6e4d16727ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00af340acb184f16b50761edf91d625f', 'request_id': 'req-c2eab5c5-b6a6-4761-8852-c6e4d16727ad'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:57:49.696340 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:57:49.700892 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-c2eab5c5-b6a6-4761-8852-c6e4d16727ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00af340acb184f16b50761edf91d625f', 'request_id': 'req-c2eab5c5-b6a6-4761-8852-c6e4d16727ad'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:57:49.715183 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-c2eab5c5-b6a6-4761-8852-c6e4d16727ad admin admin] The token cache is being invalidate because project 00af340acb184f16b50761edf91d625f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:57:49.715466 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-c2eab5c5-b6a6-4761-8852-c6e4d16727ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:57:49.716121 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-c2eab5c5-b6a6-4761-8852-c6e4d16727ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:57:49.717958 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1131/2268] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:57:49 2022] DELETE /identity/v3/projects/00af340acb184f16b50761edf91d625f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:57:49.721663 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639374f-62cf-428c-b220-8a890ec9749e service neutron] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:49.732380 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639374f-62cf-428c-b220-8a890ec9749e service neutron] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:49.796589 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef221a-2da5-4382-942f-20744183f7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:49.797254 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef221a-2da5-4382-942f-20744183f7b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:49.797519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef221a-2da5-4382-942f-20744183f7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:49.797803 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef221a-2da5-4382-942f-20744183f7b3 admin admin] PATH_INFO: `/v3/users/245f0bb8d2f1474891a6b064b6f2f0a0` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:49.798983 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef221a-2da5-4382-942f-20744183f7b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=245f0bb8d2f1474891a6b064b6f2f0a0)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:49.800915 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef221a-2da5-4382-942f-20744183f7b3 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:49.850483 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-43ef221a-2da5-4382-942f-20744183f7b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '245f0bb8d2f1474891a6b064b6f2f0a0'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:57:49.851141 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-43ef221a-2da5-4382-942f-20744183f7b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '245f0bb8d2f1474891a6b064b6f2f0a0'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:57:49.851747 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-43ef221a-2da5-4382-942f-20744183f7b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '245f0bb8d2f1474891a6b064b6f2f0a0'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:57:49.864111 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-43ef221a-2da5-4382-942f-20744183f7b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '245f0bb8d2f1474891a6b064b6f2f0a0'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:57:49.871641 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-43ef221a-2da5-4382-942f-20744183f7b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '245f0bb8d2f1474891a6b064b6f2f0a0'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:57:49.884593 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1138/2269] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:57:49 2022] DELETE /identity/v3/users/245f0bb8d2f1474891a6b064b6f2f0a0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:57:50.176070 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a2647-d39d-4856-be65-3c97b15c8e41 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:50.176612 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a2647-d39d-4856-be65-3c97b15c8e41 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:50.176706 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a2647-d39d-4856-be65-3c97b15c8e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:50.195988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-646a2647-d39d-4856-be65-3c97b15c8e41 None None] MFA Rules not processed for user `e3eba8e63be14907a364797a0189290c`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:57:50.197224 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-646a2647-d39d-4856-be65-3c97b15c8e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:50.243768 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef221a-2da5-4382-942f-20744183f7b3 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:50.245720 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-43ef221a-2da5-4382-942f-20744183f7b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:50.267797 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1132/2270] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:57:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:57:50.310281 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:57:50.332565 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef221a-2da5-4382-942f-20744183f7b3 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:50.337290 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b4c08-c398-4c7d-af08-c783bb74f4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:50.337965 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b4c08-c398-4c7d-af08-c783bb74f4b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:50.338254 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b4c08-c398-4c7d-af08-c783bb74f4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:50.338533 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b4c08-c398-4c7d-af08-c783bb74f4b0 admin admin] PATH_INFO: `/v3/projects/b7a976f8d69f4a36837bf1e037d18cfe` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:50.340472 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b4c08-c398-4c7d-af08-c783bb74f4b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7a976f8d69f4a36837bf1e037d18cfe)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:50.342401 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b4c08-c398-4c7d-af08-c783bb74f4b0 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:50.392018 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-541b4c08-c398-4c7d-af08-c783bb74f4b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7a976f8d69f4a36837bf1e037d18cfe', 'request_id': 'req-541b4c08-c398-4c7d-af08-c783bb74f4b0'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:57:50.398772 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-541b4c08-c398-4c7d-af08-c783bb74f4b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7a976f8d69f4a36837bf1e037d18cfe', 'request_id': 'req-541b4c08-c398-4c7d-af08-c783bb74f4b0'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:57:50.407715 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-541b4c08-c398-4c7d-af08-c783bb74f4b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7a976f8d69f4a36837bf1e037d18cfe', 'request_id': 'req-541b4c08-c398-4c7d-af08-c783bb74f4b0'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:57:50.418664 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-541b4c08-c398-4c7d-af08-c783bb74f4b0 admin admin] The token cache is being invalidate because project b7a976f8d69f4a36837bf1e037d18cfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:57:50.418956 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-541b4c08-c398-4c7d-af08-c783bb74f4b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:57:50.419605 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-541b4c08-c398-4c7d-af08-c783bb74f4b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:57:50.421152 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1139/2271] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:57:50 2022] DELETE /identity/v3/projects/b7a976f8d69f4a36837bf1e037d18cfe => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:57:50.426845 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aed4e9-b510-4416-b24e-87940faaf74a None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:50.427220 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aed4e9-b510-4416-b24e-87940faaf74a None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:50.427570 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aed4e9-b510-4416-b24e-87940faaf74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:50.447544 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-e9aed4e9-b510-4416-b24e-87940faaf74a None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:57:50.449518 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-e9aed4e9-b510-4416-b24e-87940faaf74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:50.509393 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1133/2272] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:57:50.517803 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befad02-d52e-4585-926d-441c2bb7d4ed None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:50.518095 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befad02-d52e-4585-926d-441c2bb7d4ed None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:50.518373 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befad02-d52e-4585-926d-441c2bb7d4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:50.539061 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-8befad02-d52e-4585-926d-441c2bb7d4ed None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:57:50.540287 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-8befad02-d52e-4585-926d-441c2bb7d4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:50.549342 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1140/2273] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:57:50.553653 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aed4e9-b510-4416-b24e-87940faaf74a None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:50.563672 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aed4e9-b510-4416-b24e-87940faaf74a None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:50.568263 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62116395-42d8-4df7-b557-66b979f1de4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:50.568872 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62116395-42d8-4df7-b557-66b979f1de4b admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:50.569147 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62116395-42d8-4df7-b557-66b979f1de4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:50.569419 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62116395-42d8-4df7-b557-66b979f1de4b admin admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:50.570143 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62116395-42d8-4df7-b557-66b979f1de4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:57:50.570443 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62116395-42d8-4df7-b557-66b979f1de4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:50.572030 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62116395-42d8-4df7-b557-66b979f1de4b admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:50.585179 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1134/2274] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:57:50.589798 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befad02-d52e-4585-926d-441c2bb7d4ed None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:50.599206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befad02-d52e-4585-926d-441c2bb7d4ed None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:50.603937 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46cd170-2859-4907-8e06-9f90ed84b3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:50.605074 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cd170-2859-4907-8e06-9f90ed84b3cc admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:50.605367 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cd170-2859-4907-8e06-9f90ed84b3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:50.605693 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cd170-2859-4907-8e06-9f90ed84b3cc admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:50.606362 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46cd170-2859-4907-8e06-9f90ed84b3cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:50.608283 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46cd170-2859-4907-8e06-9f90ed84b3cc admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:50.636098 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1141/2275] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:57:50 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:57:50.640410 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62116395-42d8-4df7-b557-66b979f1de4b admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:50.651430 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62116395-42d8-4df7-b557-66b979f1de4b admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:50.710716 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b4563-e50e-4071-9a14-8a2aa512dba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:50.711965 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b4563-e50e-4071-9a14-8a2aa512dba4 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:50.711965 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b4563-e50e-4071-9a14-8a2aa512dba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:50.711965 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b4563-e50e-4071-9a14-8a2aa512dba4 admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:50.712514 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b4563-e50e-4071-9a14-8a2aa512dba4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:50.715162 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b4563-e50e-4071-9a14-8a2aa512dba4 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:50.736749 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1135/2276] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:57:50 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:57:50.740747 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46cd170-2859-4907-8e06-9f90ed84b3cc admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:50.751619 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46cd170-2859-4907-8e06-9f90ed84b3cc admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:50.756522 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c6de2-41a5-4f3a-9fb8-49606a8ab2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:50.757129 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c6de2-41a5-4f3a-9fb8-49606a8ab2db admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:50.757404 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c6de2-41a5-4f3a-9fb8-49606a8ab2db admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:50.757710 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c6de2-41a5-4f3a-9fb8-49606a8ab2db admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:50.758400 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c6de2-41a5-4f3a-9fb8-49606a8ab2db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:50.760162 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c6de2-41a5-4f3a-9fb8-49606a8ab2db admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:50.771084 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1142/2277] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:57:50.774887 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b4563-e50e-4071-9a14-8a2aa512dba4 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:50.786101 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b4563-e50e-4071-9a14-8a2aa512dba4 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:50.790847 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0eba6-f36d-4388-996a-1bf5bc792f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:50.791490 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0eba6-f36d-4388-996a-1bf5bc792f3b admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:50.791773 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0eba6-f36d-4388-996a-1bf5bc792f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:50.792668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0eba6-f36d-4388-996a-1bf5bc792f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:50.793382 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0eba6-f36d-4388-996a-1bf5bc792f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:50.795041 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0eba6-f36d-4388-996a-1bf5bc792f3b admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:50.796418 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:57:50.809330 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1136/2278] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:57:50.813774 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c6de2-41a5-4f3a-9fb8-49606a8ab2db admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:50.823999 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c6de2-41a5-4f3a-9fb8-49606a8ab2db admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:50.828703 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23516623-b17c-4066-996c-abd8232f99f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:50.829428 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23516623-b17c-4066-996c-abd8232f99f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:50.829757 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23516623-b17c-4066-996c-abd8232f99f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:50.830033 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23516623-b17c-4066-996c-abd8232f99f5 admin admin] PATH_INFO: `/v3/projects/bdd366edf6704c4a80530f7c11267875/users/1659a036cef847e78867f3361c51bbba/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:50.845006 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23516623-b17c-4066-996c-abd8232f99f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdd366edf6704c4a80530f7c11267875, user_id=1659a036cef847e78867f3361c51bbba, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:50.847725 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23516623-b17c-4066-996c-abd8232f99f5 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:50.861132 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1143/2279] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:57:50 2022] PUT /identity/v3/projects/bdd366edf6704c4a80530f7c11267875/users/1659a036cef847e78867f3361c51bbba/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:57:50.872051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b265a-453b-4f46-b7f8-1f4b137827e3 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:50.872603 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b265a-453b-4f46-b7f8-1f4b137827e3 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:50.872923 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b265a-453b-4f46-b7f8-1f4b137827e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:50.904750 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-f94b265a-453b-4f46-b7f8-1f4b137827e3 None None] MFA Rules not processed for user `1659a036cef847e78867f3361c51bbba`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:57:50.906018 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-f94b265a-453b-4f46-b7f8-1f4b137827e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:50.983013 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1137/2280] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:57:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:57:50.987228 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23516623-b17c-4066-996c-abd8232f99f5 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:51.055003 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23516623-b17c-4066-996c-abd8232f99f5 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:51.060462 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2f28c-9853-43de-a40d-39b1d19c8438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:51.061112 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2f28c-9853-43de-a40d-39b1d19c8438 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:51.061530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2f28c-9853-43de-a40d-39b1d19c8438 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:51.061819 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2f28c-9853-43de-a40d-39b1d19c8438 admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:51.062499 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2f28c-9853-43de-a40d-39b1d19c8438 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:51.064440 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2f28c-9853-43de-a40d-39b1d19c8438 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:51.080017 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:57:51.093779 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1144/2281] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:57:50 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:57:51.098091 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b265a-453b-4f46-b7f8-1f4b137827e3 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:51.114089 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b265a-453b-4f46-b7f8-1f4b137827e3 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:51.177175 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c85b2-39db-48f7-9b0d-ce792845e7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:51.178095 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c85b2-39db-48f7-9b0d-ce792845e7a6 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:51.178514 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c85b2-39db-48f7-9b0d-ce792845e7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:51.179012 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c85b2-39db-48f7-9b0d-ce792845e7a6 admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:51.179696 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c85b2-39db-48f7-9b0d-ce792845e7a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:51.181757 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c85b2-39db-48f7-9b0d-ce792845e7a6 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:51.207727 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1138/2282] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:57:51 2022] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:57:51.208993 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2f28c-9853-43de-a40d-39b1d19c8438 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:51.219286 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2f28c-9853-43de-a40d-39b1d19c8438 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:51.223922 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00ef9d-cc7a-4b92-bf7b-35b95908a12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:51.224530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00ef9d-cc7a-4b92-bf7b-35b95908a12c admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:51.224807 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00ef9d-cc7a-4b92-bf7b-35b95908a12c admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:51.225083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00ef9d-cc7a-4b92-bf7b-35b95908a12c admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:51.225811 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00ef9d-cc7a-4b92-bf7b-35b95908a12c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:51.227407 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00ef9d-cc7a-4b92-bf7b-35b95908a12c admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:51.238664 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1145/2283] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:57:51.243167 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c85b2-39db-48f7-9b0d-ce792845e7a6 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:51.254455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c85b2-39db-48f7-9b0d-ce792845e7a6 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:51.259783 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141250a-1ab3-4779-96c0-730e43e9aa31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:51.260626 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141250a-1ab3-4779-96c0-730e43e9aa31 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:51.261073 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141250a-1ab3-4779-96c0-730e43e9aa31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:51.261173 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141250a-1ab3-4779-96c0-730e43e9aa31 admin admin] PATH_INFO: `/v3/projects/3d4660b511074896b3bb7a63db4e18fb/users/7b11760c2a2045699f61818695f1d5f9/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:51.282301 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f141250a-1ab3-4779-96c0-730e43e9aa31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d4660b511074896b3bb7a63db4e18fb, user_id=7b11760c2a2045699f61818695f1d5f9, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:51.285403 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f141250a-1ab3-4779-96c0-730e43e9aa31 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:51.299373 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1139/2284] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:57:51 2022] PUT /identity/v3/projects/3d4660b511074896b3bb7a63db4e18fb/users/7b11760c2a2045699f61818695f1d5f9/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:57:51.304869 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00ef9d-cc7a-4b92-bf7b-35b95908a12c admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:51.315893 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00ef9d-cc7a-4b92-bf7b-35b95908a12c admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:51.376425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03941e06-8802-4d15-a234-c668af02e8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:51.377063 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03941e06-8802-4d15-a234-c668af02e8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:51.377441 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03941e06-8802-4d15-a234-c668af02e8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:51.377758 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03941e06-8802-4d15-a234-c668af02e8f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:51.378466 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03941e06-8802-4d15-a234-c668af02e8f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:51.380434 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03941e06-8802-4d15-a234-c668af02e8f2 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:51.394390 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1146/2285] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:57:51.398547 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141250a-1ab3-4779-96c0-730e43e9aa31 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:51.409742 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141250a-1ab3-4779-96c0-730e43e9aa31 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:51.414611 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e944a148-ebe2-4222-8805-5f1fed58f559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:51.415278 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944a148-ebe2-4222-8805-5f1fed58f559 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:51.415560 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944a148-ebe2-4222-8805-5f1fed58f559 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:51.415840 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944a148-ebe2-4222-8805-5f1fed58f559 admin admin] PATH_INFO: `/v3/projects/3d4660b511074896b3bb7a63db4e18fb/users/7b11760c2a2045699f61818695f1d5f9/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:51.418429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e944a148-ebe2-4222-8805-5f1fed58f559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d4660b511074896b3bb7a63db4e18fb, user_id=7b11760c2a2045699f61818695f1d5f9, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:51.421034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e944a148-ebe2-4222-8805-5f1fed58f559 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:51.431397 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1140/2286] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:57:51 2022] PUT /identity/v3/projects/3d4660b511074896b3bb7a63db4e18fb/users/7b11760c2a2045699f61818695f1d5f9/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:57:51.442303 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57e441-8309-4092-9a0d-9cf4775c0bc4 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:51.442597 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57e441-8309-4092-9a0d-9cf4775c0bc4 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:51.442923 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57e441-8309-4092-9a0d-9cf4775c0bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:51.472680 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-cc57e441-8309-4092-9a0d-9cf4775c0bc4 None None] MFA Rules not processed for user `7b11760c2a2045699f61818695f1d5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:57:51.473955 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-cc57e441-8309-4092-9a0d-9cf4775c0bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:51.546259 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1147/2287] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:57:51 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:57:51.556899 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e944a148-ebe2-4222-8805-5f1fed58f559 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:51.558693 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-e944a148-ebe2-4222-8805-5f1fed58f559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:51.600346 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:57:51.616949 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e944a148-ebe2-4222-8805-5f1fed58f559 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:51.620686 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7b42a-76f8-4b82-9f7e-7defceac290a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:51.621291 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7b42a-76f8-4b82-9f7e-7defceac290a service cinder] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:51.621601 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7b42a-76f8-4b82-9f7e-7defceac290a service cinder] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:51.621873 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7b42a-76f8-4b82-9f7e-7defceac290a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:51.677740 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f7b42a-76f8-4b82-9f7e-7defceac290a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:51.679229 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f7b42a-76f8-4b82-9f7e-7defceac290a service cinder] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:51.688023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1141/2288] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:57:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:57:54.302117 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57e441-8309-4092-9a0d-9cf4775c0bc4 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:54.312343 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57e441-8309-4092-9a0d-9cf4775c0bc4 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:54.315909 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531be03-2c48-465c-92bb-419877db85c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:54.316519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531be03-2c48-465c-92bb-419877db85c0 service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:54.316803 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531be03-2c48-465c-92bb-419877db85c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:54.317077 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531be03-2c48-465c-92bb-419877db85c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:54.326115 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531be03-2c48-465c-92bb-419877db85c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:54.327540 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531be03-2c48-465c-92bb-419877db85c0 service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:54.336864 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1148/2289] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:57:54 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:57:59.345180 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7b42a-76f8-4b82-9f7e-7defceac290a service cinder] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:57:59.346651 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-e1f7b42a-76f8-4b82-9f7e-7defceac290a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:59.422031 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7b42a-76f8-4b82-9f7e-7defceac290a service cinder] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:57:59.427428 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2815a2cb-11f3-4679-9408-c219c0cd1e58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:57:59.428045 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815a2cb-11f3-4679-9408-c219c0cd1e58 service nova] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:57:59.428391 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815a2cb-11f3-4679-9408-c219c0cd1e58 service nova] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:57:59.428595 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815a2cb-11f3-4679-9408-c219c0cd1e58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:57:59.430549 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-2815a2cb-11f3-4679-9408-c219c0cd1e58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:57:59.446740 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2815a2cb-11f3-4679-9408-c219c0cd1e58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:57:59.448873 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2815a2cb-11f3-4679-9408-c219c0cd1e58 service nova] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:57:59.460056 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1142/2290] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:57:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:58:03.710873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531be03-2c48-465c-92bb-419877db85c0 service cinder] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:03.725146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531be03-2c48-465c-92bb-419877db85c0 service cinder] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:03.732890 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65a3dc-5a0f-4b69-8980-fd56d5ffd77b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:03.733700 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65a3dc-5a0f-4b69-8980-fd56d5ffd77b service nova] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:03.734045 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65a3dc-5a0f-4b69-8980-fd56d5ffd77b service nova] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:03.734431 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65a3dc-5a0f-4b69-8980-fd56d5ffd77b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:03.736311 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-2c65a3dc-5a0f-4b69-8980-fd56d5ffd77b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:03.750184 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65a3dc-5a0f-4b69-8980-fd56d5ffd77b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:03.752121 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65a3dc-5a0f-4b69-8980-fd56d5ffd77b service nova] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:03.764778 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1149/2291] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:58:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:58:07.219242 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2815a2cb-11f3-4679-9408-c219c0cd1e58 service nova] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:07.281600 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2815a2cb-11f3-4679-9408-c219c0cd1e58 service nova] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:07.286062 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a1692-f6cb-426d-9d68-a8d9cd21ec4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:07.286700 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a1692-f6cb-426d-9d68-a8d9cd21ec4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:07.286981 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a1692-f6cb-426d-9d68-a8d9cd21ec4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:07.287258 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a1692-f6cb-426d-9d68-a8d9cd21ec4f admin admin] PATH_INFO: `/v3/users/1659a036cef847e78867f3361c51bbba` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:07.288408 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a1692-f6cb-426d-9d68-a8d9cd21ec4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1659a036cef847e78867f3361c51bbba)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:07.290352 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a1692-f6cb-426d-9d68-a8d9cd21ec4f admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:07.311209 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:58:07.336132 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-e31a1692-f6cb-426d-9d68-a8d9cd21ec4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1659a036cef847e78867f3361c51bbba'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:07.343408 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-e31a1692-f6cb-426d-9d68-a8d9cd21ec4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1659a036cef847e78867f3361c51bbba'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:07.344000 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-e31a1692-f6cb-426d-9d68-a8d9cd21ec4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1659a036cef847e78867f3361c51bbba'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:07.344593 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-e31a1692-f6cb-426d-9d68-a8d9cd21ec4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1659a036cef847e78867f3361c51bbba'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:07.356668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-e31a1692-f6cb-426d-9d68-a8d9cd21ec4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1659a036cef847e78867f3361c51bbba'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:07.368720 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1143/2292] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:58:07 2022] DELETE /identity/v3/users/1659a036cef847e78867f3361c51bbba => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:58:07.373722 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458f654-fd17-4aeb-837a-39f1671dd766 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:07.374207 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458f654-fd17-4aeb-837a-39f1671dd766 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:07.374316 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458f654-fd17-4aeb-837a-39f1671dd766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:07.393280 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-1458f654-fd17-4aeb-837a-39f1671dd766 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:58:07.394551 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-1458f654-fd17-4aeb-837a-39f1671dd766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:07.428631 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:58:07.454159 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1150/2293] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:58:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:58:07.464914 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a1692-f6cb-426d-9d68-a8d9cd21ec4f admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:07.466392 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-e31a1692-f6cb-426d-9d68-a8d9cd21ec4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:07.523555 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a1692-f6cb-426d-9d68-a8d9cd21ec4f admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:07.527787 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ca702-68cf-4a55-adb8-e068dc71faa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:07.528411 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ca702-68cf-4a55-adb8-e068dc71faa8 service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:07.528693 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ca702-68cf-4a55-adb8-e068dc71faa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:07.528971 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ca702-68cf-4a55-adb8-e068dc71faa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:07.537952 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ca702-68cf-4a55-adb8-e068dc71faa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:07.539408 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ca702-68cf-4a55-adb8-e068dc71faa8 service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:07.549920 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1144/2294] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:58:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:58:07.817784 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458f654-fd17-4aeb-837a-39f1671dd766 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:07.819255 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-1458f654-fd17-4aeb-837a-39f1671dd766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:07.832509 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458f654-fd17-4aeb-837a-39f1671dd766 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:07.837676 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344bcefa-4828-4cd6-bc24-86b46f9038ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:07.838448 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bcefa-4828-4cd6-bc24-86b46f9038ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:07.838830 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bcefa-4828-4cd6-bc24-86b46f9038ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:07.839112 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bcefa-4828-4cd6-bc24-86b46f9038ab admin admin] PATH_INFO: `/v3/projects/bdd366edf6704c4a80530f7c11267875` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:07.840311 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344bcefa-4828-4cd6-bc24-86b46f9038ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdd366edf6704c4a80530f7c11267875)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:07.842377 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344bcefa-4828-4cd6-bc24-86b46f9038ab admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:07.892340 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-344bcefa-4828-4cd6-bc24-86b46f9038ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdd366edf6704c4a80530f7c11267875', 'request_id': 'req-344bcefa-4828-4cd6-bc24-86b46f9038ab'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:07.899217 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-344bcefa-4828-4cd6-bc24-86b46f9038ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdd366edf6704c4a80530f7c11267875', 'request_id': 'req-344bcefa-4828-4cd6-bc24-86b46f9038ab'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:07.906434 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-344bcefa-4828-4cd6-bc24-86b46f9038ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdd366edf6704c4a80530f7c11267875', 'request_id': 'req-344bcefa-4828-4cd6-bc24-86b46f9038ab'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:07.917328 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-344bcefa-4828-4cd6-bc24-86b46f9038ab admin admin] The token cache is being invalidate because project bdd366edf6704c4a80530f7c11267875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:58:07.917676 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-344bcefa-4828-4cd6-bc24-86b46f9038ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:07.918379 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-344bcefa-4828-4cd6-bc24-86b46f9038ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:07.919893 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1151/2295] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:58:07 2022] DELETE /identity/v3/projects/bdd366edf6704c4a80530f7c11267875 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:58:07.923913 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ca702-68cf-4a55-adb8-e068dc71faa8 service neutron] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:07.934599 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ca702-68cf-4a55-adb8-e068dc71faa8 service neutron] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:07.990807 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689c19a-08ea-4304-9bb9-ec5fb71c68d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:07.991436 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689c19a-08ea-4304-9bb9-ec5fb71c68d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:07.991720 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689c19a-08ea-4304-9bb9-ec5fb71c68d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:07.991995 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689c19a-08ea-4304-9bb9-ec5fb71c68d6 admin admin] PATH_INFO: `/v3/users/7b11760c2a2045699f61818695f1d5f9` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:07.993129 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689c19a-08ea-4304-9bb9-ec5fb71c68d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b11760c2a2045699f61818695f1d5f9)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:07.995135 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689c19a-08ea-4304-9bb9-ec5fb71c68d6 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:08.036694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:58:08.042968 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-9689c19a-08ea-4304-9bb9-ec5fb71c68d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b11760c2a2045699f61818695f1d5f9'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:08.050171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-9689c19a-08ea-4304-9bb9-ec5fb71c68d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b11760c2a2045699f61818695f1d5f9'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:08.050790 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-9689c19a-08ea-4304-9bb9-ec5fb71c68d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b11760c2a2045699f61818695f1d5f9'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:08.051393 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-9689c19a-08ea-4304-9bb9-ec5fb71c68d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b11760c2a2045699f61818695f1d5f9'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:08.063339 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-9689c19a-08ea-4304-9bb9-ec5fb71c68d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b11760c2a2045699f61818695f1d5f9'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:08.075330 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1145/2296] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:58:07 2022] DELETE /identity/v3/users/7b11760c2a2045699f61818695f1d5f9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:58:08.566195 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344bcefa-4828-4cd6-bc24-86b46f9038ab admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:08.567723 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-344bcefa-4828-4cd6-bc24-86b46f9038ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:08.581711 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344bcefa-4828-4cd6-bc24-86b46f9038ab admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:08.644582 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c3ec0-820e-49e1-90f0-fde4ba09e2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:08.645357 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c3ec0-820e-49e1-90f0-fde4ba09e2c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:08.645671 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c3ec0-820e-49e1-90f0-fde4ba09e2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:08.645947 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c3ec0-820e-49e1-90f0-fde4ba09e2c7 admin admin] PATH_INFO: `/v3/projects/3d4660b511074896b3bb7a63db4e18fb` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:08.647187 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c3ec0-820e-49e1-90f0-fde4ba09e2c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d4660b511074896b3bb7a63db4e18fb)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:08.649091 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c3ec0-820e-49e1-90f0-fde4ba09e2c7 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:08.709888 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-074c3ec0-820e-49e1-90f0-fde4ba09e2c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d4660b511074896b3bb7a63db4e18fb', 'request_id': 'req-074c3ec0-820e-49e1-90f0-fde4ba09e2c7'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:08.720714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-074c3ec0-820e-49e1-90f0-fde4ba09e2c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d4660b511074896b3bb7a63db4e18fb', 'request_id': 'req-074c3ec0-820e-49e1-90f0-fde4ba09e2c7'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:08.733217 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-074c3ec0-820e-49e1-90f0-fde4ba09e2c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d4660b511074896b3bb7a63db4e18fb', 'request_id': 'req-074c3ec0-820e-49e1-90f0-fde4ba09e2c7'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:08.737608 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:58:08.747481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-074c3ec0-820e-49e1-90f0-fde4ba09e2c7 admin admin] The token cache is being invalidate because project 3d4660b511074896b3bb7a63db4e18fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:58:08.748112 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-074c3ec0-820e-49e1-90f0-fde4ba09e2c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:08.748976 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-074c3ec0-820e-49e1-90f0-fde4ba09e2c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:08.750771 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1152/2297] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:58:08 2022] DELETE /identity/v3/projects/3d4660b511074896b3bb7a63db4e18fb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:58:08.756083 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0caf55-8c16-4131-8c5d-5d8d70c6d891 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:08.756558 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0caf55-8c16-4131-8c5d-5d8d70c6d891 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:08.756814 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0caf55-8c16-4131-8c5d-5d8d70c6d891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:08.779643 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-ae0caf55-8c16-4131-8c5d-5d8d70c6d891 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:58:08.781103 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-ae0caf55-8c16-4131-8c5d-5d8d70c6d891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:08.848598 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1146/2298] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:58:08.856543 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff42b0-c162-40df-8d55-0c3f6598994c None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:08.856837 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff42b0-c162-40df-8d55-0c3f6598994c None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:08.857121 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff42b0-c162-40df-8d55-0c3f6598994c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:08.878500 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-6bff42b0-c162-40df-8d55-0c3f6598994c None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:58:08.879714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-6bff42b0-c162-40df-8d55-0c3f6598994c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:08.889935 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1153/2299] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:58:08.894748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0caf55-8c16-4131-8c5d-5d8d70c6d891 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:08.905215 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0caf55-8c16-4131-8c5d-5d8d70c6d891 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:08.910155 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bbeb4-a923-4ae4-96d1-eaa978e3593a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:08.910878 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bbeb4-a923-4ae4-96d1-eaa978e3593a admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:08.911220 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bbeb4-a923-4ae4-96d1-eaa978e3593a admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:08.911500 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bbeb4-a923-4ae4-96d1-eaa978e3593a admin admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:08.912202 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853bbeb4-a923-4ae4-96d1-eaa978e3593a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:58:08.912506 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853bbeb4-a923-4ae4-96d1-eaa978e3593a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:08.914166 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853bbeb4-a923-4ae4-96d1-eaa978e3593a admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:08.928678 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1147/2300] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:58:08.933867 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff42b0-c162-40df-8d55-0c3f6598994c None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:08.943233 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff42b0-c162-40df-8d55-0c3f6598994c None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:08.948610 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c396d3e-e782-4543-b534-265e3ac0b301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:08.949963 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c396d3e-e782-4543-b534-265e3ac0b301 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:08.950191 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c396d3e-e782-4543-b534-265e3ac0b301 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:08.950465 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c396d3e-e782-4543-b534-265e3ac0b301 admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:08.951136 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c396d3e-e782-4543-b534-265e3ac0b301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:08.953048 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c396d3e-e782-4543-b534-265e3ac0b301 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:08.979776 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1154/2301] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:58:08 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:58:08.984100 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bbeb4-a923-4ae4-96d1-eaa978e3593a admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:08.994055 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bbeb4-a923-4ae4-96d1-eaa978e3593a admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:09.064826 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f0cfb-5f56-4ac0-9b8e-cd2eefa09089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:09.065474 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f0cfb-5f56-4ac0-9b8e-cd2eefa09089 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:09.065788 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f0cfb-5f56-4ac0-9b8e-cd2eefa09089 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:09.066084 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f0cfb-5f56-4ac0-9b8e-cd2eefa09089 admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:09.066726 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f0cfb-5f56-4ac0-9b8e-cd2eefa09089 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:09.068669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f0cfb-5f56-4ac0-9b8e-cd2eefa09089 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:09.092552 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1148/2302] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:58:08 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:58:09.097841 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c396d3e-e782-4543-b534-265e3ac0b301 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:09.116483 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c396d3e-e782-4543-b534-265e3ac0b301 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:09.123947 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfacbbbc-3f67-420f-8dcb-6110fd9b5b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:09.124698 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacbbbc-3f67-420f-8dcb-6110fd9b5b27 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:09.125126 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacbbbc-3f67-420f-8dcb-6110fd9b5b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:09.125656 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacbbbc-3f67-420f-8dcb-6110fd9b5b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:09.126783 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfacbbbc-3f67-420f-8dcb-6110fd9b5b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:09.129696 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfacbbbc-3f67-420f-8dcb-6110fd9b5b27 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:09.144550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1155/2303] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:58:09.148581 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f0cfb-5f56-4ac0-9b8e-cd2eefa09089 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:09.159325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f0cfb-5f56-4ac0-9b8e-cd2eefa09089 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:09.164159 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27f797-7fc8-405e-b817-9d91105081df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:09.164840 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27f797-7fc8-405e-b817-9d91105081df admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:09.165180 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27f797-7fc8-405e-b817-9d91105081df admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:09.165543 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27f797-7fc8-405e-b817-9d91105081df admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:09.166314 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27f797-7fc8-405e-b817-9d91105081df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:09.168597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27f797-7fc8-405e-b817-9d91105081df admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:09.184707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1149/2304] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:58:09.185986 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfacbbbc-3f67-420f-8dcb-6110fd9b5b27 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:09.196939 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfacbbbc-3f67-420f-8dcb-6110fd9b5b27 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:09.202419 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc000e-2a8f-4fbb-998b-66fa234e6a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:09.203026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc000e-2a8f-4fbb-998b-66fa234e6a84 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:09.203306 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc000e-2a8f-4fbb-998b-66fa234e6a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:09.203582 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc000e-2a8f-4fbb-998b-66fa234e6a84 admin admin] PATH_INFO: `/v3/projects/50f73f78e6674f619de733fd08699d9d/users/78614688b47641b1abf996f927051db2/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:09.219681 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc000e-2a8f-4fbb-998b-66fa234e6a84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50f73f78e6674f619de733fd08699d9d, user_id=78614688b47641b1abf996f927051db2, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:09.222499 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc000e-2a8f-4fbb-998b-66fa234e6a84 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:09.236372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1156/2305] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:58:09 2022] PUT /identity/v3/projects/50f73f78e6674f619de733fd08699d9d/users/78614688b47641b1abf996f927051db2/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:58:09.249076 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024546b-2300-4964-88e3-b9a57244c418 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:09.249346 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024546b-2300-4964-88e3-b9a57244c418 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:09.249661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024546b-2300-4964-88e3-b9a57244c418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:09.281865 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-d024546b-2300-4964-88e3-b9a57244c418 None None] MFA Rules not processed for user `78614688b47641b1abf996f927051db2`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:58:09.283240 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-d024546b-2300-4964-88e3-b9a57244c418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:09.296211 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:58:09.355114 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1150/2306] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:58:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:58:09.359425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc000e-2a8f-4fbb-998b-66fa234e6a84 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:09.420237 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc000e-2a8f-4fbb-998b-66fa234e6a84 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:09.425065 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20085a33-c9d3-4656-ad6c-df546ec50538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:09.425740 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20085a33-c9d3-4656-ad6c-df546ec50538 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:09.426030 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20085a33-c9d3-4656-ad6c-df546ec50538 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:09.426306 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20085a33-c9d3-4656-ad6c-df546ec50538 admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:09.426981 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20085a33-c9d3-4656-ad6c-df546ec50538 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:09.428893 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20085a33-c9d3-4656-ad6c-df546ec50538 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:09.455179 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1157/2307] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:58:09 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:58:09.459187 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024546b-2300-4964-88e3-b9a57244c418 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:09.470908 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024546b-2300-4964-88e3-b9a57244c418 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:09.536204 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd287c47-c80f-4879-9f71-897ba33b61c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:09.536855 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd287c47-c80f-4879-9f71-897ba33b61c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:09.537137 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd287c47-c80f-4879-9f71-897ba33b61c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:09.537412 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd287c47-c80f-4879-9f71-897ba33b61c1 admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:09.538118 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd287c47-c80f-4879-9f71-897ba33b61c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:09.540037 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd287c47-c80f-4879-9f71-897ba33b61c1 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:09.555566 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646a8c6-b3a9-4eb5-a632-c3d8e576829c None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:09.555863 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646a8c6-b3a9-4eb5-a632-c3d8e576829c None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:09.556155 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646a8c6-b3a9-4eb5-a632-c3d8e576829c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:09.563588 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1151/2308] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:58:09 2022] POST /identity/v3/users => generated 298 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:58:09.567540 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd287c47-c80f-4879-9f71-897ba33b61c1 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:09.576165 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-1646a8c6-b3a9-4eb5-a632-c3d8e576829c None None] MFA Rules not processed for user `a994c976b95744ed9723bf9c4386bde1`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:58:09.577438 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd287c47-c80f-4879-9f71-897ba33b61c1 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:09.577758 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-1646a8c6-b3a9-4eb5-a632-c3d8e576829c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:09.582093 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d719d5-1d1c-462f-8c90-29c1bce72fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:09.582699 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d719d5-1d1c-462f-8c90-29c1bce72fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:09.582984 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d719d5-1d1c-462f-8c90-29c1bce72fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:09.583260 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d719d5-1d1c-462f-8c90-29c1bce72fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:09.583959 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d719d5-1d1c-462f-8c90-29c1bce72fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:09.585558 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d719d5-1d1c-462f-8c90-29c1bce72fb3 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:09.596066 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1152/2309] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:58:09.600184 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d719d5-1d1c-462f-8c90-29c1bce72fb3 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:09.610436 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d719d5-1d1c-462f-8c90-29c1bce72fb3 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:09.615099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595fea6-ab72-4319-a8a9-b973d33f73e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:09.615744 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595fea6-ab72-4319-a8a9-b973d33f73e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:09.616023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595fea6-ab72-4319-a8a9-b973d33f73e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:09.616300 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595fea6-ab72-4319-a8a9-b973d33f73e9 admin admin] PATH_INFO: `/v3/projects/3517e2f5f1d342b98fa62dd469a35632/users/d7222004403e4f02a2c29f3d92b97c21/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:09.631527 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595fea6-ab72-4319-a8a9-b973d33f73e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3517e2f5f1d342b98fa62dd469a35632, user_id=d7222004403e4f02a2c29f3d92b97c21, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:09.634337 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595fea6-ab72-4319-a8a9-b973d33f73e9 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:09.636111 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1158/2310] 10.222.0.46 () {58 vars in 967 bytes} [Wed Aug 3 12:58:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:58:09.648506 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1153/2311] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:58:09 2022] PUT /identity/v3/projects/3517e2f5f1d342b98fa62dd469a35632/users/d7222004403e4f02a2c29f3d92b97c21/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:58:09.653042 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1646a8c6-b3a9-4eb5-a632-c3d8e576829c None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:09.664704 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1646a8c6-b3a9-4eb5-a632-c3d8e576829c None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:09.682484 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:58:09.687496 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595fea6-ab72-4319-a8a9-b973d33f73e9 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:09.689559 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-b595fea6-ab72-4319-a8a9-b973d33f73e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:09.725998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f142f01-e616-4927-8548-45c0d091e4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:09.726546 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f142f01-e616-4927-8548-45c0d091e4cb admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:09.726825 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f142f01-e616-4927-8548-45c0d091e4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:09.727099 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f142f01-e616-4927-8548-45c0d091e4cb admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:09.727794 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f142f01-e616-4927-8548-45c0d091e4cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:09.730150 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f142f01-e616-4927-8548-45c0d091e4cb admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:09.743673 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1159/2312] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:58:09.744725 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f142f01-e616-4927-8548-45c0d091e4cb admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:09.754404 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f142f01-e616-4927-8548-45c0d091e4cb admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:09.759194 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4158e-45f4-49e8-8132-0a5f904bde45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:09.759829 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4158e-45f4-49e8-8132-0a5f904bde45 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:09.760110 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4158e-45f4-49e8-8132-0a5f904bde45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:09.760440 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4158e-45f4-49e8-8132-0a5f904bde45 admin admin] PATH_INFO: `/v3/projects/3517e2f5f1d342b98fa62dd469a35632/users/d7222004403e4f02a2c29f3d92b97c21/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:09.762606 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4158e-45f4-49e8-8132-0a5f904bde45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3517e2f5f1d342b98fa62dd469a35632, user_id=d7222004403e4f02a2c29f3d92b97c21, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:09.765467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4158e-45f4-49e8-8132-0a5f904bde45 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:09.765859 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595fea6-ab72-4319-a8a9-b973d33f73e9 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:09.771016 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3cbaa6-0bb7-464f-8194-68e5fe158ac7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67df369737ea4c83bae134f4bf2de20d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:09.771635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cbaa6-0bb7-464f-8194-68e5fe158ac7 service swift] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:09.771920 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cbaa6-0bb7-464f-8194-68e5fe158ac7 service swift] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:09.772197 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cbaa6-0bb7-464f-8194-68e5fe158ac7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:09.775783 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1160/2313] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:58:09 2022] PUT /identity/v3/projects/3517e2f5f1d342b98fa62dd469a35632/users/d7222004403e4f02a2c29f3d92b97c21/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:58:09.781334 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:58:09.787000 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3519d-c5c9-4144-8347-e552bec9700a None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:09.787293 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3519d-c5c9-4144-8347-e552bec9700a None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:09.787721 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3519d-c5c9-4144-8347-e552bec9700a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:09.816608 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-fec3519d-c5c9-4144-8347-e552bec9700a None None] MFA Rules not processed for user `d7222004403e4f02a2c29f3d92b97c21`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:58:09.818153 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-fec3519d-c5c9-4144-8347-e552bec9700a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:09.831627 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3cbaa6-0bb7-464f-8194-68e5fe158ac7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:09.833221 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3cbaa6-0bb7-464f-8194-68e5fe158ac7 service swift] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:09.842601 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1154/2314] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Aug 3 12:58:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 03 12:58:09.894026 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1161/2315] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:58:09 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:58:09.905021 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3cbaa6-0bb7-464f-8194-68e5fe158ac7 service swift] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:09.906726 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-ca3cbaa6-0bb7-464f-8194-68e5fe158ac7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:09.967379 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3cbaa6-0bb7-464f-8194-68e5fe158ac7 service swift] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:10.019872 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b28453-71a1-42bd-ba1b-be7a796f3ab7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:10.020489 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b28453-71a1-42bd-ba1b-be7a796f3ab7 service cinder] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:10.020766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b28453-71a1-42bd-ba1b-be7a796f3ab7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:10.021037 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b28453-71a1-42bd-ba1b-be7a796f3ab7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:10.032774 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b28453-71a1-42bd-ba1b-be7a796f3ab7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:10.034286 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b28453-71a1-42bd-ba1b-be7a796f3ab7 service cinder] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:10.045080 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1155/2316] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:58:09 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:58:10.151699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3519d-c5c9-4144-8347-e552bec9700a None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:10.161537 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3519d-c5c9-4144-8347-e552bec9700a None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:10.165113 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee24461-81e5-4cda-987f-69cc56387175 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:10.165757 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee24461-81e5-4cda-987f-69cc56387175 service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:10.166042 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee24461-81e5-4cda-987f-69cc56387175 service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:10.166318 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee24461-81e5-4cda-987f-69cc56387175 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:10.228403 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee24461-81e5-4cda-987f-69cc56387175 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:10.229987 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee24461-81e5-4cda-987f-69cc56387175 service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:10.240548 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1162/2317] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:58:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:58:12.858848 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b28453-71a1-42bd-ba1b-be7a796f3ab7 service cinder] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:12.926413 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b28453-71a1-42bd-ba1b-be7a796f3ab7 service cinder] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:12.930861 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243ab68-ce10-464a-94c3-a0055567f494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:12.931502 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243ab68-ce10-464a-94c3-a0055567f494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:12.931777 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243ab68-ce10-464a-94c3-a0055567f494 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:12.932050 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243ab68-ce10-464a-94c3-a0055567f494 admin admin] PATH_INFO: `/v3/users/78614688b47641b1abf996f927051db2` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:12.933613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8243ab68-ce10-464a-94c3-a0055567f494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78614688b47641b1abf996f927051db2)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:12.935542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8243ab68-ce10-464a-94c3-a0055567f494 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:12.946610 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:58:13.004730 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-8243ab68-ce10-464a-94c3-a0055567f494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78614688b47641b1abf996f927051db2'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:13.022288 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-8243ab68-ce10-464a-94c3-a0055567f494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78614688b47641b1abf996f927051db2'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:13.022951 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-8243ab68-ce10-464a-94c3-a0055567f494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78614688b47641b1abf996f927051db2'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:13.024265 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-8243ab68-ce10-464a-94c3-a0055567f494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78614688b47641b1abf996f927051db2'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:13.038558 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-8243ab68-ce10-464a-94c3-a0055567f494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78614688b47641b1abf996f927051db2'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:13.052148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1156/2318] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:58:12 2022] DELETE /identity/v3/users/78614688b47641b1abf996f927051db2 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:58:13.056613 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1a71a-d3c3-454e-91bf-484efb3e45f5 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:13.057192 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1a71a-d3c3-454e-91bf-484efb3e45f5 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:13.057293 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1a71a-d3c3-454e-91bf-484efb3e45f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:13.078344 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-c7d1a71a-d3c3-454e-91bf-484efb3e45f5 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:58:13.079303 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-c7d1a71a-d3c3-454e-91bf-484efb3e45f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:13.084212 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243ab68-ce10-464a-94c3-a0055567f494 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:13.084929 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-8243ab68-ce10-464a-94c3-a0055567f494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:13.123242 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:58:13.195596 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243ab68-ce10-464a-94c3-a0055567f494 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:13.202229 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1163/2319] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:58:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:58:13.207170 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c5518-772d-4d34-aea4-fec22e6cfb84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56847173abb48d39c0ee6fb9cdbbbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:13.207448 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c5518-772d-4d34-aea4-fec22e6cfb84 service placement] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:13.208014 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c5518-772d-4d34-aea4-fec22e6cfb84 service placement] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:13.208179 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c5518-772d-4d34-aea4-fec22e6cfb84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:13.210461 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-ba9c5518-772d-4d34-aea4-fec22e6cfb84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:13.212545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1a71a-d3c3-454e-91bf-484efb3e45f5 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:13.214759 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-c7d1a71a-d3c3-454e-91bf-484efb3e45f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:13.225314 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c5518-772d-4d34-aea4-fec22e6cfb84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:13.227372 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c5518-772d-4d34-aea4-fec22e6cfb84 service placement] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:13.240466 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1157/2320] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:58:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:58:13.322070 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1a71a-d3c3-454e-91bf-484efb3e45f5 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:13.326510 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67562e8-e9fd-46dc-ad45-301b0e23b538 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:13.327171 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67562e8-e9fd-46dc-ad45-301b0e23b538 service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:13.327452 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67562e8-e9fd-46dc-ad45-301b0e23b538 service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:13.327725 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67562e8-e9fd-46dc-ad45-301b0e23b538 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:13.339688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67562e8-e9fd-46dc-ad45-301b0e23b538 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:13.341559 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67562e8-e9fd-46dc-ad45-301b0e23b538 service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:13.364446 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1164/2321] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:58:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:58:13.649746 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c5518-772d-4d34-aea4-fec22e6cfb84 service placement] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:13.651283 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-ba9c5518-772d-4d34-aea4-fec22e6cfb84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:13.665262 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c5518-772d-4d34-aea4-fec22e6cfb84 service placement] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:13.672390 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0c5bf-0725-4da8-bef2-e488eebd0f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:13.673459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0c5bf-0725-4da8-bef2-e488eebd0f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:13.673459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0c5bf-0725-4da8-bef2-e488eebd0f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:13.673855 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0c5bf-0725-4da8-bef2-e488eebd0f62 admin admin] PATH_INFO: `/v3/projects/50f73f78e6674f619de733fd08699d9d` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:13.674997 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af0c5bf-0725-4da8-bef2-e488eebd0f62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50f73f78e6674f619de733fd08699d9d)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:13.677235 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af0c5bf-0725-4da8-bef2-e488eebd0f62 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:13.730344 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-1af0c5bf-0725-4da8-bef2-e488eebd0f62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50f73f78e6674f619de733fd08699d9d', 'request_id': 'req-1af0c5bf-0725-4da8-bef2-e488eebd0f62'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:13.737900 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-1af0c5bf-0725-4da8-bef2-e488eebd0f62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50f73f78e6674f619de733fd08699d9d', 'request_id': 'req-1af0c5bf-0725-4da8-bef2-e488eebd0f62'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:13.744202 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-1af0c5bf-0725-4da8-bef2-e488eebd0f62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50f73f78e6674f619de733fd08699d9d', 'request_id': 'req-1af0c5bf-0725-4da8-bef2-e488eebd0f62'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:13.753971 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:58:13.758156 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-1af0c5bf-0725-4da8-bef2-e488eebd0f62 admin admin] The token cache is being invalidate because project 50f73f78e6674f619de733fd08699d9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:58:13.758623 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-1af0c5bf-0725-4da8-bef2-e488eebd0f62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:13.759736 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-1af0c5bf-0725-4da8-bef2-e488eebd0f62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:13.761924 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1158/2322] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:58:13 2022] DELETE /identity/v3/projects/50f73f78e6674f619de733fd08699d9d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:58:13.765912 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67562e8-e9fd-46dc-ad45-301b0e23b538 service neutron] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:13.776992 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67562e8-e9fd-46dc-ad45-301b0e23b538 service neutron] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:13.835221 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612f763-91ee-48bf-b8b0-058ff7038fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:13.835877 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612f763-91ee-48bf-b8b0-058ff7038fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:13.836162 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612f763-91ee-48bf-b8b0-058ff7038fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:13.836446 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612f763-91ee-48bf-b8b0-058ff7038fd4 admin admin] PATH_INFO: `/v3/users/d7222004403e4f02a2c29f3d92b97c21` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:13.837734 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612f763-91ee-48bf-b8b0-058ff7038fd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7222004403e4f02a2c29f3d92b97c21)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:13.839804 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612f763-91ee-48bf-b8b0-058ff7038fd4 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:13.889910 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-2612f763-91ee-48bf-b8b0-058ff7038fd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7222004403e4f02a2c29f3d92b97c21'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:13.890571 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-2612f763-91ee-48bf-b8b0-058ff7038fd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7222004403e4f02a2c29f3d92b97c21'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:13.891183 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-2612f763-91ee-48bf-b8b0-058ff7038fd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7222004403e4f02a2c29f3d92b97c21'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:13.903513 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-2612f763-91ee-48bf-b8b0-058ff7038fd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7222004403e4f02a2c29f3d92b97c21'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:13.909186 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:58:13.911355 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-2612f763-91ee-48bf-b8b0-058ff7038fd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7222004403e4f02a2c29f3d92b97c21'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:13.929761 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1165/2323] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:58:13 2022] DELETE /identity/v3/users/d7222004403e4f02a2c29f3d92b97c21 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:58:14.467800 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0c5bf-0725-4da8-bef2-e488eebd0f62 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:14.469632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-1af0c5bf-0725-4da8-bef2-e488eebd0f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:14.483671 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0c5bf-0725-4da8-bef2-e488eebd0f62 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:14.547383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912e71f-9331-4d08-b08b-c95ba03ab099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:14.548033 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912e71f-9331-4d08-b08b-c95ba03ab099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:14.548312 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912e71f-9331-4d08-b08b-c95ba03ab099 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:14.548587 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912e71f-9331-4d08-b08b-c95ba03ab099 admin admin] PATH_INFO: `/v3/projects/3517e2f5f1d342b98fa62dd469a35632` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:14.549768 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912e71f-9331-4d08-b08b-c95ba03ab099 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3517e2f5f1d342b98fa62dd469a35632)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:14.551679 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912e71f-9331-4d08-b08b-c95ba03ab099 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:14.600053 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-2912e71f-9331-4d08-b08b-c95ba03ab099 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3517e2f5f1d342b98fa62dd469a35632', 'request_id': 'req-2912e71f-9331-4d08-b08b-c95ba03ab099'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:14.606750 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-2912e71f-9331-4d08-b08b-c95ba03ab099 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3517e2f5f1d342b98fa62dd469a35632', 'request_id': 'req-2912e71f-9331-4d08-b08b-c95ba03ab099'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:14.612605 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-2912e71f-9331-4d08-b08b-c95ba03ab099 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3517e2f5f1d342b98fa62dd469a35632', 'request_id': 'req-2912e71f-9331-4d08-b08b-c95ba03ab099'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:14.626503 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-2912e71f-9331-4d08-b08b-c95ba03ab099 admin admin] The token cache is being invalidate because project 3517e2f5f1d342b98fa62dd469a35632 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:58:14.626992 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-2912e71f-9331-4d08-b08b-c95ba03ab099 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:14.627664 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-2912e71f-9331-4d08-b08b-c95ba03ab099 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:14.629229 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1159/2324] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:58:14 2022] DELETE /identity/v3/projects/3517e2f5f1d342b98fa62dd469a35632 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:58:14.634617 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1ce00-8886-49e1-8104-69e68ee5e3de None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:14.635088 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1ce00-8886-49e1-8104-69e68ee5e3de None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:14.635389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1ce00-8886-49e1-8104-69e68ee5e3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:14.656378 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-fff1ce00-8886-49e1-8104-69e68ee5e3de None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:58:14.657715 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-fff1ce00-8886-49e1-8104-69e68ee5e3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:14.728397 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1166/2325] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:58:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:58:14.738196 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820017aa-5e72-4725-b2ab-b12293426b87 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:14.739016 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820017aa-5e72-4725-b2ab-b12293426b87 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:14.739304 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820017aa-5e72-4725-b2ab-b12293426b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:14.762238 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-820017aa-5e72-4725-b2ab-b12293426b87 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:58:14.763485 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-820017aa-5e72-4725-b2ab-b12293426b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:14.772914 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1160/2326] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:58:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:58:14.777971 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1ce00-8886-49e1-8104-69e68ee5e3de None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:14.788141 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1ce00-8886-49e1-8104-69e68ee5e3de None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:14.793322 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa01da-8a4f-49cf-9dba-679bc982f3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:14.793980 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa01da-8a4f-49cf-9dba-679bc982f3cf admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:14.794259 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa01da-8a4f-49cf-9dba-679bc982f3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:14.794530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa01da-8a4f-49cf-9dba-679bc982f3cf admin admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:14.795234 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa01da-8a4f-49cf-9dba-679bc982f3cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:58:14.795964 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa01da-8a4f-49cf-9dba-679bc982f3cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:14.797291 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa01da-8a4f-49cf-9dba-679bc982f3cf admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:14.811962 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1167/2327] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:58:14.815955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820017aa-5e72-4725-b2ab-b12293426b87 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:14.825943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820017aa-5e72-4725-b2ab-b12293426b87 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:14.831248 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db208c-4fca-4040-bb1f-05b3f05220bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:14.831876 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db208c-4fca-4040-bb1f-05b3f05220bd admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:14.832158 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db208c-4fca-4040-bb1f-05b3f05220bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:14.832433 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db208c-4fca-4040-bb1f-05b3f05220bd admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:14.833248 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db208c-4fca-4040-bb1f-05b3f05220bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:14.835215 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db208c-4fca-4040-bb1f-05b3f05220bd admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:14.866513 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1161/2328] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:58:14 2022] POST /identity/v3/projects => generated 407 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:58:14.870734 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa01da-8a4f-49cf-9dba-679bc982f3cf admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:14.881863 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa01da-8a4f-49cf-9dba-679bc982f3cf admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:14.960041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd7e72-286b-42e3-90cb-7788b90d06ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:14.961411 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd7e72-286b-42e3-90cb-7788b90d06ae admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:14.961913 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd7e72-286b-42e3-90cb-7788b90d06ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:14.962345 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd7e72-286b-42e3-90cb-7788b90d06ae admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:14.964532 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd7e72-286b-42e3-90cb-7788b90d06ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:14.967840 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd7e72-286b-42e3-90cb-7788b90d06ae admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:14.996968 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1168/2329] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:58:14 2022] POST /identity/v3/users => generated 304 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:58:14.999155 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db208c-4fca-4040-bb1f-05b3f05220bd admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:15.010142 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db208c-4fca-4040-bb1f-05b3f05220bd admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:15.015534 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a3203-bb2e-4562-a27a-dceb3c1f9318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:15.016410 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a3203-bb2e-4562-a27a-dceb3c1f9318 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:15.016758 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a3203-bb2e-4562-a27a-dceb3c1f9318 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:15.017102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a3203-bb2e-4562-a27a-dceb3c1f9318 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:15.017958 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8a3203-bb2e-4562-a27a-dceb3c1f9318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:15.019630 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8a3203-bb2e-4562-a27a-dceb3c1f9318 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:15.035810 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1162/2330] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:58:15.038988 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd7e72-286b-42e3-90cb-7788b90d06ae admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:15.050333 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd7e72-286b-42e3-90cb-7788b90d06ae admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:15.055246 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b8fd3-dd57-4d59-92f4-8b149d88e776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:15.055865 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b8fd3-dd57-4d59-92f4-8b149d88e776 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:15.056147 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b8fd3-dd57-4d59-92f4-8b149d88e776 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:15.056421 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b8fd3-dd57-4d59-92f4-8b149d88e776 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:15.057164 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b8fd3-dd57-4d59-92f4-8b149d88e776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:15.058851 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b8fd3-dd57-4d59-92f4-8b149d88e776 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:15.071970 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1169/2331] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:58:15.076569 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a3203-bb2e-4562-a27a-dceb3c1f9318 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:15.088526 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a3203-bb2e-4562-a27a-dceb3c1f9318 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:15.094027 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772fd5dd-34a8-4b7c-86ba-c1ec73a0fc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:15.094818 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fd5dd-34a8-4b7c-86ba-c1ec73a0fc55 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:15.095200 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fd5dd-34a8-4b7c-86ba-c1ec73a0fc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:15.095600 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fd5dd-34a8-4b7c-86ba-c1ec73a0fc55 admin admin] PATH_INFO: `/v3/projects/8c660cd0e60b4c6384280b89f44fc66f/users/2c5584e96c32474cbd7471c52ce213c0/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:15.114027 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772fd5dd-34a8-4b7c-86ba-c1ec73a0fc55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c660cd0e60b4c6384280b89f44fc66f, user_id=2c5584e96c32474cbd7471c52ce213c0, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:15.118427 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772fd5dd-34a8-4b7c-86ba-c1ec73a0fc55 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:15.134072 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1163/2332] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:58:15 2022] PUT /identity/v3/projects/8c660cd0e60b4c6384280b89f44fc66f/users/2c5584e96c32474cbd7471c52ce213c0/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:58:15.146821 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37d7bf-9d68-4a37-a43f-6d2bd8c5a185 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:15.146821 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37d7bf-9d68-4a37-a43f-6d2bd8c5a185 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:15.147108 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37d7bf-9d68-4a37-a43f-6d2bd8c5a185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:15.180359 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-bb37d7bf-9d68-4a37-a43f-6d2bd8c5a185 None None] MFA Rules not processed for user `2c5584e96c32474cbd7471c52ce213c0`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:58:15.181662 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-bb37d7bf-9d68-4a37-a43f-6d2bd8c5a185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:15.239634 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:58:15.268851 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1170/2333] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:58:15 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:58:15.273224 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772fd5dd-34a8-4b7c-86ba-c1ec73a0fc55 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:15.304107 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:58:15.340070 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772fd5dd-34a8-4b7c-86ba-c1ec73a0fc55 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:15.344819 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bfe7c-7e16-406a-8549-a7d2a1a5c2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:15.345417 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bfe7c-7e16-406a-8549-a7d2a1a5c2ab admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:15.345734 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bfe7c-7e16-406a-8549-a7d2a1a5c2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:15.346019 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bfe7c-7e16-406a-8549-a7d2a1a5c2ab admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:15.346696 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68bfe7c-7e16-406a-8549-a7d2a1a5c2ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:15.348610 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68bfe7c-7e16-406a-8549-a7d2a1a5c2ab admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:15.380203 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1164/2334] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:58:15 2022] POST /identity/v3/projects => generated 407 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:58:15.381717 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37d7bf-9d68-4a37-a43f-6d2bd8c5a185 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:15.393577 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37d7bf-9d68-4a37-a43f-6d2bd8c5a185 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:15.453175 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d9156-58b0-470e-a2c6-4cab19b1237d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:15.454080 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d9156-58b0-470e-a2c6-4cab19b1237d admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:15.454459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d9156-58b0-470e-a2c6-4cab19b1237d admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:15.454829 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d9156-58b0-470e-a2c6-4cab19b1237d admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:15.455611 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d9156-58b0-470e-a2c6-4cab19b1237d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:15.457682 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d9156-58b0-470e-a2c6-4cab19b1237d admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:15.484251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1171/2335] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:58:15 2022] POST /identity/v3/users => generated 310 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:58:15.485412 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bfe7c-7e16-406a-8549-a7d2a1a5c2ab admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:15.496104 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bfe7c-7e16-406a-8549-a7d2a1a5c2ab admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:15.501320 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e8377-e833-433d-ad3b-b280123a4341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:15.501971 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e8377-e833-433d-ad3b-b280123a4341 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:15.502249 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e8377-e833-433d-ad3b-b280123a4341 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:15.502521 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e8377-e833-433d-ad3b-b280123a4341 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:15.503223 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e8377-e833-433d-ad3b-b280123a4341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:15.504878 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e8377-e833-433d-ad3b-b280123a4341 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:15.520232 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1165/2336] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 12:58:15.524311 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d9156-58b0-470e-a2c6-4cab19b1237d admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:15.546742 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d9156-58b0-470e-a2c6-4cab19b1237d admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:15.560008 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb686e0-8a5a-4efa-9e42-23018785de8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:15.560961 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb686e0-8a5a-4efa-9e42-23018785de8e admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:15.561440 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb686e0-8a5a-4efa-9e42-23018785de8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:15.561975 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb686e0-8a5a-4efa-9e42-23018785de8e admin admin] PATH_INFO: `/v3/projects/fd20ce8c147842b68d74eea80bd2cd04/users/23b6b814d6e94d9ebdc157f905eda235/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:15.581581 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb686e0-8a5a-4efa-9e42-23018785de8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd20ce8c147842b68d74eea80bd2cd04, user_id=23b6b814d6e94d9ebdc157f905eda235, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:15.584222 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb686e0-8a5a-4efa-9e42-23018785de8e admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:15.603889 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1172/2337] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:58:15 2022] PUT /identity/v3/projects/fd20ce8c147842b68d74eea80bd2cd04/users/23b6b814d6e94d9ebdc157f905eda235/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:58:15.607589 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e8377-e833-433d-ad3b-b280123a4341 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:15.617781 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e8377-e833-433d-ad3b-b280123a4341 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:15.687539 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2402e36-5510-4dfe-9be0-be6416639e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:15.688167 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2402e36-5510-4dfe-9be0-be6416639e8e admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:15.688445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2402e36-5510-4dfe-9be0-be6416639e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:15.688718 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2402e36-5510-4dfe-9be0-be6416639e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:15.689526 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2402e36-5510-4dfe-9be0-be6416639e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:15.691087 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2402e36-5510-4dfe-9be0-be6416639e8e admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:15.704415 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1166/2338] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:58:15.705835 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb686e0-8a5a-4efa-9e42-23018785de8e admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:15.717606 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb686e0-8a5a-4efa-9e42-23018785de8e admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:15.723094 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafe3a9-ab80-46a1-b2ea-d3294d562432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:15.723918 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafe3a9-ab80-46a1-b2ea-d3294d562432 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:15.724334 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafe3a9-ab80-46a1-b2ea-d3294d562432 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:15.724684 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafe3a9-ab80-46a1-b2ea-d3294d562432 admin admin] PATH_INFO: `/v3/projects/fd20ce8c147842b68d74eea80bd2cd04/users/23b6b814d6e94d9ebdc157f905eda235/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:15.726814 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcafe3a9-ab80-46a1-b2ea-d3294d562432 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd20ce8c147842b68d74eea80bd2cd04, user_id=23b6b814d6e94d9ebdc157f905eda235, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:15.730565 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcafe3a9-ab80-46a1-b2ea-d3294d562432 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:15.742464 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1173/2339] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:58:15 2022] PUT /identity/v3/projects/fd20ce8c147842b68d74eea80bd2cd04/users/23b6b814d6e94d9ebdc157f905eda235/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:58:15.752684 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b06722-93b3-4306-b2fb-68bd48ca8118 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:15.753044 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b06722-93b3-4306-b2fb-68bd48ca8118 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:15.753327 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b06722-93b3-4306-b2fb-68bd48ca8118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:15.793332 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-55b06722-93b3-4306-b2fb-68bd48ca8118 None None] MFA Rules not processed for user `23b6b814d6e94d9ebdc157f905eda235`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:58:15.794735 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-55b06722-93b3-4306-b2fb-68bd48ca8118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:15.877531 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1167/2340] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:58:15 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:58:15.886661 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafe3a9-ab80-46a1-b2ea-d3294d562432 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:15.888690 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-fcafe3a9-ab80-46a1-b2ea-d3294d562432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:15.961752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafe3a9-ab80-46a1-b2ea-d3294d562432 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:15.969917 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09009589-f7fe-4b62-a013-f52da42e462a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:15.970661 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09009589-f7fe-4b62-a013-f52da42e462a service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:15.971231 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09009589-f7fe-4b62-a013-f52da42e462a service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:15.971231 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09009589-f7fe-4b62-a013-f52da42e462a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:15.987229 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09009589-f7fe-4b62-a013-f52da42e462a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:15.988898 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09009589-f7fe-4b62-a013-f52da42e462a service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:15.999993 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1174/2341] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:58:15 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:58:16.212792 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b06722-93b3-4306-b2fb-68bd48ca8118 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:16.226432 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b06722-93b3-4306-b2fb-68bd48ca8118 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:16.230710 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c1c0c-8bd1-4cc4-9607-b41d66e91d09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:16.231331 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c1c0c-8bd1-4cc4-9607-b41d66e91d09 service cinder] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:16.231610 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c1c0c-8bd1-4cc4-9607-b41d66e91d09 service cinder] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:16.231879 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c1c0c-8bd1-4cc4-9607-b41d66e91d09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:16.271836 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:58:16.325835 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c1c0c-8bd1-4cc4-9607-b41d66e91d09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:16.327372 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c1c0c-8bd1-4cc4-9607-b41d66e91d09 service cinder] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:16.343593 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1168/2342] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:58:16 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:58:16.375484 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09009589-f7fe-4b62-a013-f52da42e462a service cinder] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:16.375484 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-09009589-f7fe-4b62-a013-f52da42e462a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:16.426168 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:58:16.451425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09009589-f7fe-4b62-a013-f52da42e462a service cinder] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:16.456389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a238f-394d-404a-8430-87053cac5b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:16.457101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a238f-394d-404a-8430-87053cac5b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:16.457445 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a238f-394d-404a-8430-87053cac5b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:16.457812 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a238f-394d-404a-8430-87053cac5b29 admin admin] PATH_INFO: `/v3/users/52d96a43d1fa4493929b65914de85062` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:16.459040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a238f-394d-404a-8430-87053cac5b29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52d96a43d1fa4493929b65914de85062)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:16.460957 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a238f-394d-404a-8430-87053cac5b29 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:16.514025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-8f6a238f-394d-404a-8430-87053cac5b29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52d96a43d1fa4493929b65914de85062'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:16.514699 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-8f6a238f-394d-404a-8430-87053cac5b29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52d96a43d1fa4493929b65914de85062'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:16.515307 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-8f6a238f-394d-404a-8430-87053cac5b29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52d96a43d1fa4493929b65914de85062'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:16.528121 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-8f6a238f-394d-404a-8430-87053cac5b29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52d96a43d1fa4493929b65914de85062'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:16.535507 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-8f6a238f-394d-404a-8430-87053cac5b29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52d96a43d1fa4493929b65914de85062'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:16.549199 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1175/2343] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:58:16 2022] DELETE /identity/v3/users/52d96a43d1fa4493929b65914de85062 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:58:16.743449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c1c0c-8bd1-4cc4-9607-b41d66e91d09 service cinder] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:16.756709 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c1c0c-8bd1-4cc4-9607-b41d66e91d09 service cinder] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:16.814054 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb23ab-904e-4277-b22e-20d21a5a7ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:16.814689 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb23ab-904e-4277-b22e-20d21a5a7ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:16.814968 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb23ab-904e-4277-b22e-20d21a5a7ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:16.815243 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb23ab-904e-4277-b22e-20d21a5a7ae5 admin admin] PATH_INFO: `/v3/projects/fd9b12be01e4433ebccb8cb20bdaf9e1` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:16.816428 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb23ab-904e-4277-b22e-20d21a5a7ae5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd9b12be01e4433ebccb8cb20bdaf9e1)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:16.818365 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb23ab-904e-4277-b22e-20d21a5a7ae5 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:16.863132 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-49cb23ab-904e-4277-b22e-20d21a5a7ae5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd9b12be01e4433ebccb8cb20bdaf9e1', 'request_id': 'req-49cb23ab-904e-4277-b22e-20d21a5a7ae5'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:16.869102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-49cb23ab-904e-4277-b22e-20d21a5a7ae5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd9b12be01e4433ebccb8cb20bdaf9e1', 'request_id': 'req-49cb23ab-904e-4277-b22e-20d21a5a7ae5'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:16.875700 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-49cb23ab-904e-4277-b22e-20d21a5a7ae5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd9b12be01e4433ebccb8cb20bdaf9e1', 'request_id': 'req-49cb23ab-904e-4277-b22e-20d21a5a7ae5'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:16.888020 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-49cb23ab-904e-4277-b22e-20d21a5a7ae5 admin admin] The token cache is being invalidate because project fd9b12be01e4433ebccb8cb20bdaf9e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:58:16.888301 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-49cb23ab-904e-4277-b22e-20d21a5a7ae5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:16.888919 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-49cb23ab-904e-4277-b22e-20d21a5a7ae5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:16.890460 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1169/2344] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:58:16 2022] DELETE /identity/v3/projects/fd9b12be01e4433ebccb8cb20bdaf9e1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:58:16.894568 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a238f-394d-404a-8430-87053cac5b29 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:16.896020 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-8f6a238f-394d-404a-8430-87053cac5b29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:16.909015 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a238f-394d-404a-8430-87053cac5b29 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:16.965966 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe74adf-062f-4231-888c-a81b57e06428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:16.966596 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe74adf-062f-4231-888c-a81b57e06428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:16.966873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe74adf-062f-4231-888c-a81b57e06428 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:16.967147 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe74adf-062f-4231-888c-a81b57e06428 admin admin] PATH_INFO: `/v3/users/cc9cf230645b49acabf92ae131bfe922` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:16.968298 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe74adf-062f-4231-888c-a81b57e06428 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc9cf230645b49acabf92ae131bfe922)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:16.970286 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe74adf-062f-4231-888c-a81b57e06428 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:17.015473 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-2fe74adf-062f-4231-888c-a81b57e06428 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc9cf230645b49acabf92ae131bfe922'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:17.016111 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-2fe74adf-062f-4231-888c-a81b57e06428 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc9cf230645b49acabf92ae131bfe922'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:17.016707 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-2fe74adf-062f-4231-888c-a81b57e06428 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc9cf230645b49acabf92ae131bfe922'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:17.028625 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:58:17.031508 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-2fe74adf-062f-4231-888c-a81b57e06428 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc9cf230645b49acabf92ae131bfe922'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:17.039921 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-2fe74adf-062f-4231-888c-a81b57e06428 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc9cf230645b49acabf92ae131bfe922'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:17.052998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1176/2345] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:58:16 2022] DELETE /identity/v3/users/cc9cf230645b49acabf92ae131bfe922 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:58:17.236284 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb23ab-904e-4277-b22e-20d21a5a7ae5 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:17.238860 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-49cb23ab-904e-4277-b22e-20d21a5a7ae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:17.262891 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb23ab-904e-4277-b22e-20d21a5a7ae5 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:17.321709 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:58:17.334773 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be7c2e-8a63-4d47-a794-eee1e2099e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:17.335432 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be7c2e-8a63-4d47-a794-eee1e2099e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:17.335752 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be7c2e-8a63-4d47-a794-eee1e2099e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:17.335945 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be7c2e-8a63-4d47-a794-eee1e2099e81 admin admin] PATH_INFO: `/v3/projects/0623a3a7eea04f7fb8fe25ea05871bb1` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:17.337109 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32be7c2e-8a63-4d47-a794-eee1e2099e81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0623a3a7eea04f7fb8fe25ea05871bb1)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:17.340082 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32be7c2e-8a63-4d47-a794-eee1e2099e81 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:17.386283 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-32be7c2e-8a63-4d47-a794-eee1e2099e81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0623a3a7eea04f7fb8fe25ea05871bb1', 'request_id': 'req-32be7c2e-8a63-4d47-a794-eee1e2099e81'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:17.392355 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-32be7c2e-8a63-4d47-a794-eee1e2099e81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0623a3a7eea04f7fb8fe25ea05871bb1', 'request_id': 'req-32be7c2e-8a63-4d47-a794-eee1e2099e81'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:17.397858 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-32be7c2e-8a63-4d47-a794-eee1e2099e81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0623a3a7eea04f7fb8fe25ea05871bb1', 'request_id': 'req-32be7c2e-8a63-4d47-a794-eee1e2099e81'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:17.410686 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-32be7c2e-8a63-4d47-a794-eee1e2099e81 admin admin] The token cache is being invalidate because project 0623a3a7eea04f7fb8fe25ea05871bb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:58:17.410976 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-32be7c2e-8a63-4d47-a794-eee1e2099e81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:17.411708 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-32be7c2e-8a63-4d47-a794-eee1e2099e81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:17.413240 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1170/2346] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:58:17 2022] DELETE /identity/v3/projects/0623a3a7eea04f7fb8fe25ea05871bb1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:58:17.418340 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb189637-48b4-4eed-b552-825f06b70523 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:17.418634 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb189637-48b4-4eed-b552-825f06b70523 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:17.418914 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb189637-48b4-4eed-b552-825f06b70523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:17.439128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-fb189637-48b4-4eed-b552-825f06b70523 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:58:17.440332 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-fb189637-48b4-4eed-b552-825f06b70523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:17.502355 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1177/2347] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:58:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:58:17.512252 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ae97e-452b-4b3d-b282-b3e9db952f3a None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:17.512534 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ae97e-452b-4b3d-b282-b3e9db952f3a None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:17.512812 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ae97e-452b-4b3d-b282-b3e9db952f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:17.532920 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-220ae97e-452b-4b3d-b282-b3e9db952f3a None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:58:17.534110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-220ae97e-452b-4b3d-b282-b3e9db952f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:17.542295 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1171/2348] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:58:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:58:17.546920 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb189637-48b4-4eed-b552-825f06b70523 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:17.556670 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb189637-48b4-4eed-b552-825f06b70523 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:17.564151 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74b5d5-3b29-493f-8a38-0c2ec9acdcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:17.564778 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74b5d5-3b29-493f-8a38-0c2ec9acdcf9 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:17.565056 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74b5d5-3b29-493f-8a38-0c2ec9acdcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:17.565330 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74b5d5-3b29-493f-8a38-0c2ec9acdcf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:17.566094 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c74b5d5-3b29-493f-8a38-0c2ec9acdcf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:58:17.566387 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c74b5d5-3b29-493f-8a38-0c2ec9acdcf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:17.567986 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c74b5d5-3b29-493f-8a38-0c2ec9acdcf9 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:17.580528 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1178/2349] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:58:17.584990 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ae97e-452b-4b3d-b282-b3e9db952f3a None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:17.595078 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ae97e-452b-4b3d-b282-b3e9db952f3a None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:17.599647 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd2359-e667-4524-8de2-50131215ebe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:17.600243 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd2359-e667-4524-8de2-50131215ebe2 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:17.600521 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd2359-e667-4524-8de2-50131215ebe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:17.600791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd2359-e667-4524-8de2-50131215ebe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:17.601455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd2359-e667-4524-8de2-50131215ebe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:17.603388 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd2359-e667-4524-8de2-50131215ebe2 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:17.631287 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1172/2350] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:58:17 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:58:17.635970 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74b5d5-3b29-493f-8a38-0c2ec9acdcf9 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:17.646568 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74b5d5-3b29-493f-8a38-0c2ec9acdcf9 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:17.708711 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2028aa-6f09-4fa0-a4f5-c2ca363c223d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:17.709337 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2028aa-6f09-4fa0-a4f5-c2ca363c223d admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:17.709752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2028aa-6f09-4fa0-a4f5-c2ca363c223d admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:17.710028 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2028aa-6f09-4fa0-a4f5-c2ca363c223d admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:17.710736 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2028aa-6f09-4fa0-a4f5-c2ca363c223d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:17.712652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2028aa-6f09-4fa0-a4f5-c2ca363c223d admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:17.734639 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1179/2351] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:58:17 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:58:17.738944 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd2359-e667-4524-8de2-50131215ebe2 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:17.751079 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd2359-e667-4524-8de2-50131215ebe2 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:17.756021 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e331278-7f34-41c7-927e-36a16a01c360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:17.756643 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e331278-7f34-41c7-927e-36a16a01c360 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:17.756927 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e331278-7f34-41c7-927e-36a16a01c360 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:17.757194 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e331278-7f34-41c7-927e-36a16a01c360 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:17.757930 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e331278-7f34-41c7-927e-36a16a01c360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:17.759503 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e331278-7f34-41c7-927e-36a16a01c360 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:17.773215 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1173/2352] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:58:17.774661 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2028aa-6f09-4fa0-a4f5-c2ca363c223d admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:17.785239 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2028aa-6f09-4fa0-a4f5-c2ca363c223d admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:17.790477 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede131b-d7d9-47bc-a482-bbad60ca3e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:17.791086 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede131b-d7d9-47bc-a482-bbad60ca3e47 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:17.791495 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede131b-d7d9-47bc-a482-bbad60ca3e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:17.791998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede131b-d7d9-47bc-a482-bbad60ca3e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:17.792755 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede131b-d7d9-47bc-a482-bbad60ca3e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:17.794465 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede131b-d7d9-47bc-a482-bbad60ca3e47 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:17.805910 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1180/2353] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:58:17.811030 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e331278-7f34-41c7-927e-36a16a01c360 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:17.821173 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e331278-7f34-41c7-927e-36a16a01c360 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:17.826648 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ba4eb-b6fb-4382-9b3a-470aaaf34db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:17.827317 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ba4eb-b6fb-4382-9b3a-470aaaf34db5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:17.827600 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ba4eb-b6fb-4382-9b3a-470aaaf34db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:17.827878 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ba4eb-b6fb-4382-9b3a-470aaaf34db5 admin admin] PATH_INFO: `/v3/projects/7050190e6c174c2c89f444d767eff396/users/d5bfeb28d41243daa5726e189d0ed898/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:17.843517 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ba4eb-b6fb-4382-9b3a-470aaaf34db5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7050190e6c174c2c89f444d767eff396, user_id=d5bfeb28d41243daa5726e189d0ed898, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:17.846239 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ba4eb-b6fb-4382-9b3a-470aaaf34db5 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:17.860791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1174/2354] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:58:17 2022] PUT /identity/v3/projects/7050190e6c174c2c89f444d767eff396/users/d5bfeb28d41243daa5726e189d0ed898/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:58:17.865848 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3bfe0-5dd4-4cdd-bcf0-d825c54afb49 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:17.866543 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3bfe0-5dd4-4cdd-bcf0-d825c54afb49 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:17.866825 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3bfe0-5dd4-4cdd-bcf0-d825c54afb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:17.891242 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-c5e3bfe0-5dd4-4cdd-bcf0-d825c54afb49 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:58:17.892483 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-c5e3bfe0-5dd4-4cdd-bcf0-d825c54afb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:17.933994 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:58:17.955395 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1181/2355] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:58:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:58:17.965260 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ba4eb-b6fb-4382-9b3a-470aaaf34db5 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:17.967054 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-9f7ba4eb-b6fb-4382-9b3a-470aaaf34db5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:18.023530 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ba4eb-b6fb-4382-9b3a-470aaaf34db5 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:18.027850 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0cc22-d458-40c7-bf93-f1d7a032cd76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:18.028460 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0cc22-d458-40c7-bf93-f1d7a032cd76 service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:18.028777 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0cc22-d458-40c7-bf93-f1d7a032cd76 service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:18.029016 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0cc22-d458-40c7-bf93-f1d7a032cd76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:18.038275 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0cc22-d458-40c7-bf93-f1d7a032cd76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:18.039674 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0cc22-d458-40c7-bf93-f1d7a032cd76 service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:18.049654 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1175/2356] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:58:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:58:21.855935 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3bfe0-5dd4-4cdd-bcf0-d825c54afb49 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:21.858124 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-c5e3bfe0-5dd4-4cdd-bcf0-d825c54afb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:21.871581 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3bfe0-5dd4-4cdd-bcf0-d825c54afb49 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:21.876670 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8024f-b575-49d4-93b2-2fd772acd098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:21.878024 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8024f-b575-49d4-93b2-2fd772acd098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:21.878470 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8024f-b575-49d4-93b2-2fd772acd098 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:21.878905 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8024f-b575-49d4-93b2-2fd772acd098 admin admin] PATH_INFO: `/v3/users/2c5584e96c32474cbd7471c52ce213c0` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:21.880349 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8024f-b575-49d4-93b2-2fd772acd098 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c5584e96c32474cbd7471c52ce213c0)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:21.882874 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8024f-b575-49d4-93b2-2fd772acd098 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:21.942496 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-76d8024f-b575-49d4-93b2-2fd772acd098 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c5584e96c32474cbd7471c52ce213c0'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:21.943155 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-76d8024f-b575-49d4-93b2-2fd772acd098 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c5584e96c32474cbd7471c52ce213c0'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:21.943746 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-76d8024f-b575-49d4-93b2-2fd772acd098 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c5584e96c32474cbd7471c52ce213c0'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:21.964640 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-76d8024f-b575-49d4-93b2-2fd772acd098 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c5584e96c32474cbd7471c52ce213c0'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:21.973056 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-76d8024f-b575-49d4-93b2-2fd772acd098 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c5584e96c32474cbd7471c52ce213c0'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:21.990064 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1182/2357] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:58:21 2022] DELETE /identity/v3/users/2c5584e96c32474cbd7471c52ce213c0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:58:21.995581 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0917e-0e3f-40bd-92fe-c90b4f2b70d9 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:21.996113 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0917e-0e3f-40bd-92fe-c90b4f2b70d9 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:21.996113 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0917e-0e3f-40bd-92fe-c90b4f2b70d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:22.022120 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-8ea0917e-0e3f-40bd-92fe-c90b4f2b70d9 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:58:22.023752 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-8ea0917e-0e3f-40bd-92fe-c90b4f2b70d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:22.047753 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:58:22.077580 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60befb-fb3b-4c25-bd64-135c750b14c5 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:22.077865 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60befb-fb3b-4c25-bd64-135c750b14c5 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:22.078144 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60befb-fb3b-4c25-bd64-135c750b14c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:22.109636 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-6c60befb-fb3b-4c25-bd64-135c750b14c5 None None] MFA Rules not processed for user `d5bfeb28d41243daa5726e189d0ed898`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:58:22.110890 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-6c60befb-fb3b-4c25-bd64-135c750b14c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:22.115004 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1176/2358] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:58:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:58:22.124857 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0917e-0e3f-40bd-92fe-c90b4f2b70d9 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:22.126288 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-8ea0917e-0e3f-40bd-92fe-c90b4f2b70d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:22.195490 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1183/2359] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:58:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:58:22.200302 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60befb-fb3b-4c25-bd64-135c750b14c5 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:22.200430 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0917e-0e3f-40bd-92fe-c90b4f2b70d9 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:22.201680 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-6c60befb-fb3b-4c25-bd64-135c750b14c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:22.204644 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9eb67-b922-4dcb-b13f-374eb5a50134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:22.205279 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9eb67-b922-4dcb-b13f-374eb5a50134 service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:22.205593 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9eb67-b922-4dcb-b13f-374eb5a50134 service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:22.205877 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9eb67-b922-4dcb-b13f-374eb5a50134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:22.216490 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9eb67-b922-4dcb-b13f-374eb5a50134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:22.216693 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60befb-fb3b-4c25-bd64-135c750b14c5 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:22.218010 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9eb67-b922-4dcb-b13f-374eb5a50134 service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:22.221215 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42d01d-fc2b-4abb-815b-efe05421df31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:22.221879 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42d01d-fc2b-4abb-815b-efe05421df31 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:22.222166 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42d01d-fc2b-4abb-815b-efe05421df31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:22.222450 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42d01d-fc2b-4abb-815b-efe05421df31 admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:22.223134 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42d01d-fc2b-4abb-815b-efe05421df31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:22.225061 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42d01d-fc2b-4abb-815b-efe05421df31 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:22.229556 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1177/2360] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:58:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 12:58:22.259089 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1184/2361] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:58:22 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:58:22.260992 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9eb67-b922-4dcb-b13f-374eb5a50134 service neutron] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:22.272581 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9eb67-b922-4dcb-b13f-374eb5a50134 service neutron] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:22.345475 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5e079-8d66-475a-a7bc-3ab419fb1d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:22.346233 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5e079-8d66-475a-a7bc-3ab419fb1d5f admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:22.346576 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5e079-8d66-475a-a7bc-3ab419fb1d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:22.347095 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5e079-8d66-475a-a7bc-3ab419fb1d5f admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:22.348331 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5e079-8d66-475a-a7bc-3ab419fb1d5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:22.349890 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5e079-8d66-475a-a7bc-3ab419fb1d5f admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:22.373076 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1178/2362] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:58:22 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 12:58:22.388221 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42d01d-fc2b-4abb-815b-efe05421df31 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:22.403383 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42d01d-fc2b-4abb-815b-efe05421df31 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:22.412963 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0e4f2-c92c-4283-96c4-8cdd1b29840e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:22.413640 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0e4f2-c92c-4283-96c4-8cdd1b29840e admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:22.413924 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0e4f2-c92c-4283-96c4-8cdd1b29840e admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:22.414215 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0e4f2-c92c-4283-96c4-8cdd1b29840e admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:22.414986 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0e4f2-c92c-4283-96c4-8cdd1b29840e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:22.417214 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0e4f2-c92c-4283-96c4-8cdd1b29840e admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:22.428025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1185/2363] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:58:22.432498 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5e079-8d66-475a-a7bc-3ab419fb1d5f admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:22.443290 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5e079-8d66-475a-a7bc-3ab419fb1d5f admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:22.455482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd19ba5-5e67-4c62-8a61-4672c67c96dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:22.456566 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd19ba5-5e67-4c62-8a61-4672c67c96dd admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:22.456856 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd19ba5-5e67-4c62-8a61-4672c67c96dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:22.457596 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd19ba5-5e67-4c62-8a61-4672c67c96dd admin admin] PATH_INFO: `/v3/projects/5196b0ffac644a28a273c37fe5cecb42/users/c4eca587c4674d978a4b2cc34ebb1420/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:22.566834 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0e4f2-c92c-4283-96c4-8cdd1b29840e admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:22.568685 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-6cd0e4f2-c92c-4283-96c4-8cdd1b29840e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:22.591205 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0e4f2-c92c-4283-96c4-8cdd1b29840e admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:22.605139 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd19ba5-5e67-4c62-8a61-4672c67c96dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5196b0ffac644a28a273c37fe5cecb42, user_id=c4eca587c4674d978a4b2cc34ebb1420, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:22.605848 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830b197-6efe-4a25-a4e9-b6245d348aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:22.606555 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830b197-6efe-4a25-a4e9-b6245d348aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:22.606848 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830b197-6efe-4a25-a4e9-b6245d348aff admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:22.607134 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830b197-6efe-4a25-a4e9-b6245d348aff admin admin] PATH_INFO: `/v3/projects/8c660cd0e60b4c6384280b89f44fc66f` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:22.607969 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd19ba5-5e67-4c62-8a61-4672c67c96dd admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:22.608360 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830b197-6efe-4a25-a4e9-b6245d348aff admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c660cd0e60b4c6384280b89f44fc66f)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:22.610634 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830b197-6efe-4a25-a4e9-b6245d348aff admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:22.620819 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:58:22.625565 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1179/2364] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:58:22 2022] PUT /identity/v3/projects/5196b0ffac644a28a273c37fe5cecb42/users/c4eca587c4674d978a4b2cc34ebb1420/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:58:22.628753 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd19ba5-5e67-4c62-8a61-4672c67c96dd admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:22.669099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:58:22.678129 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-6830b197-6efe-4a25-a4e9-b6245d348aff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c660cd0e60b4c6384280b89f44fc66f', 'request_id': 'req-6830b197-6efe-4a25-a4e9-b6245d348aff'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:22.685740 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-6830b197-6efe-4a25-a4e9-b6245d348aff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c660cd0e60b4c6384280b89f44fc66f', 'request_id': 'req-6830b197-6efe-4a25-a4e9-b6245d348aff'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:22.693801 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-6830b197-6efe-4a25-a4e9-b6245d348aff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c660cd0e60b4c6384280b89f44fc66f', 'request_id': 'req-6830b197-6efe-4a25-a4e9-b6245d348aff'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:22.706732 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-6830b197-6efe-4a25-a4e9-b6245d348aff admin admin] The token cache is being invalidate because project 8c660cd0e60b4c6384280b89f44fc66f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:58:22.707044 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-6830b197-6efe-4a25-a4e9-b6245d348aff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:22.707683 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-6830b197-6efe-4a25-a4e9-b6245d348aff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:22.709292 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1186/2365] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:58:22 2022] DELETE /identity/v3/projects/8c660cd0e60b4c6384280b89f44fc66f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:58:22.714073 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830b197-6efe-4a25-a4e9-b6245d348aff admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:22.715526 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd19ba5-5e67-4c62-8a61-4672c67c96dd admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:22.715818 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-6830b197-6efe-4a25-a4e9-b6245d348aff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:22.787130 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe112c7-2c76-4245-84f8-087672292067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:22.787753 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe112c7-2c76-4245-84f8-087672292067 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:22.788040 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe112c7-2c76-4245-84f8-087672292067 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:22.788313 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe112c7-2c76-4245-84f8-087672292067 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:22.789046 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe112c7-2c76-4245-84f8-087672292067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:22.790696 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe112c7-2c76-4245-84f8-087672292067 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:22.796620 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830b197-6efe-4a25-a4e9-b6245d348aff admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:22.801308 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1180/2366] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:58:22.802115 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d55086-a40a-4786-9589-414205a29142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:22.802770 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d55086-a40a-4786-9589-414205a29142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:22.803054 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d55086-a40a-4786-9589-414205a29142 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:22.803328 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d55086-a40a-4786-9589-414205a29142 admin admin] PATH_INFO: `/v3/users/23b6b814d6e94d9ebdc157f905eda235` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:22.804603 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d55086-a40a-4786-9589-414205a29142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23b6b814d6e94d9ebdc157f905eda235)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:22.805335 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe112c7-2c76-4245-84f8-087672292067 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:22.806795 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d55086-a40a-4786-9589-414205a29142 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:22.807171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-dfe112c7-2c76-4245-84f8-087672292067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:22.820079 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe112c7-2c76-4245-84f8-087672292067 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:22.825646 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9c67a-7283-49e6-ba0f-60677509f1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:22.826189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9c67a-7283-49e6-ba0f-60677509f1ef admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:22.826471 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9c67a-7283-49e6-ba0f-60677509f1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:22.826748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9c67a-7283-49e6-ba0f-60677509f1ef admin admin] PATH_INFO: `/v3/projects/5196b0ffac644a28a273c37fe5cecb42/users/c4eca587c4674d978a4b2cc34ebb1420/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:22.828765 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e9c67a-7283-49e6-ba0f-60677509f1ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=5196b0ffac644a28a273c37fe5cecb42, user_id=c4eca587c4674d978a4b2cc34ebb1420, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:22.831480 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e9c67a-7283-49e6-ba0f-60677509f1ef admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:22.845287 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1181/2367] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:58:22 2022] PUT /identity/v3/projects/5196b0ffac644a28a273c37fe5cecb42/users/c4eca587c4674d978a4b2cc34ebb1420/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:58:22.861015 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-d4d55086-a40a-4786-9589-414205a29142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23b6b814d6e94d9ebdc157f905eda235'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:22.861735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-d4d55086-a40a-4786-9589-414205a29142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23b6b814d6e94d9ebdc157f905eda235'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:22.862378 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-d4d55086-a40a-4786-9589-414205a29142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23b6b814d6e94d9ebdc157f905eda235'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:22.879160 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-d4d55086-a40a-4786-9589-414205a29142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23b6b814d6e94d9ebdc157f905eda235'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:22.891684 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-d4d55086-a40a-4786-9589-414205a29142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23b6b814d6e94d9ebdc157f905eda235'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:22.911978 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1187/2368] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:58:22 2022] DELETE /identity/v3/users/23b6b814d6e94d9ebdc157f905eda235 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:58:23.334974 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9c67a-7283-49e6-ba0f-60677509f1ef admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:23.338989 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-46e9c67a-7283-49e6-ba0f-60677509f1ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:23.446948 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9c67a-7283-49e6-ba0f-60677509f1ef admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:23.530831 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fdd31c-49c6-4bbe-a116-ee1e067cffae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:23.531784 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdd31c-49c6-4bbe-a116-ee1e067cffae admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:23.532219 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdd31c-49c6-4bbe-a116-ee1e067cffae admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:23.532493 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdd31c-49c6-4bbe-a116-ee1e067cffae admin admin] PATH_INFO: `/v3/projects/fd20ce8c147842b68d74eea80bd2cd04` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:23.533857 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fdd31c-49c6-4bbe-a116-ee1e067cffae admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd20ce8c147842b68d74eea80bd2cd04)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:23.535741 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fdd31c-49c6-4bbe-a116-ee1e067cffae admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:23.545683 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:58:23.604189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-39fdd31c-49c6-4bbe-a116-ee1e067cffae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd20ce8c147842b68d74eea80bd2cd04', 'request_id': 'req-39fdd31c-49c6-4bbe-a116-ee1e067cffae'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:23.619468 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-39fdd31c-49c6-4bbe-a116-ee1e067cffae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd20ce8c147842b68d74eea80bd2cd04', 'request_id': 'req-39fdd31c-49c6-4bbe-a116-ee1e067cffae'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:23.625962 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-39fdd31c-49c6-4bbe-a116-ee1e067cffae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd20ce8c147842b68d74eea80bd2cd04', 'request_id': 'req-39fdd31c-49c6-4bbe-a116-ee1e067cffae'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:23.643054 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-39fdd31c-49c6-4bbe-a116-ee1e067cffae admin admin] The token cache is being invalidate because project fd20ce8c147842b68d74eea80bd2cd04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:58:23.643514 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-39fdd31c-49c6-4bbe-a116-ee1e067cffae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:23.644305 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-39fdd31c-49c6-4bbe-a116-ee1e067cffae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:23.646404 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1182/2369] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:58:23 2022] DELETE /identity/v3/projects/fd20ce8c147842b68d74eea80bd2cd04 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 12:58:23.652584 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b1afe-f18e-4adf-9637-8bed7a55c1b0 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:23.652956 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b1afe-f18e-4adf-9637-8bed7a55c1b0 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:23.653302 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b1afe-f18e-4adf-9637-8bed7a55c1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:23.674016 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-fd7b1afe-f18e-4adf-9637-8bed7a55c1b0 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:58:23.675300 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-fd7b1afe-f18e-4adf-9637-8bed7a55c1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:23.700891 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:58:23.797531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1188/2370] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:58:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:58:23.852983 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052d8e7-fa70-4ff1-bc3b-1dd4f94d1f0d None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:23.853293 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052d8e7-fa70-4ff1-bc3b-1dd4f94d1f0d None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:23.853611 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052d8e7-fa70-4ff1-bc3b-1dd4f94d1f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:23.874927 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-f052d8e7-fa70-4ff1-bc3b-1dd4f94d1f0d None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:58:23.876069 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-f052d8e7-fa70-4ff1-bc3b-1dd4f94d1f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:23.889217 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1183/2371] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:58:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:58:23.890534 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b1afe-f18e-4adf-9637-8bed7a55c1b0 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:23.900587 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b1afe-f18e-4adf-9637-8bed7a55c1b0 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:23.906942 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9623a-61de-467c-af25-d274071091fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:23.907885 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9623a-61de-467c-af25-d274071091fd admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:23.908338 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9623a-61de-467c-af25-d274071091fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:23.910196 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9623a-61de-467c-af25-d274071091fd admin admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:23.910949 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9623a-61de-467c-af25-d274071091fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:58:23.911260 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9623a-61de-467c-af25-d274071091fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:23.912943 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9623a-61de-467c-af25-d274071091fd admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:23.929596 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1189/2372] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 12:58:23.934994 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052d8e7-fa70-4ff1-bc3b-1dd4f94d1f0d None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:23.944841 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052d8e7-fa70-4ff1-bc3b-1dd4f94d1f0d None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:23.950323 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbaa9cc-579a-4c94-b7b5-edb0f4f290ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:23.951012 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbaa9cc-579a-4c94-b7b5-edb0f4f290ae admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:23.951360 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbaa9cc-579a-4c94-b7b5-edb0f4f290ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:23.951705 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbaa9cc-579a-4c94-b7b5-edb0f4f290ae admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:23.952531 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbaa9cc-579a-4c94-b7b5-edb0f4f290ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:23.954739 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbaa9cc-579a-4c94-b7b5-edb0f4f290ae admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:23.985164 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1184/2373] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:58:23 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:58:23.989468 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9623a-61de-467c-af25-d274071091fd admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:24.000822 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9623a-61de-467c-af25-d274071091fd admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:24.073235 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c0466-c48c-4d22-b96b-3271d6e0fc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:24.074018 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c0466-c48c-4d22-b96b-3271d6e0fc2b admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:24.074299 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c0466-c48c-4d22-b96b-3271d6e0fc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:24.074589 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c0466-c48c-4d22-b96b-3271d6e0fc2b admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:24.075252 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c0466-c48c-4d22-b96b-3271d6e0fc2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:24.077230 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c0466-c48c-4d22-b96b-3271d6e0fc2b admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:24.105960 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1190/2374] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:58:23 2022] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:58:24.107185 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbaa9cc-579a-4c94-b7b5-edb0f4f290ae admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:24.118554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbaa9cc-579a-4c94-b7b5-edb0f4f290ae admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:24.124882 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f35d76-386e-4330-8489-39628ba0999e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:24.125328 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f35d76-386e-4330-8489-39628ba0999e admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:24.125853 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f35d76-386e-4330-8489-39628ba0999e admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:24.126023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f35d76-386e-4330-8489-39628ba0999e admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:24.126769 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f35d76-386e-4330-8489-39628ba0999e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:24.128464 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f35d76-386e-4330-8489-39628ba0999e admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:24.142677 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1185/2375] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:58:24.143939 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c0466-c48c-4d22-b96b-3271d6e0fc2b admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:24.155469 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c0466-c48c-4d22-b96b-3271d6e0fc2b admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:24.161787 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062dc7b9-0c9c-4611-8c4c-16159b4a3a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:24.162421 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062dc7b9-0c9c-4611-8c4c-16159b4a3a32 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:24.162701 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062dc7b9-0c9c-4611-8c4c-16159b4a3a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:24.162998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062dc7b9-0c9c-4611-8c4c-16159b4a3a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:24.163708 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062dc7b9-0c9c-4611-8c4c-16159b4a3a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:24.165454 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062dc7b9-0c9c-4611-8c4c-16159b4a3a32 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:24.179265 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1191/2376] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:58:24.184500 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f35d76-386e-4330-8489-39628ba0999e admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:24.197123 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f35d76-386e-4330-8489-39628ba0999e admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:24.203050 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75526e8c-3bed-4175-a98f-da4a81054fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:24.204242 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75526e8c-3bed-4175-a98f-da4a81054fde admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:24.204546 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75526e8c-3bed-4175-a98f-da4a81054fde admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:24.205034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75526e8c-3bed-4175-a98f-da4a81054fde admin admin] PATH_INFO: `/v3/projects/7c1919952ed4443ea1dd79bdf5333a2d/users/918e5657ce1946ee915e2078b2524ff5/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:24.222816 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75526e8c-3bed-4175-a98f-da4a81054fde admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c1919952ed4443ea1dd79bdf5333a2d, user_id=918e5657ce1946ee915e2078b2524ff5, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:24.226076 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75526e8c-3bed-4175-a98f-da4a81054fde admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:24.253220 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1186/2377] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:58:24 2022] PUT /identity/v3/projects/7c1919952ed4443ea1dd79bdf5333a2d/users/918e5657ce1946ee915e2078b2524ff5/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:58:24.264028 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917eace-ceb8-412f-a7e0-4adb58d1fa35 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:24.264494 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917eace-ceb8-412f-a7e0-4adb58d1fa35 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:24.264870 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917eace-ceb8-412f-a7e0-4adb58d1fa35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:24.319398 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-f917eace-ceb8-412f-a7e0-4adb58d1fa35 None None] MFA Rules not processed for user `918e5657ce1946ee915e2078b2524ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:58:24.320116 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-f917eace-ceb8-412f-a7e0-4adb58d1fa35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:24.406664 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1192/2378] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:58:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:58:24.419133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75526e8c-3bed-4175-a98f-da4a81054fde admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:24.420914 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-75526e8c-3bed-4175-a98f-da4a81054fde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:24.506342 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75526e8c-3bed-4175-a98f-da4a81054fde admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:24.511503 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079e1d3-88e1-45f6-896e-e758c75b7611 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:24.512232 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079e1d3-88e1-45f6-896e-e758c75b7611 service cinder] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:24.512558 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079e1d3-88e1-45f6-896e-e758c75b7611 service cinder] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:24.512901 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079e1d3-88e1-45f6-896e-e758c75b7611 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:24.526743 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079e1d3-88e1-45f6-896e-e758c75b7611 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:24.528353 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079e1d3-88e1-45f6-896e-e758c75b7611 service cinder] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:24.540232 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1187/2379] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:58:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:58:27.723494 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c0866-0ba7-4f41-8a9d-77864861cc68 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:27.724292 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c0866-0ba7-4f41-8a9d-77864861cc68 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:27.724721 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c0866-0ba7-4f41-8a9d-77864861cc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:27.762594 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:58:27.775111 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-fb9c0866-0ba7-4f41-8a9d-77864861cc68 None None] MFA Rules not processed for user `c4eca587c4674d978a4b2cc34ebb1420`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:58:27.777096 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-fb9c0866-0ba7-4f41-8a9d-77864861cc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:27.867616 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1193/2380] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:58:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:58:27.887497 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079e1d3-88e1-45f6-896e-e758c75b7611 service cinder] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:27.890982 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-e079e1d3-88e1-45f6-896e-e758c75b7611 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:27.997065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:58:28.061894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079e1d3-88e1-45f6-896e-e758c75b7611 service cinder] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:28.069128 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07750ec2-1520-48f0-b847-934cd7dd21ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:28.070032 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07750ec2-1520-48f0-b847-934cd7dd21ff service nova] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:28.070318 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07750ec2-1520-48f0-b847-934cd7dd21ff service nova] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:28.070596 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07750ec2-1520-48f0-b847-934cd7dd21ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:28.072398 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-07750ec2-1520-48f0-b847-934cd7dd21ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:28.154224 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07750ec2-1520-48f0-b847-934cd7dd21ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:28.155839 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07750ec2-1520-48f0-b847-934cd7dd21ff service nova] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:28.178963 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1188/2381] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:58:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:58:29.548953 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dea3ca-550c-49b5-ab94-926aef88d45e None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:29.549441 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dea3ca-550c-49b5-ab94-926aef88d45e None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:29.549728 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dea3ca-550c-49b5-ab94-926aef88d45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:29.571827 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-99dea3ca-550c-49b5-ab94-926aef88d45e None None] MFA Rules not processed for user `d5bfeb28d41243daa5726e189d0ed898`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:58:29.574008 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-99dea3ca-550c-49b5-ab94-926aef88d45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:29.587428 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1194/2382] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:58:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:58:38.161203 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=40 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:58:38.583218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07750ec2-1520-48f0-b847-934cd7dd21ff service nova] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:38.644819 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07750ec2-1520-48f0-b847-934cd7dd21ff service nova] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:38.649424 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e514b73-903a-4c1b-800a-f59cbc2b45a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:38.650094 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e514b73-903a-4c1b-800a-f59cbc2b45a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:38.650388 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e514b73-903a-4c1b-800a-f59cbc2b45a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:38.650665 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e514b73-903a-4c1b-800a-f59cbc2b45a1 admin admin] PATH_INFO: `/v3/users/918e5657ce1946ee915e2078b2524ff5` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:38.651808 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e514b73-903a-4c1b-800a-f59cbc2b45a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=918e5657ce1946ee915e2078b2524ff5)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:38.654277 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e514b73-903a-4c1b-800a-f59cbc2b45a1 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:38.698745 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-8e514b73-903a-4c1b-800a-f59cbc2b45a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '918e5657ce1946ee915e2078b2524ff5'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:38.706194 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-8e514b73-903a-4c1b-800a-f59cbc2b45a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '918e5657ce1946ee915e2078b2524ff5'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:38.706821 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-8e514b73-903a-4c1b-800a-f59cbc2b45a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '918e5657ce1946ee915e2078b2524ff5'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:38.707414 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-8e514b73-903a-4c1b-800a-f59cbc2b45a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '918e5657ce1946ee915e2078b2524ff5'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:38.719688 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-8e514b73-903a-4c1b-800a-f59cbc2b45a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '918e5657ce1946ee915e2078b2524ff5'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:38.732958 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1189/2383] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:58:38 2022] DELETE /identity/v3/users/918e5657ce1946ee915e2078b2524ff5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:58:38.737472 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a4b08-d26e-4624-838a-e8210bf8e5d2 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:38.737980 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a4b08-d26e-4624-838a-e8210bf8e5d2 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:38.738082 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a4b08-d26e-4624-838a-e8210bf8e5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:38.759081 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-854a4b08-d26e-4624-838a-e8210bf8e5d2 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:58:38.760297 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-854a4b08-d26e-4624-838a-e8210bf8e5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:38.821022 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1195/2384] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:58:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:58:38.830781 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e514b73-903a-4c1b-800a-f59cbc2b45a1 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:38.832187 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-8e514b73-903a-4c1b-800a-f59cbc2b45a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:38.889985 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e514b73-903a-4c1b-800a-f59cbc2b45a1 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:38.893684 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68127e6-4387-4962-ac84-d4dea3b26c53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:38.894324 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68127e6-4387-4962-ac84-d4dea3b26c53 service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:38.894580 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68127e6-4387-4962-ac84-d4dea3b26c53 service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:38.894850 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68127e6-4387-4962-ac84-d4dea3b26c53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:38.907496 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68127e6-4387-4962-ac84-d4dea3b26c53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:38.908925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68127e6-4387-4962-ac84-d4dea3b26c53 service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:38.920224 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1190/2385] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:58:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:58:39.203590 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a4b08-d26e-4624-838a-e8210bf8e5d2 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:39.205117 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-854a4b08-d26e-4624-838a-e8210bf8e5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:39.219134 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a4b08-d26e-4624-838a-e8210bf8e5d2 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:39.224219 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ffeb7-7120-4a91-8146-ca1ee1f381ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:39.225100 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ffeb7-7120-4a91-8146-ca1ee1f381ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:39.225394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ffeb7-7120-4a91-8146-ca1ee1f381ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:39.225725 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ffeb7-7120-4a91-8146-ca1ee1f381ad admin admin] PATH_INFO: `/v3/projects/7c1919952ed4443ea1dd79bdf5333a2d` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:39.226948 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ffeb7-7120-4a91-8146-ca1ee1f381ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c1919952ed4443ea1dd79bdf5333a2d)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:39.228968 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ffeb7-7120-4a91-8146-ca1ee1f381ad admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:39.280462 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-800ffeb7-7120-4a91-8146-ca1ee1f381ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c1919952ed4443ea1dd79bdf5333a2d', 'request_id': 'req-800ffeb7-7120-4a91-8146-ca1ee1f381ad'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:39.286694 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-800ffeb7-7120-4a91-8146-ca1ee1f381ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c1919952ed4443ea1dd79bdf5333a2d', 'request_id': 'req-800ffeb7-7120-4a91-8146-ca1ee1f381ad'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:39.295587 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-800ffeb7-7120-4a91-8146-ca1ee1f381ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c1919952ed4443ea1dd79bdf5333a2d', 'request_id': 'req-800ffeb7-7120-4a91-8146-ca1ee1f381ad'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:39.306328 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-800ffeb7-7120-4a91-8146-ca1ee1f381ad admin admin] The token cache is being invalidate because project 7c1919952ed4443ea1dd79bdf5333a2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:58:39.306611 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-800ffeb7-7120-4a91-8146-ca1ee1f381ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:39.307242 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-800ffeb7-7120-4a91-8146-ca1ee1f381ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:39.308781 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1196/2386] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:58:39 2022] DELETE /identity/v3/projects/7c1919952ed4443ea1dd79bdf5333a2d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:58:39.314654 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6462f3e-cfc2-44a6-8181-fd9e5480947c None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:39.315125 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6462f3e-cfc2-44a6-8181-fd9e5480947c None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:39.315363 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6462f3e-cfc2-44a6-8181-fd9e5480947c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:39.335352 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-c6462f3e-cfc2-44a6-8181-fd9e5480947c None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:58:39.336572 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-c6462f3e-cfc2-44a6-8181-fd9e5480947c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:39.354873 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:58:39.402320 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1191/2387] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:58:39.411317 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bc122-dd4f-47e1-99f3-b33bfb205498 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:39.411605 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bc122-dd4f-47e1-99f3-b33bfb205498 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:39.411877 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bc122-dd4f-47e1-99f3-b33bfb205498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:39.435968 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-825bc122-dd4f-47e1-99f3-b33bfb205498 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:58:39.437463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-825bc122-dd4f-47e1-99f3-b33bfb205498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:39.447288 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1197/2388] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:58:39.456917 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6462f3e-cfc2-44a6-8181-fd9e5480947c None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:39.462537 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6462f3e-cfc2-44a6-8181-fd9e5480947c None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:39.467233 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629be848-2049-43a1-b433-8dc88c01c00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:39.468020 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629be848-2049-43a1-b433-8dc88c01c00d admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:39.468707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629be848-2049-43a1-b433-8dc88c01c00d admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:39.468707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629be848-2049-43a1-b433-8dc88c01c00d admin admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:39.469445 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629be848-2049-43a1-b433-8dc88c01c00d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:58:39.469821 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629be848-2049-43a1-b433-8dc88c01c00d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:39.471717 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629be848-2049-43a1-b433-8dc88c01c00d admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:39.487209 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1192/2389] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:58:39.491081 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bc122-dd4f-47e1-99f3-b33bfb205498 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:39.501431 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bc122-dd4f-47e1-99f3-b33bfb205498 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:39.506362 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b5f1b-c8d5-494c-9cfe-768da8268397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:39.506975 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b5f1b-c8d5-494c-9cfe-768da8268397 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:39.507252 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b5f1b-c8d5-494c-9cfe-768da8268397 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:39.507524 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b5f1b-c8d5-494c-9cfe-768da8268397 admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:39.508213 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b5f1b-c8d5-494c-9cfe-768da8268397 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:39.510427 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b5f1b-c8d5-494c-9cfe-768da8268397 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:39.515790 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:58:39.545477 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1198/2390] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:58:39 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:58:39.550581 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629be848-2049-43a1-b433-8dc88c01c00d admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:39.566494 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629be848-2049-43a1-b433-8dc88c01c00d admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:39.625632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ac1e5-e30c-4947-b206-7ec17a17ac7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:39.626397 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ac1e5-e30c-4947-b206-7ec17a17ac7b admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:39.626716 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ac1e5-e30c-4947-b206-7ec17a17ac7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:39.627131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ac1e5-e30c-4947-b206-7ec17a17ac7b admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:39.627956 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ac1e5-e30c-4947-b206-7ec17a17ac7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:39.630597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ac1e5-e30c-4947-b206-7ec17a17ac7b admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:39.657303 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1193/2391] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:58:39 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:58:39.661473 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b5f1b-c8d5-494c-9cfe-768da8268397 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:39.675669 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b5f1b-c8d5-494c-9cfe-768da8268397 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:39.679093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb09e70-bacf-433d-9b7e-135d08cddbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:39.679801 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb09e70-bacf-433d-9b7e-135d08cddbc0 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:39.680143 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb09e70-bacf-433d-9b7e-135d08cddbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:39.680492 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb09e70-bacf-433d-9b7e-135d08cddbc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:39.681248 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb09e70-bacf-433d-9b7e-135d08cddbc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:39.682938 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb09e70-bacf-433d-9b7e-135d08cddbc0 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:39.695350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1199/2392] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:58:39.700500 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ac1e5-e30c-4947-b206-7ec17a17ac7b admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:39.711320 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ac1e5-e30c-4947-b206-7ec17a17ac7b admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:39.717040 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d34e7-f24b-4cb9-9606-7652e328607e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:39.717945 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d34e7-f24b-4cb9-9606-7652e328607e admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:39.718219 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d34e7-f24b-4cb9-9606-7652e328607e admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:39.718494 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d34e7-f24b-4cb9-9606-7652e328607e admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:39.719236 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d34e7-f24b-4cb9-9606-7652e328607e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:39.721375 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d34e7-f24b-4cb9-9606-7652e328607e admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:39.733791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1194/2393] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:58:39.738512 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb09e70-bacf-433d-9b7e-135d08cddbc0 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:39.751019 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb09e70-bacf-433d-9b7e-135d08cddbc0 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:39.762335 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0a7b6-9af7-46db-b3fd-84e44ac809b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:39.763199 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0a7b6-9af7-46db-b3fd-84e44ac809b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:39.763783 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0a7b6-9af7-46db-b3fd-84e44ac809b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:39.764037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0a7b6-9af7-46db-b3fd-84e44ac809b7 admin admin] PATH_INFO: `/v3/projects/fdb8a6b1c85a4fa68d3a0c8af2b7ef6e/users/955a027a268a4957b675bc0d366586dd/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:39.782786 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0a7b6-9af7-46db-b3fd-84e44ac809b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdb8a6b1c85a4fa68d3a0c8af2b7ef6e, user_id=955a027a268a4957b675bc0d366586dd, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:39.786556 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0a7b6-9af7-46db-b3fd-84e44ac809b7 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:39.804472 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1200/2394] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:58:39 2022] PUT /identity/v3/projects/fdb8a6b1c85a4fa68d3a0c8af2b7ef6e/users/955a027a268a4957b675bc0d366586dd/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:58:39.815849 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c02de-a350-4f23-a0f3-1da9be0cd574 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:39.816256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c02de-a350-4f23-a0f3-1da9be0cd574 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:39.816599 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c02de-a350-4f23-a0f3-1da9be0cd574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:39.859952 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-3c3c02de-a350-4f23-a0f3-1da9be0cd574 None None] MFA Rules not processed for user `955a027a268a4957b675bc0d366586dd`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:58:39.859952 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-3c3c02de-a350-4f23-a0f3-1da9be0cd574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:39.928323 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1195/2395] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:58:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:58:39.939847 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0a7b6-9af7-46db-b3fd-84e44ac809b7 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:39.941670 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-32f0a7b6-9af7-46db-b3fd-84e44ac809b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:40.006310 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0a7b6-9af7-46db-b3fd-84e44ac809b7 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:40.010031 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb30b0a-84a8-4fbc-9982-d053c82255ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:40.010632 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb30b0a-84a8-4fbc-9982-d053c82255ba service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:40.010923 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb30b0a-84a8-4fbc-9982-d053c82255ba service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:40.011201 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb30b0a-84a8-4fbc-9982-d053c82255ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:40.020563 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb30b0a-84a8-4fbc-9982-d053c82255ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:40.022056 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb30b0a-84a8-4fbc-9982-d053c82255ba service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:40.033468 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1201/2396] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:58:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:58:40.059055 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c02de-a350-4f23-a0f3-1da9be0cd574 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:40.079480 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:58:40.127269 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c02de-a350-4f23-a0f3-1da9be0cd574 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:40.132087 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3b2d3-860c-43d8-9ac8-7fc56bcefb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:40.132724 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3b2d3-860c-43d8-9ac8-7fc56bcefb34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:40.133142 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3b2d3-860c-43d8-9ac8-7fc56bcefb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:40.133449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3b2d3-860c-43d8-9ac8-7fc56bcefb34 admin admin] PATH_INFO: `/v3/users/955a027a268a4957b675bc0d366586dd` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:40.134652 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a3b2d3-860c-43d8-9ac8-7fc56bcefb34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=955a027a268a4957b675bc0d366586dd)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:40.136565 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a3b2d3-860c-43d8-9ac8-7fc56bcefb34 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:40.188031 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-81a3b2d3-860c-43d8-9ac8-7fc56bcefb34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '955a027a268a4957b675bc0d366586dd'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:40.194357 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-81a3b2d3-860c-43d8-9ac8-7fc56bcefb34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '955a027a268a4957b675bc0d366586dd'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:40.195064 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-81a3b2d3-860c-43d8-9ac8-7fc56bcefb34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '955a027a268a4957b675bc0d366586dd'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:40.195785 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-81a3b2d3-860c-43d8-9ac8-7fc56bcefb34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '955a027a268a4957b675bc0d366586dd'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:40.209481 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-81a3b2d3-860c-43d8-9ac8-7fc56bcefb34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '955a027a268a4957b675bc0d366586dd'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:40.222258 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1196/2397] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:58:40 2022] DELETE /identity/v3/users/955a027a268a4957b675bc0d366586dd => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:58:40.226868 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af352c0-c6b7-45df-a2e1-b2bcb664d37e None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:40.227154 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af352c0-c6b7-45df-a2e1-b2bcb664d37e None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:40.227427 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af352c0-c6b7-45df-a2e1-b2bcb664d37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:40.247865 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-1af352c0-c6b7-45df-a2e1-b2bcb664d37e None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:58:40.249289 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-1af352c0-c6b7-45df-a2e1-b2bcb664d37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:40.308642 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1202/2398] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:58:40.319073 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3b2d3-860c-43d8-9ac8-7fc56bcefb34 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:40.320524 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-81a3b2d3-860c-43d8-9ac8-7fc56bcefb34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:40.384292 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3b2d3-860c-43d8-9ac8-7fc56bcefb34 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:40.387916 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530fbb31-e99d-4dbd-9506-f66a7d811b7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:40.389686 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fbb31-e99d-4dbd-9506-f66a7d811b7b service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:40.389988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fbb31-e99d-4dbd-9506-f66a7d811b7b service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:40.390265 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fbb31-e99d-4dbd-9506-f66a7d811b7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:40.399427 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530fbb31-e99d-4dbd-9506-f66a7d811b7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:40.400917 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530fbb31-e99d-4dbd-9506-f66a7d811b7b service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:40.411811 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1197/2399] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:58:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:58:40.693747 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af352c0-c6b7-45df-a2e1-b2bcb664d37e None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:40.695212 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-1af352c0-c6b7-45df-a2e1-b2bcb664d37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:40.708008 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af352c0-c6b7-45df-a2e1-b2bcb664d37e None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:40.712876 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb509c1-b86e-4d36-8039-5a64b6bcc052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:40.713462 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb509c1-b86e-4d36-8039-5a64b6bcc052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:40.713822 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb509c1-b86e-4d36-8039-5a64b6bcc052 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:40.714103 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb509c1-b86e-4d36-8039-5a64b6bcc052 admin admin] PATH_INFO: `/v3/projects/fdb8a6b1c85a4fa68d3a0c8af2b7ef6e` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:40.715267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb509c1-b86e-4d36-8039-5a64b6bcc052 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdb8a6b1c85a4fa68d3a0c8af2b7ef6e)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:40.717966 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb509c1-b86e-4d36-8039-5a64b6bcc052 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:40.768790 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:58:40.770249 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-1bb509c1-b86e-4d36-8039-5a64b6bcc052 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdb8a6b1c85a4fa68d3a0c8af2b7ef6e', 'request_id': 'req-1bb509c1-b86e-4d36-8039-5a64b6bcc052'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:40.778136 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-1bb509c1-b86e-4d36-8039-5a64b6bcc052 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdb8a6b1c85a4fa68d3a0c8af2b7ef6e', 'request_id': 'req-1bb509c1-b86e-4d36-8039-5a64b6bcc052'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:40.787175 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-1bb509c1-b86e-4d36-8039-5a64b6bcc052 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdb8a6b1c85a4fa68d3a0c8af2b7ef6e', 'request_id': 'req-1bb509c1-b86e-4d36-8039-5a64b6bcc052'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:40.800783 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-1bb509c1-b86e-4d36-8039-5a64b6bcc052 admin admin] The token cache is being invalidate because project fdb8a6b1c85a4fa68d3a0c8af2b7ef6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:58:40.801117 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-1bb509c1-b86e-4d36-8039-5a64b6bcc052 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:40.801857 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-1bb509c1-b86e-4d36-8039-5a64b6bcc052 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:40.803390 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1203/2400] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:58:40 2022] DELETE /identity/v3/projects/fdb8a6b1c85a4fa68d3a0c8af2b7ef6e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:58:40.808352 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1961898-8f36-4c58-ab6e-ba8b6ed987d2 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:40.808841 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1961898-8f36-4c58-ab6e-ba8b6ed987d2 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:40.809120 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1961898-8f36-4c58-ab6e-ba8b6ed987d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:40.829840 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-b1961898-8f36-4c58-ab6e-ba8b6ed987d2 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:58:40.831057 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-b1961898-8f36-4c58-ab6e-ba8b6ed987d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:40.864721 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:58:40.899255 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1198/2401] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:58:40.906999 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a253546-30bc-48fd-a4a3-2fcca20a6e48 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:40.907290 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a253546-30bc-48fd-a4a3-2fcca20a6e48 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:40.907569 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a253546-30bc-48fd-a4a3-2fcca20a6e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:40.928385 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-0a253546-30bc-48fd-a4a3-2fcca20a6e48 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:58:40.929643 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-0a253546-30bc-48fd-a4a3-2fcca20a6e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:40.938265 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1204/2402] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:58:40.942686 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1961898-8f36-4c58-ab6e-ba8b6ed987d2 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:40.953317 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1961898-8f36-4c58-ab6e-ba8b6ed987d2 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:40.957915 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907ccab-1761-4a25-a407-d6f77708f70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:40.958511 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907ccab-1761-4a25-a407-d6f77708f70a admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:40.958874 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907ccab-1761-4a25-a407-d6f77708f70a admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:40.959147 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907ccab-1761-4a25-a407-d6f77708f70a admin admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:40.959950 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907ccab-1761-4a25-a407-d6f77708f70a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 12:58:40.960338 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907ccab-1761-4a25-a407-d6f77708f70a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:40.962093 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907ccab-1761-4a25-a407-d6f77708f70a admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:40.974660 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1199/2403] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 12:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 12:58:40.979031 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a253546-30bc-48fd-a4a3-2fcca20a6e48 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:40.988395 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a253546-30bc-48fd-a4a3-2fcca20a6e48 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:40.993113 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839d4ed-c7ea-492b-84ef-4f73557feeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:40.993751 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839d4ed-c7ea-492b-84ef-4f73557feeb2 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:40.994035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839d4ed-c7ea-492b-84ef-4f73557feeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:40.994311 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839d4ed-c7ea-492b-84ef-4f73557feeb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:40.994972 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839d4ed-c7ea-492b-84ef-4f73557feeb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:40.996870 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839d4ed-c7ea-492b-84ef-4f73557feeb2 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:41.025747 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1205/2404] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 12:58:40 2022] POST /identity/v3/projects => generated 399 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:58:41.030758 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907ccab-1761-4a25-a407-d6f77708f70a admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:41.042956 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907ccab-1761-4a25-a407-d6f77708f70a admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:41.101414 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1c54a-e2ff-429b-9a2a-7741dace9cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:41.102052 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1c54a-e2ff-429b-9a2a-7741dace9cf8 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:41.102333 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1c54a-e2ff-429b-9a2a-7741dace9cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:41.102737 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1c54a-e2ff-429b-9a2a-7741dace9cf8 admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:41.103363 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1c54a-e2ff-429b-9a2a-7741dace9cf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:41.105596 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1c54a-e2ff-429b-9a2a-7741dace9cf8 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:41.127838 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1200/2405] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 12:58:41 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 12:58:41.132389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839d4ed-c7ea-492b-84ef-4f73557feeb2 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:41.143601 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839d4ed-c7ea-492b-84ef-4f73557feeb2 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:41.148277 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddde155-0cc2-47e1-a236-585b51a0e504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:41.148936 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddde155-0cc2-47e1-a236-585b51a0e504 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:41.149211 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddde155-0cc2-47e1-a236-585b51a0e504 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:41.149480 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddde155-0cc2-47e1-a236-585b51a0e504 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:41.150206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddde155-0cc2-47e1-a236-585b51a0e504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:41.151798 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddde155-0cc2-47e1-a236-585b51a0e504 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:41.162495 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1206/2406] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:58:41.166822 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1c54a-e2ff-429b-9a2a-7741dace9cf8 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:41.178137 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1c54a-e2ff-429b-9a2a-7741dace9cf8 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:41.182896 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd38f2-a809-4180-805d-9c0047ea3cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:41.183517 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd38f2-a809-4180-805d-9c0047ea3cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:41.183796 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd38f2-a809-4180-805d-9c0047ea3cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:41.184069 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd38f2-a809-4180-805d-9c0047ea3cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:41.184765 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd38f2-a809-4180-805d-9c0047ea3cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:41.186881 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd38f2-a809-4180-805d-9c0047ea3cd9 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:41.197821 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1201/2407] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 12:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 12:58:41.202832 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddde155-0cc2-47e1-a236-585b51a0e504 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:41.213810 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddde155-0cc2-47e1-a236-585b51a0e504 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:41.219451 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072f43e-64c1-4804-82cd-1e4acc4242f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:41.220152 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072f43e-64c1-4804-82cd-1e4acc4242f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:41.220438 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072f43e-64c1-4804-82cd-1e4acc4242f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:41.220784 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072f43e-64c1-4804-82cd-1e4acc4242f8 admin admin] PATH_INFO: `/v3/projects/071ef0ac9639465abe084c5391fc3775/users/3de80e2ddb7c4cbdb7a2fc6eec7186e9/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:41.238955 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072f43e-64c1-4804-82cd-1e4acc4242f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=071ef0ac9639465abe084c5391fc3775, user_id=3de80e2ddb7c4cbdb7a2fc6eec7186e9, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:41.244222 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072f43e-64c1-4804-82cd-1e4acc4242f8 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:41.263354 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1207/2408] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 12:58:41 2022] PUT /identity/v3/projects/071ef0ac9639465abe084c5391fc3775/users/3de80e2ddb7c4cbdb7a2fc6eec7186e9/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:58:41.279919 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7208bb-4879-4aaf-a55d-636cc15c409d None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:41.280433 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7208bb-4879-4aaf-a55d-636cc15c409d None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:41.281037 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7208bb-4879-4aaf-a55d-636cc15c409d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:41.326105 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-3a7208bb-4879-4aaf-a55d-636cc15c409d None None] MFA Rules not processed for user `3de80e2ddb7c4cbdb7a2fc6eec7186e9`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:58:41.328183 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-3a7208bb-4879-4aaf-a55d-636cc15c409d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:41.403843 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1202/2409] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:58:41 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:58:41.416445 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072f43e-64c1-4804-82cd-1e4acc4242f8 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:41.418215 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-e072f43e-64c1-4804-82cd-1e4acc4242f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:41.486788 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072f43e-64c1-4804-82cd-1e4acc4242f8 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:41.490735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c002eea-36d2-449b-a032-4bbaa836b723 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:41.491310 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c002eea-36d2-449b-a032-4bbaa836b723 service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:41.491591 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c002eea-36d2-449b-a032-4bbaa836b723 service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:41.491868 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c002eea-36d2-449b-a032-4bbaa836b723 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:41.501624 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c002eea-36d2-449b-a032-4bbaa836b723 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:41.503063 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c002eea-36d2-449b-a032-4bbaa836b723 service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:41.512158 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1208/2410] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:58:41 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:58:46.497070 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7208bb-4879-4aaf-a55d-636cc15c409d None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:46.536956 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:58:46.561197 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7208bb-4879-4aaf-a55d-636cc15c409d None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:46.565695 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871b777-a44d-4288-8d3a-82846901a3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:46.566326 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871b777-a44d-4288-8d3a-82846901a3a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:46.566602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871b777-a44d-4288-8d3a-82846901a3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:46.566873 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871b777-a44d-4288-8d3a-82846901a3a6 admin admin] PATH_INFO: `/v3/users/3de80e2ddb7c4cbdb7a2fc6eec7186e9` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:46.568029 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871b777-a44d-4288-8d3a-82846901a3a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3de80e2ddb7c4cbdb7a2fc6eec7186e9)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:46.569970 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871b777-a44d-4288-8d3a-82846901a3a6 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:46.615354 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-e871b777-a44d-4288-8d3a-82846901a3a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3de80e2ddb7c4cbdb7a2fc6eec7186e9'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:46.622719 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-e871b777-a44d-4288-8d3a-82846901a3a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3de80e2ddb7c4cbdb7a2fc6eec7186e9'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:46.623542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-e871b777-a44d-4288-8d3a-82846901a3a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3de80e2ddb7c4cbdb7a2fc6eec7186e9'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:46.624180 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-e871b777-a44d-4288-8d3a-82846901a3a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3de80e2ddb7c4cbdb7a2fc6eec7186e9'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:46.636121 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-e871b777-a44d-4288-8d3a-82846901a3a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3de80e2ddb7c4cbdb7a2fc6eec7186e9'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:46.648324 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1203/2411] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 12:58:46 2022] DELETE /identity/v3/users/3de80e2ddb7c4cbdb7a2fc6eec7186e9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:58:46.652774 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca8985-c94e-4b86-b0eb-dcc5191ec037 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:46.653229 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca8985-c94e-4b86-b0eb-dcc5191ec037 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:46.653339 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca8985-c94e-4b86-b0eb-dcc5191ec037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:46.673726 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-6cca8985-c94e-4b86-b0eb-dcc5191ec037 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:58:46.674942 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-6cca8985-c94e-4b86-b0eb-dcc5191ec037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:46.733178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1209/2412] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:58:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:58:46.742875 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871b777-a44d-4288-8d3a-82846901a3a6 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:46.744416 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-e871b777-a44d-4288-8d3a-82846901a3a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:46.800453 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871b777-a44d-4288-8d3a-82846901a3a6 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:46.803931 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d58ad-3631-4110-849b-f191a23878af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:46.804536 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d58ad-3631-4110-849b-f191a23878af service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:46.804812 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d58ad-3631-4110-849b-f191a23878af service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:46.805081 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d58ad-3631-4110-849b-f191a23878af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:46.814058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d58ad-3631-4110-849b-f191a23878af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:46.815469 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d58ad-3631-4110-849b-f191a23878af service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:46.824631 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1204/2413] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:58:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:58:47.155143 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca8985-c94e-4b86-b0eb-dcc5191ec037 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:47.156753 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-6cca8985-c94e-4b86-b0eb-dcc5191ec037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:47.168649 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca8985-c94e-4b86-b0eb-dcc5191ec037 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:47.173303 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37309839-f160-4f30-aa2b-c71f6cb8ce89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:47.173978 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37309839-f160-4f30-aa2b-c71f6cb8ce89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:47.174259 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37309839-f160-4f30-aa2b-c71f6cb8ce89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:47.174536 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37309839-f160-4f30-aa2b-c71f6cb8ce89 admin admin] PATH_INFO: `/v3/projects/071ef0ac9639465abe084c5391fc3775` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:47.175688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37309839-f160-4f30-aa2b-c71f6cb8ce89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=071ef0ac9639465abe084c5391fc3775)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:47.177737 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37309839-f160-4f30-aa2b-c71f6cb8ce89 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:47.190204 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:58:47.239622 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-37309839-f160-4f30-aa2b-c71f6cb8ce89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '071ef0ac9639465abe084c5391fc3775', 'request_id': 'req-37309839-f160-4f30-aa2b-c71f6cb8ce89'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:47.245928 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-37309839-f160-4f30-aa2b-c71f6cb8ce89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '071ef0ac9639465abe084c5391fc3775', 'request_id': 'req-37309839-f160-4f30-aa2b-c71f6cb8ce89'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:47.254415 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-37309839-f160-4f30-aa2b-c71f6cb8ce89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '071ef0ac9639465abe084c5391fc3775', 'request_id': 'req-37309839-f160-4f30-aa2b-c71f6cb8ce89'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:47.265208 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-37309839-f160-4f30-aa2b-c71f6cb8ce89 admin admin] The token cache is being invalidate because project 071ef0ac9639465abe084c5391fc3775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 12:58:47.265518 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-37309839-f160-4f30-aa2b-c71f6cb8ce89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:47.266132 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-37309839-f160-4f30-aa2b-c71f6cb8ce89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 12:58:47.267653 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1210/2414] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 12:58:47 2022] DELETE /identity/v3/projects/071ef0ac9639465abe084c5391fc3775 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 12:58:51.285092 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b2374-7281-4859-b65c-aa76fa0f34eb None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:51.285573 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b2374-7281-4859-b65c-aa76fa0f34eb None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:51.285690 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b2374-7281-4859-b65c-aa76fa0f34eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:51.305214 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-477b2374-7281-4859-b65c-aa76fa0f34eb None None] MFA Rules not processed for user `831d8776102847efbdae901f2b863226`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:58:51.306483 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-477b2374-7281-4859-b65c-aa76fa0f34eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:51.361949 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1205/2415] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 12:58:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:58:51.558325 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37309839-f160-4f30-aa2b-c71f6cb8ce89 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:58:51.559828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-37309839-f160-4f30-aa2b-c71f6cb8ce89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:51.630702 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37309839-f160-4f30-aa2b-c71f6cb8ce89 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:58:51.634573 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a399d-2f88-4ed1-903b-a0cbde4386e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:58:51.635185 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a399d-2f88-4ed1-903b-a0cbde4386e4 service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:58:51.635461 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a399d-2f88-4ed1-903b-a0cbde4386e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:58:51.635731 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a399d-2f88-4ed1-903b-a0cbde4386e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:58:51.637572 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-3d2a399d-2f88-4ed1-903b-a0cbde4386e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:58:51.647973 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a399d-2f88-4ed1-903b-a0cbde4386e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:58:51.649399 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a399d-2f88-4ed1-903b-a0cbde4386e4 service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:58:51.657650 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1211/2416] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:58:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:59:01.354771 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:01.654435 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=46,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:07.757928 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b2374-7281-4859-b65c-aa76fa0f34eb None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:07.759355 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-477b2374-7281-4859-b65c-aa76fa0f34eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:07.779037 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b2374-7281-4859-b65c-aa76fa0f34eb None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:07.783713 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd99a7-1ae9-456d-99bd-b1a3dc78962b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:07.784331 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd99a7-1ae9-456d-99bd-b1a3dc78962b service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:07.784605 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd99a7-1ae9-456d-99bd-b1a3dc78962b service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:07.784872 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd99a7-1ae9-456d-99bd-b1a3dc78962b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:07.788881 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-4ddd99a7-1ae9-456d-99bd-b1a3dc78962b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:07.852547 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd99a7-1ae9-456d-99bd-b1a3dc78962b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:07.854001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd99a7-1ae9-456d-99bd-b1a3dc78962b service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:07.863520 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1206/2417] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:59:17.859270 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=30 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:20.300839 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa877d-a379-4077-8509-418f7e75e82b None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:20.301331 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa877d-a379-4077-8509-418f7e75e82b None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:20.301428 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa877d-a379-4077-8509-418f7e75e82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:20.321171 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-36aa877d-a379-4077-8509-418f7e75e82b None None] MFA Rules not processed for user `a994c976b95744ed9723bf9c4386bde1`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:20.322436 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-36aa877d-a379-4077-8509-418f7e75e82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:20.377095 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1212/2418] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Aug 3 12:59:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 12:59:20.423049 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd99a7-1ae9-456d-99bd-b1a3dc78962b service neutron] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:20.424481 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-4ddd99a7-1ae9-456d-99bd-b1a3dc78962b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:20.492025 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd99a7-1ae9-456d-99bd-b1a3dc78962b service neutron] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:20.496995 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5244f6-3bd3-4fd8-bcc3-55f1bf831c55 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67df369737ea4c83bae134f4bf2de20d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:20.498405 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5244f6-3bd3-4fd8-bcc3-55f1bf831c55 service swift] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:20.498676 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5244f6-3bd3-4fd8-bcc3-55f1bf831c55 service swift] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:20.498948 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5244f6-3bd3-4fd8-bcc3-55f1bf831c55 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:20.507242 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5244f6-3bd3-4fd8-bcc3-55f1bf831c55 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:20.508818 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5244f6-3bd3-4fd8-bcc3-55f1bf831c55 service swift] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:20.517982 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1207/2419] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Aug 3 12:59:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 12:59:30.370114 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=25 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:30.514732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=32 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:34.719064 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa877d-a379-4077-8509-418f7e75e82b None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:34.720558 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-36aa877d-a379-4077-8509-418f7e75e82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:34.861640 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa877d-a379-4077-8509-418f7e75e82b None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:34.866588 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abc455-307d-4af6-bf66-d3515a373500 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56847173abb48d39c0ee6fb9cdbbbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:34.867194 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abc455-307d-4af6-bf66-d3515a373500 service placement] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:34.867474 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abc455-307d-4af6-bf66-d3515a373500 service placement] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:34.867744 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abc455-307d-4af6-bf66-d3515a373500 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:34.874870 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-58abc455-307d-4af6-bf66-d3515a373500 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:34.887063 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abc455-307d-4af6-bf66-d3515a373500 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:34.888720 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abc455-307d-4af6-bf66-d3515a373500 service placement] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:34.898415 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1213/2420] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 12:59:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 12:59:38.810012 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4045e33-2f44-4e96-a837-1d2b669fe811 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:38.810551 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4045e33-2f44-4e96-a837-1d2b669fe811 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:38.810551 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4045e33-2f44-4e96-a837-1d2b669fe811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:38.849109 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-e4045e33-2f44-4e96-a837-1d2b669fe811 None None] MFA Rules not processed for user `a994c976b95744ed9723bf9c4386bde1`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 12:59:38.851282 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-e4045e33-2f44-4e96-a837-1d2b669fe811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 12:59:38.867586 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1208/2421] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Aug 3 12:59:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 12:59:38.884279 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abc455-307d-4af6-bf66-d3515a373500 service placement] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 12:59:38.897441 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abc455-307d-4af6-bf66-d3515a373500 service placement] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 12:59:38.902888 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4feb34d-d043-4c14-b9f5-73dd9f8b1e0a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67df369737ea4c83bae134f4bf2de20d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 12:59:38.904347 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4feb34d-d043-4c14-b9f5-73dd9f8b1e0a service swift] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 12:59:38.904860 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4feb34d-d043-4c14-b9f5-73dd9f8b1e0a service swift] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 12:59:38.905327 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4feb34d-d043-4c14-b9f5-73dd9f8b1e0a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 12:59:38.914505 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4feb34d-d043-4c14-b9f5-73dd9f8b1e0a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 12:59:38.916348 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4feb34d-d043-4c14-b9f5-73dd9f8b1e0a service swift] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 12:59:38.925088 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1214/2422] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Aug 3 12:59:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 12:59:48.861782 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=10 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 12:59:48.921706 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=69 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:02.268426 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644a763-8070-4958-8ff9-35ed2a260e2b None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:02.268918 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644a763-8070-4958-8ff9-35ed2a260e2b None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:02.269189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644a763-8070-4958-8ff9-35ed2a260e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:02.290314 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-a644a763-8070-4958-8ff9-35ed2a260e2b None None] MFA Rules not processed for user `a994c976b95744ed9723bf9c4386bde1`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:02.291530 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-a644a763-8070-4958-8ff9-35ed2a260e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:02.298775 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1209/2423] 10.222.0.46 () {58 vars in 967 bytes} [Wed Aug 3 13:00:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:02.312100 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4feb34d-d043-4c14-b9f5-73dd9f8b1e0a service swift] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:02.322754 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4feb34d-d043-4c14-b9f5-73dd9f8b1e0a service swift] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:02.328644 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aeac14-1df0-43d6-aa61-f3cbbd999ff3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67df369737ea4c83bae134f4bf2de20d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:02.329395 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aeac14-1df0-43d6-aa61-f3cbbd999ff3 service swift] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:02.329724 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aeac14-1df0-43d6-aa61-f3cbbd999ff3 service swift] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:02.330032 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aeac14-1df0-43d6-aa61-f3cbbd999ff3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:02.338813 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aeac14-1df0-43d6-aa61-f3cbbd999ff3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:02.340410 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aeac14-1df0-43d6-aa61-f3cbbd999ff3 service swift] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:02.349668 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1215/2424] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Aug 3 13:00:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 03 13:00:12.285415 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:12.345738 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=6 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:13.177317 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644a763-8070-4958-8ff9-35ed2a260e2b None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:13.196636 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644a763-8070-4958-8ff9-35ed2a260e2b None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:13.200450 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c8df6-3a30-4972-9738-01e9bbf2ad40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:13.201122 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c8df6-3a30-4972-9738-01e9bbf2ad40 service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:13.201552 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c8df6-3a30-4972-9738-01e9bbf2ad40 service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:13.201817 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c8df6-3a30-4972-9738-01e9bbf2ad40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:13.203580 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-935c8df6-3a30-4972-9738-01e9bbf2ad40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:13.286294 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c8df6-3a30-4972-9738-01e9bbf2ad40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:13.287771 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c8df6-3a30-4972-9738-01e9bbf2ad40 service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:13.307010 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1210/2425] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:16.511103 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aeac14-1df0-43d6-aa61-f3cbbd999ff3 service swift] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:16.512661 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-10aeac14-1df0-43d6-aa61-f3cbbd999ff3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:16.532748 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aeac14-1df0-43d6-aa61-f3cbbd999ff3 service swift] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:16.537509 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa87439-97fe-455e-a572-d18481c664c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:16.538169 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa87439-97fe-455e-a572-d18481c664c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:16.538530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa87439-97fe-455e-a572-d18481c664c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:16.538814 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa87439-97fe-455e-a572-d18481c664c3 admin admin] PATH_INFO: `/v3/users/e3eba8e63be14907a364797a0189290c` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:16.540048 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa87439-97fe-455e-a572-d18481c664c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3eba8e63be14907a364797a0189290c)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:16.542015 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa87439-97fe-455e-a572-d18481c664c3 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:16.590266 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-caa87439-97fe-455e-a572-d18481c664c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3eba8e63be14907a364797a0189290c'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:16.590984 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-caa87439-97fe-455e-a572-d18481c664c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3eba8e63be14907a364797a0189290c'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:16.591650 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-caa87439-97fe-455e-a572-d18481c664c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3eba8e63be14907a364797a0189290c'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:16.604076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-caa87439-97fe-455e-a572-d18481c664c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3eba8e63be14907a364797a0189290c'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:16.611136 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-caa87439-97fe-455e-a572-d18481c664c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3eba8e63be14907a364797a0189290c'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:16.624324 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1216/2426] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:16 2022] DELETE /identity/v3/users/e3eba8e63be14907a364797a0189290c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:16.805923 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c8df6-3a30-4972-9738-01e9bbf2ad40 service neutron] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:16.817249 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c8df6-3a30-4972-9738-01e9bbf2ad40 service neutron] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:16.875867 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afdf914-16af-42e8-93f8-57d35fe04425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:16.876501 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdf914-16af-42e8-93f8-57d35fe04425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:16.876777 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdf914-16af-42e8-93f8-57d35fe04425 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:16.877048 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdf914-16af-42e8-93f8-57d35fe04425 admin admin] PATH_INFO: `/v3/projects/0bab88361acf4566b1bc3ab503c29540` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:16.878236 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afdf914-16af-42e8-93f8-57d35fe04425 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bab88361acf4566b1bc3ab503c29540)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:16.880138 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afdf914-16af-42e8-93f8-57d35fe04425 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:16.925883 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-8afdf914-16af-42e8-93f8-57d35fe04425 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bab88361acf4566b1bc3ab503c29540', 'request_id': 'req-8afdf914-16af-42e8-93f8-57d35fe04425'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:16.931782 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-8afdf914-16af-42e8-93f8-57d35fe04425 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bab88361acf4566b1bc3ab503c29540', 'request_id': 'req-8afdf914-16af-42e8-93f8-57d35fe04425'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:16.936294 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:16.939074 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-8afdf914-16af-42e8-93f8-57d35fe04425 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bab88361acf4566b1bc3ab503c29540', 'request_id': 'req-8afdf914-16af-42e8-93f8-57d35fe04425'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:16.951866 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-8afdf914-16af-42e8-93f8-57d35fe04425 admin admin] The token cache is being invalidate because project 0bab88361acf4566b1bc3ab503c29540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:16.952187 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-8afdf914-16af-42e8-93f8-57d35fe04425 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:16.952810 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-8afdf914-16af-42e8-93f8-57d35fe04425 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:16.954368 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1211/2427] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:16 2022] DELETE /identity/v3/projects/0bab88361acf4566b1bc3ab503c29540 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:16.959435 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f87e5-3517-485c-b666-e675ac93a048 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:16.959729 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f87e5-3517-485c-b666-e675ac93a048 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:16.960007 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f87e5-3517-485c-b666-e675ac93a048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:17.019370 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-a26f87e5-3517-485c-b666-e675ac93a048 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:17.020572 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-a26f87e5-3517-485c-b666-e675ac93a048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:17.078276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1217/2428] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:17.086247 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbce457-f2e1-4ba6-91ec-8ae95e82b7ed None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:17.086537 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbce457-f2e1-4ba6-91ec-8ae95e82b7ed None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:17.086816 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbce457-f2e1-4ba6-91ec-8ae95e82b7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:17.106019 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-5dbce457-f2e1-4ba6-91ec-8ae95e82b7ed None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:17.107736 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-5dbce457-f2e1-4ba6-91ec-8ae95e82b7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:17.115501 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1212/2429] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:17.119755 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f87e5-3517-485c-b666-e675ac93a048 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:17.129936 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f87e5-3517-485c-b666-e675ac93a048 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:17.134762 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac637f7-435d-4b34-9a6a-bc91b5fad4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:17.135358 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac637f7-435d-4b34-9a6a-bc91b5fad4e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:17.135633 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac637f7-435d-4b34-9a6a-bc91b5fad4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:17.135900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac637f7-435d-4b34-9a6a-bc91b5fad4e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:17.136613 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac637f7-435d-4b34-9a6a-bc91b5fad4e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:00:17.136909 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac637f7-435d-4b34-9a6a-bc91b5fad4e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:17.138590 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac637f7-435d-4b34-9a6a-bc91b5fad4e9 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:17.149854 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1218/2430] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 13:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:00:17.153914 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbce457-f2e1-4ba6-91ec-8ae95e82b7ed None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:17.162922 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbce457-f2e1-4ba6-91ec-8ae95e82b7ed None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:17.167561 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666a490-661b-4ca5-8980-08715aca8184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:17.168152 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666a490-661b-4ca5-8980-08715aca8184 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:17.168432 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666a490-661b-4ca5-8980-08715aca8184 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:17.168707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666a490-661b-4ca5-8980-08715aca8184 admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:17.169400 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666a490-661b-4ca5-8980-08715aca8184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:17.171904 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666a490-661b-4ca5-8980-08715aca8184 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:17.198549 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1213/2431] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:17 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:00:17.203015 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac637f7-435d-4b34-9a6a-bc91b5fad4e9 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:17.213067 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac637f7-435d-4b34-9a6a-bc91b5fad4e9 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:17.238736 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:17.270215 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d0cc6-e728-4950-8eb1-cd6308dce687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:17.270837 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d0cc6-e728-4950-8eb1-cd6308dce687 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:17.271115 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d0cc6-e728-4950-8eb1-cd6308dce687 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:17.271390 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d0cc6-e728-4950-8eb1-cd6308dce687 admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:17.272096 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d0cc6-e728-4950-8eb1-cd6308dce687 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:17.274040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d0cc6-e728-4950-8eb1-cd6308dce687 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:17.295632 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1219/2432] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:17 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:17.299766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666a490-661b-4ca5-8980-08715aca8184 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:17.309942 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666a490-661b-4ca5-8980-08715aca8184 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:17.314666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c179b3-e266-423c-bf71-c8537f722843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:17.315267 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c179b3-e266-423c-bf71-c8537f722843 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:17.315545 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c179b3-e266-423c-bf71-c8537f722843 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:17.315817 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c179b3-e266-423c-bf71-c8537f722843 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:17.316513 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c179b3-e266-423c-bf71-c8537f722843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:17.318142 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c179b3-e266-423c-bf71-c8537f722843 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:17.328141 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1214/2433] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:17.331906 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d0cc6-e728-4950-8eb1-cd6308dce687 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:17.342573 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d0cc6-e728-4950-8eb1-cd6308dce687 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:17.347359 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b1c38-0e25-4bb7-bb2d-07b1e996fda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:17.347963 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b1c38-0e25-4bb7-bb2d-07b1e996fda6 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:17.348244 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b1c38-0e25-4bb7-bb2d-07b1e996fda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:17.348519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b1c38-0e25-4bb7-bb2d-07b1e996fda6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:17.349218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b1c38-0e25-4bb7-bb2d-07b1e996fda6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:17.350832 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b1c38-0e25-4bb7-bb2d-07b1e996fda6 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:17.362123 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1220/2434] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:17.366255 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c179b3-e266-423c-bf71-c8537f722843 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:17.376329 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c179b3-e266-423c-bf71-c8537f722843 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:17.381028 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d212b4e-e88f-45ac-9781-dcddbab2c793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:17.381856 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d212b4e-e88f-45ac-9781-dcddbab2c793 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:17.382140 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d212b4e-e88f-45ac-9781-dcddbab2c793 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:17.382473 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d212b4e-e88f-45ac-9781-dcddbab2c793 admin admin] PATH_INFO: `/v3/projects/7b9dff2000db40b9af0d574199c3b371/users/744400af4de94c4886690b60830669a7/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:17.396931 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d212b4e-e88f-45ac-9781-dcddbab2c793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b9dff2000db40b9af0d574199c3b371, user_id=744400af4de94c4886690b60830669a7, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:17.399709 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d212b4e-e88f-45ac-9781-dcddbab2c793 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:17.413757 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1215/2435] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:17 2022] PUT /identity/v3/projects/7b9dff2000db40b9af0d574199c3b371/users/744400af4de94c4886690b60830669a7/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:17.425625 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029b00d-ff19-43d5-bb06-c109c1128648 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:17.425912 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029b00d-ff19-43d5-bb06-c109c1128648 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:17.426184 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029b00d-ff19-43d5-bb06-c109c1128648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:17.452874 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-e029b00d-ff19-43d5-bb06-c109c1128648 None None] MFA Rules not processed for user `744400af4de94c4886690b60830669a7`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:17.454075 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-e029b00d-ff19-43d5-bb06-c109c1128648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:17.517331 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1221/2436] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:00:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:17.528601 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d212b4e-e88f-45ac-9781-dcddbab2c793 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:17.531013 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-1d212b4e-e88f-45ac-9781-dcddbab2c793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:17.632429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d212b4e-e88f-45ac-9781-dcddbab2c793 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:17.638948 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adaa1db-1bae-4d0d-a568-5f9102247682 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:17.639546 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adaa1db-1bae-4d0d-a568-5f9102247682 service nova] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:17.639819 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adaa1db-1bae-4d0d-a568-5f9102247682 service nova] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:17.640087 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adaa1db-1bae-4d0d-a568-5f9102247682 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:17.648363 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adaa1db-1bae-4d0d-a568-5f9102247682 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:17.650059 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adaa1db-1bae-4d0d-a568-5f9102247682 service nova] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:17.660034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1216/2437] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:22.833794 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029b00d-ff19-43d5-bb06-c109c1128648 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:22.894573 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029b00d-ff19-43d5-bb06-c109c1128648 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:22.899094 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef2da1-4baa-446f-b6e0-525d7427d1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:22.899727 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef2da1-4baa-446f-b6e0-525d7427d1b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:22.900010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef2da1-4baa-446f-b6e0-525d7427d1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:22.900284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef2da1-4baa-446f-b6e0-525d7427d1b7 admin admin] PATH_INFO: `/v3/users/744400af4de94c4886690b60830669a7` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:22.901442 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef2da1-4baa-446f-b6e0-525d7427d1b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=744400af4de94c4886690b60830669a7)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:22.903391 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef2da1-4baa-446f-b6e0-525d7427d1b7 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:22.943258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:22.950663 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-86ef2da1-4baa-446f-b6e0-525d7427d1b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '744400af4de94c4886690b60830669a7'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:22.951573 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-86ef2da1-4baa-446f-b6e0-525d7427d1b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '744400af4de94c4886690b60830669a7'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:22.952198 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-86ef2da1-4baa-446f-b6e0-525d7427d1b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '744400af4de94c4886690b60830669a7'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:22.964068 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-86ef2da1-4baa-446f-b6e0-525d7427d1b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '744400af4de94c4886690b60830669a7'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:22.971167 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-86ef2da1-4baa-446f-b6e0-525d7427d1b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '744400af4de94c4886690b60830669a7'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:22.984455 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1222/2438] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:22 2022] DELETE /identity/v3/users/744400af4de94c4886690b60830669a7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:22.989143 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb006628-015f-4106-a314-bb6d7aa5392c None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:22.989682 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb006628-015f-4106-a314-bb6d7aa5392c None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:22.989682 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb006628-015f-4106-a314-bb6d7aa5392c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:23.008986 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-eb006628-015f-4106-a314-bb6d7aa5392c None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:23.010227 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-eb006628-015f-4106-a314-bb6d7aa5392c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:23.056376 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:23.073547 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1217/2439] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:00:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:23.083299 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef2da1-4baa-446f-b6e0-525d7427d1b7 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:23.084738 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-86ef2da1-4baa-446f-b6e0-525d7427d1b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:23.155601 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef2da1-4baa-446f-b6e0-525d7427d1b7 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:23.159326 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78142320-341a-4f9d-9cf9-50a257cecc40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:23.159941 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78142320-341a-4f9d-9cf9-50a257cecc40 service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:23.160225 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78142320-341a-4f9d-9cf9-50a257cecc40 service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:23.160503 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78142320-341a-4f9d-9cf9-50a257cecc40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:23.169374 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78142320-341a-4f9d-9cf9-50a257cecc40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:23.171379 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78142320-341a-4f9d-9cf9-50a257cecc40 service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:23.180737 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1223/2440] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:23.444309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb006628-015f-4106-a314-bb6d7aa5392c None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:23.445837 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-eb006628-015f-4106-a314-bb6d7aa5392c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:23.458242 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb006628-015f-4106-a314-bb6d7aa5392c None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:23.462938 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ead6f8-b662-4201-a347-495b4e5b581c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:23.463651 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ead6f8-b662-4201-a347-495b4e5b581c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:23.463994 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ead6f8-b662-4201-a347-495b4e5b581c admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:23.464340 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ead6f8-b662-4201-a347-495b4e5b581c admin admin] PATH_INFO: `/v3/projects/7b9dff2000db40b9af0d574199c3b371` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:23.465596 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ead6f8-b662-4201-a347-495b4e5b581c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b9dff2000db40b9af0d574199c3b371)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:23.468027 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ead6f8-b662-4201-a347-495b4e5b581c admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:23.516034 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-19ead6f8-b662-4201-a347-495b4e5b581c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b9dff2000db40b9af0d574199c3b371', 'request_id': 'req-19ead6f8-b662-4201-a347-495b4e5b581c'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:23.522159 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-19ead6f8-b662-4201-a347-495b4e5b581c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b9dff2000db40b9af0d574199c3b371', 'request_id': 'req-19ead6f8-b662-4201-a347-495b4e5b581c'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:23.527549 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-19ead6f8-b662-4201-a347-495b4e5b581c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b9dff2000db40b9af0d574199c3b371', 'request_id': 'req-19ead6f8-b662-4201-a347-495b4e5b581c'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:23.540474 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-19ead6f8-b662-4201-a347-495b4e5b581c admin admin] The token cache is being invalidate because project 7b9dff2000db40b9af0d574199c3b371 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:23.540783 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-19ead6f8-b662-4201-a347-495b4e5b581c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:23.541400 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-19ead6f8-b662-4201-a347-495b4e5b581c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:23.542944 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1218/2441] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:23 2022] DELETE /identity/v3/projects/7b9dff2000db40b9af0d574199c3b371 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:23.548471 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c3670-3e74-4490-8926-f69b2c5cef07 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:23.548763 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c3670-3e74-4490-8926-f69b2c5cef07 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:23.549073 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c3670-3e74-4490-8926-f69b2c5cef07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:23.568328 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-2e4c3670-3e74-4490-8926-f69b2c5cef07 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:23.569575 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-2e4c3670-3e74-4490-8926-f69b2c5cef07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:23.629656 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1224/2442] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:23.637794 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82664184-0863-471e-a62a-136c35061da8 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:23.638076 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82664184-0863-471e-a62a-136c35061da8 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:23.638348 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82664184-0863-471e-a62a-136c35061da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:23.659238 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-82664184-0863-471e-a62a-136c35061da8 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:23.660429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-82664184-0863-471e-a62a-136c35061da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:23.668160 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1219/2443] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:23.672980 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c3670-3e74-4490-8926-f69b2c5cef07 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:23.682999 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c3670-3e74-4490-8926-f69b2c5cef07 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:23.687684 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7baed-30a8-45f1-a1ef-55e3c44299d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:23.688353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7baed-30a8-45f1-a1ef-55e3c44299d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:23.688638 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7baed-30a8-45f1-a1ef-55e3c44299d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:23.688917 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7baed-30a8-45f1-a1ef-55e3c44299d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:23.689657 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa7baed-30a8-45f1-a1ef-55e3c44299d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:00:23.689969 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa7baed-30a8-45f1-a1ef-55e3c44299d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:23.691567 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa7baed-30a8-45f1-a1ef-55e3c44299d4 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:23.703888 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1225/2444] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 13:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:00:23.708295 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82664184-0863-471e-a62a-136c35061da8 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:23.718407 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82664184-0863-471e-a62a-136c35061da8 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:23.723214 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fef167-5efa-4ef6-adbc-5700eda1ba6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:23.723816 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fef167-5efa-4ef6-adbc-5700eda1ba6c admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:23.724095 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fef167-5efa-4ef6-adbc-5700eda1ba6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:23.724369 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fef167-5efa-4ef6-adbc-5700eda1ba6c admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:23.725035 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fef167-5efa-4ef6-adbc-5700eda1ba6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:23.726960 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fef167-5efa-4ef6-adbc-5700eda1ba6c admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:23.753934 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1220/2445] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:23 2022] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:23.758485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7baed-30a8-45f1-a1ef-55e3c44299d4 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:23.769172 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7baed-30a8-45f1-a1ef-55e3c44299d4 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:23.801442 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:23.829531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf170ec-b30a-487e-a501-0eb29d826138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:23.830160 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf170ec-b30a-487e-a501-0eb29d826138 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:23.830446 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf170ec-b30a-487e-a501-0eb29d826138 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:23.830723 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf170ec-b30a-487e-a501-0eb29d826138 admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:23.831395 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf170ec-b30a-487e-a501-0eb29d826138 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:23.833339 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf170ec-b30a-487e-a501-0eb29d826138 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:23.854501 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1226/2446] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:23 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:23.858768 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fef167-5efa-4ef6-adbc-5700eda1ba6c admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:23.869037 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fef167-5efa-4ef6-adbc-5700eda1ba6c admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:23.873772 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4782ea-199f-4221-8206-314b45dcd480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:23.874371 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4782ea-199f-4221-8206-314b45dcd480 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:23.874651 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4782ea-199f-4221-8206-314b45dcd480 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:23.874924 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4782ea-199f-4221-8206-314b45dcd480 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:23.875616 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4782ea-199f-4221-8206-314b45dcd480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:23.877183 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4782ea-199f-4221-8206-314b45dcd480 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:23.887285 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1221/2447] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:23.891686 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf170ec-b30a-487e-a501-0eb29d826138 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:23.901898 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf170ec-b30a-487e-a501-0eb29d826138 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:23.907604 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415b3ee-ef6f-4937-b3a5-5c36d38c51f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:23.908221 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415b3ee-ef6f-4937-b3a5-5c36d38c51f9 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:23.908504 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415b3ee-ef6f-4937-b3a5-5c36d38c51f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:23.908782 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415b3ee-ef6f-4937-b3a5-5c36d38c51f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:23.909482 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415b3ee-ef6f-4937-b3a5-5c36d38c51f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:23.911099 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415b3ee-ef6f-4937-b3a5-5c36d38c51f9 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:23.921076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1227/2448] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:23.925220 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4782ea-199f-4221-8206-314b45dcd480 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:23.935142 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4782ea-199f-4221-8206-314b45dcd480 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:23.939836 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275e564-42e5-49de-be86-7ef1d85a5534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:23.940486 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275e564-42e5-49de-be86-7ef1d85a5534 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:23.940766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275e564-42e5-49de-be86-7ef1d85a5534 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:23.941041 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275e564-42e5-49de-be86-7ef1d85a5534 admin admin] PATH_INFO: `/v3/projects/7884686a5d1049008924564416bcec88/users/d9ff4227bd1946b1b170a2012d82a82d/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:23.956051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275e564-42e5-49de-be86-7ef1d85a5534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7884686a5d1049008924564416bcec88, user_id=d9ff4227bd1946b1b170a2012d82a82d, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:23.958744 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275e564-42e5-49de-be86-7ef1d85a5534 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:23.972410 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1222/2449] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:23 2022] PUT /identity/v3/projects/7884686a5d1049008924564416bcec88/users/d9ff4227bd1946b1b170a2012d82a82d/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:23.982982 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abaa753-ac93-46a6-85a9-6cec810f502b None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:23.983364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abaa753-ac93-46a6-85a9-6cec810f502b None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:23.983646 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abaa753-ac93-46a6-85a9-6cec810f502b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:24.012807 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-8abaa753-ac93-46a6-85a9-6cec810f502b None None] MFA Rules not processed for user `d9ff4227bd1946b1b170a2012d82a82d`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:24.014067 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-8abaa753-ac93-46a6-85a9-6cec810f502b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:24.077854 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1228/2450] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:00:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:24.082334 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275e564-42e5-49de-be86-7ef1d85a5534 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:24.143774 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275e564-42e5-49de-be86-7ef1d85a5534 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:24.148430 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed28c84-e7a8-40c4-ac11-b344a3a45d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:24.149069 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed28c84-e7a8-40c4-ac11-b344a3a45d07 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:24.149356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed28c84-e7a8-40c4-ac11-b344a3a45d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:24.149666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed28c84-e7a8-40c4-ac11-b344a3a45d07 admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:24.150335 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed28c84-e7a8-40c4-ac11-b344a3a45d07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:24.152216 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed28c84-e7a8-40c4-ac11-b344a3a45d07 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:24.165962 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:24.179457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1223/2451] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:24 2022] POST /identity/v3/projects => generated 393 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:24.183345 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abaa753-ac93-46a6-85a9-6cec810f502b None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:24.194612 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abaa753-ac93-46a6-85a9-6cec810f502b None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:24.249650 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe633c0-85c7-4726-94f4-03c4585ef702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:24.250271 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe633c0-85c7-4726-94f4-03c4585ef702 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:24.250558 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe633c0-85c7-4726-94f4-03c4585ef702 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:24.250830 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe633c0-85c7-4726-94f4-03c4585ef702 admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:24.251476 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe633c0-85c7-4726-94f4-03c4585ef702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:24.253402 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe633c0-85c7-4726-94f4-03c4585ef702 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:24.276106 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1229/2452] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:24 2022] POST /identity/v3/users => generated 303 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:24.279874 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed28c84-e7a8-40c4-ac11-b344a3a45d07 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:24.290678 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed28c84-e7a8-40c4-ac11-b344a3a45d07 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:24.295337 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e6ab2-f6a5-468d-aea4-1a0d190c8176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:24.296231 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e6ab2-f6a5-468d-aea4-1a0d190c8176 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:24.296521 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e6ab2-f6a5-468d-aea4-1a0d190c8176 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:24.296801 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e6ab2-f6a5-468d-aea4-1a0d190c8176 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:24.297525 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e6ab2-f6a5-468d-aea4-1a0d190c8176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:24.299113 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e6ab2-f6a5-468d-aea4-1a0d190c8176 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:24.309560 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1224/2453] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:24.314341 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe633c0-85c7-4726-94f4-03c4585ef702 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:24.324181 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe633c0-85c7-4726-94f4-03c4585ef702 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:24.329753 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1a67d-792b-4b1f-9ffc-7c0dcf7328f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:24.330380 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1a67d-792b-4b1f-9ffc-7c0dcf7328f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:24.330665 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1a67d-792b-4b1f-9ffc-7c0dcf7328f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:24.330953 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1a67d-792b-4b1f-9ffc-7c0dcf7328f0 admin admin] PATH_INFO: `/v3/projects/7ad17c3e654e404c9e8b640236f8ff74/users/8c983b346c2f454d9c9afa11e9bba93e/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:24.345762 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1a67d-792b-4b1f-9ffc-7c0dcf7328f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad17c3e654e404c9e8b640236f8ff74, user_id=8c983b346c2f454d9c9afa11e9bba93e, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:24.348433 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1a67d-792b-4b1f-9ffc-7c0dcf7328f0 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:24.361714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1230/2454] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:24 2022] PUT /identity/v3/projects/7ad17c3e654e404c9e8b640236f8ff74/users/8c983b346c2f454d9c9afa11e9bba93e/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:24.365534 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e6ab2-f6a5-468d-aea4-1a0d190c8176 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:24.375974 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e6ab2-f6a5-468d-aea4-1a0d190c8176 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:24.432154 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95756740-cd77-4eb7-9f0b-84acd72b6f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:24.432770 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95756740-cd77-4eb7-9f0b-84acd72b6f76 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:24.433054 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95756740-cd77-4eb7-9f0b-84acd72b6f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:24.433346 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95756740-cd77-4eb7-9f0b-84acd72b6f76 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:24.434091 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95756740-cd77-4eb7-9f0b-84acd72b6f76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:24.435689 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95756740-cd77-4eb7-9f0b-84acd72b6f76 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:24.446179 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1225/2455] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:24.450360 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1a67d-792b-4b1f-9ffc-7c0dcf7328f0 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:24.460574 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1a67d-792b-4b1f-9ffc-7c0dcf7328f0 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:24.465192 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e2dbb-c019-4b5c-acd5-6be2876eabd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:24.465883 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e2dbb-c019-4b5c-acd5-6be2876eabd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:24.466168 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e2dbb-c019-4b5c-acd5-6be2876eabd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:24.466447 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e2dbb-c019-4b5c-acd5-6be2876eabd6 admin admin] PATH_INFO: `/v3/projects/7ad17c3e654e404c9e8b640236f8ff74/users/8c983b346c2f454d9c9afa11e9bba93e/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:24.468588 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e2dbb-c019-4b5c-acd5-6be2876eabd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad17c3e654e404c9e8b640236f8ff74, user_id=8c983b346c2f454d9c9afa11e9bba93e, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:24.471368 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e2dbb-c019-4b5c-acd5-6be2876eabd6 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:24.474467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:24.484177 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1231/2456] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:24 2022] PUT /identity/v3/projects/7ad17c3e654e404c9e8b640236f8ff74/users/8c983b346c2f454d9c9afa11e9bba93e/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:24.495763 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9f8c4-1064-412b-bee8-220c9ef6694b None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:24.496050 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9f8c4-1064-412b-bee8-220c9ef6694b None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:24.496326 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9f8c4-1064-412b-bee8-220c9ef6694b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:24.525202 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-edb9f8c4-1064-412b-bee8-220c9ef6694b None None] MFA Rules not processed for user `8c983b346c2f454d9c9afa11e9bba93e`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:24.526492 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-edb9f8c4-1064-412b-bee8-220c9ef6694b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:24.599659 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1226/2457] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:00:24 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:24.610338 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e2dbb-c019-4b5c-acd5-6be2876eabd6 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:24.612065 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-707e2dbb-c019-4b5c-acd5-6be2876eabd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:24.690203 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e2dbb-c019-4b5c-acd5-6be2876eabd6 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:24.693866 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d414e-e3f0-41eb-90da-38386444b3b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:24.694470 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d414e-e3f0-41eb-90da-38386444b3b9 service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:24.694747 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d414e-e3f0-41eb-90da-38386444b3b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:24.695022 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d414e-e3f0-41eb-90da-38386444b3b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:24.704416 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d414e-e3f0-41eb-90da-38386444b3b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:24.705874 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d414e-e3f0-41eb-90da-38386444b3b9 service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:24.715058 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1232/2458] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:24 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:24.761874 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb9f8c4-1064-412b-bee8-220c9ef6694b None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:24.763264 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-edb9f8c4-1064-412b-bee8-220c9ef6694b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:24.775760 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb9f8c4-1064-412b-bee8-220c9ef6694b None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:24.779355 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b885aca-7f82-4a70-ad7c-7a0efff47ca3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:24.780010 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b885aca-7f82-4a70-ad7c-7a0efff47ca3 service cinder] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:24.780355 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b885aca-7f82-4a70-ad7c-7a0efff47ca3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:24.780632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b885aca-7f82-4a70-ad7c-7a0efff47ca3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:24.837565 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b885aca-7f82-4a70-ad7c-7a0efff47ca3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:24.838987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b885aca-7f82-4a70-ad7c-7a0efff47ca3 service cinder] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:24.847790 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1227/2459] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:24 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:28.118781 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d414e-e3f0-41eb-90da-38386444b3b9 service cinder] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:28.181418 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d414e-e3f0-41eb-90da-38386444b3b9 service cinder] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:28.186640 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2424f8-b46b-4303-9de4-8cdc10db3c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:28.187284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2424f8-b46b-4303-9de4-8cdc10db3c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:28.187566 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2424f8-b46b-4303-9de4-8cdc10db3c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:28.187842 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2424f8-b46b-4303-9de4-8cdc10db3c10 admin admin] PATH_INFO: `/v3/users/d9ff4227bd1946b1b170a2012d82a82d` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:28.189019 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2424f8-b46b-4303-9de4-8cdc10db3c10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9ff4227bd1946b1b170a2012d82a82d)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:28.190997 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2424f8-b46b-4303-9de4-8cdc10db3c10 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:28.236050 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-dc2424f8-b46b-4303-9de4-8cdc10db3c10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9ff4227bd1946b1b170a2012d82a82d'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:28.236634 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-dc2424f8-b46b-4303-9de4-8cdc10db3c10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9ff4227bd1946b1b170a2012d82a82d'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:28.237242 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-dc2424f8-b46b-4303-9de4-8cdc10db3c10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9ff4227bd1946b1b170a2012d82a82d'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:28.249911 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-dc2424f8-b46b-4303-9de4-8cdc10db3c10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9ff4227bd1946b1b170a2012d82a82d'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:28.256930 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-dc2424f8-b46b-4303-9de4-8cdc10db3c10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9ff4227bd1946b1b170a2012d82a82d'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:28.265319 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:28.270706 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1233/2460] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:28 2022] DELETE /identity/v3/users/d9ff4227bd1946b1b170a2012d82a82d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:28.275558 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59395d15-b1dc-4760-8d33-d33527c7f9f8 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:28.276002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59395d15-b1dc-4760-8d33-d33527c7f9f8 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:28.276101 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59395d15-b1dc-4760-8d33-d33527c7f9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:28.283317 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:28.297216 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-59395d15-b1dc-4760-8d33-d33527c7f9f8 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:28.298467 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-59395d15-b1dc-4760-8d33-d33527c7f9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:28.357452 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1228/2461] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:00:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:28.367830 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2424f8-b46b-4303-9de4-8cdc10db3c10 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:28.369262 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-dc2424f8-b46b-4303-9de4-8cdc10db3c10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:28.427899 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2424f8-b46b-4303-9de4-8cdc10db3c10 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:28.431571 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc94816-e5ae-4f34-971d-238ba5d53a6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:28.432181 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc94816-e5ae-4f34-971d-238ba5d53a6a service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:28.432460 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc94816-e5ae-4f34-971d-238ba5d53a6a service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:28.432735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc94816-e5ae-4f34-971d-238ba5d53a6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:28.442542 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc94816-e5ae-4f34-971d-238ba5d53a6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:28.443975 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc94816-e5ae-4f34-971d-238ba5d53a6a service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:28.453490 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1234/2462] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:28.723904 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59395d15-b1dc-4760-8d33-d33527c7f9f8 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:28.725352 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-59395d15-b1dc-4760-8d33-d33527c7f9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:28.739484 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59395d15-b1dc-4760-8d33-d33527c7f9f8 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:28.744170 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182124b-1bb2-4f13-95c5-3778d04e8f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:28.744804 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182124b-1bb2-4f13-95c5-3778d04e8f33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:28.745079 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182124b-1bb2-4f13-95c5-3778d04e8f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:28.745346 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182124b-1bb2-4f13-95c5-3778d04e8f33 admin admin] PATH_INFO: `/v3/projects/7884686a5d1049008924564416bcec88` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:28.746502 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182124b-1bb2-4f13-95c5-3778d04e8f33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7884686a5d1049008924564416bcec88)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:28.749398 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182124b-1bb2-4f13-95c5-3778d04e8f33 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:28.797005 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-3182124b-1bb2-4f13-95c5-3778d04e8f33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7884686a5d1049008924564416bcec88', 'request_id': 'req-3182124b-1bb2-4f13-95c5-3778d04e8f33'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:28.803362 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-3182124b-1bb2-4f13-95c5-3778d04e8f33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7884686a5d1049008924564416bcec88', 'request_id': 'req-3182124b-1bb2-4f13-95c5-3778d04e8f33'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:28.808791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-3182124b-1bb2-4f13-95c5-3778d04e8f33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7884686a5d1049008924564416bcec88', 'request_id': 'req-3182124b-1bb2-4f13-95c5-3778d04e8f33'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:28.821186 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-3182124b-1bb2-4f13-95c5-3778d04e8f33 admin admin] The token cache is being invalidate because project 7884686a5d1049008924564416bcec88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:28.821468 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-3182124b-1bb2-4f13-95c5-3778d04e8f33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:28.822128 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-3182124b-1bb2-4f13-95c5-3778d04e8f33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:28.823637 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1229/2463] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:28 2022] DELETE /identity/v3/projects/7884686a5d1049008924564416bcec88 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:28.827686 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc94816-e5ae-4f34-971d-238ba5d53a6a service neutron] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:28.837345 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc94816-e5ae-4f34-971d-238ba5d53a6a service neutron] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:28.893929 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd06370-c5bd-4139-9e27-d67d4f552351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:28.894575 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd06370-c5bd-4139-9e27-d67d4f552351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:28.894860 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd06370-c5bd-4139-9e27-d67d4f552351 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:28.895134 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd06370-c5bd-4139-9e27-d67d4f552351 admin admin] PATH_INFO: `/v3/users/8c983b346c2f454d9c9afa11e9bba93e` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:28.896299 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd06370-c5bd-4139-9e27-d67d4f552351 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c983b346c2f454d9c9afa11e9bba93e)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:28.898309 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd06370-c5bd-4139-9e27-d67d4f552351 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:28.946382 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-4cd06370-c5bd-4139-9e27-d67d4f552351 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c983b346c2f454d9c9afa11e9bba93e'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:28.947028 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-4cd06370-c5bd-4139-9e27-d67d4f552351 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c983b346c2f454d9c9afa11e9bba93e'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:28.947621 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-4cd06370-c5bd-4139-9e27-d67d4f552351 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c983b346c2f454d9c9afa11e9bba93e'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:28.959658 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-4cd06370-c5bd-4139-9e27-d67d4f552351 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c983b346c2f454d9c9afa11e9bba93e'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:28.966295 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-4cd06370-c5bd-4139-9e27-d67d4f552351 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c983b346c2f454d9c9afa11e9bba93e'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:28.979500 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1235/2464] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:28 2022] DELETE /identity/v3/users/8c983b346c2f454d9c9afa11e9bba93e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:00:29.252996 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182124b-1bb2-4f13-95c5-3778d04e8f33 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:29.254474 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-3182124b-1bb2-4f13-95c5-3778d04e8f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:29.270392 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182124b-1bb2-4f13-95c5-3778d04e8f33 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:29.329081 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec527c-6afd-472b-8c24-7b338268544d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:29.329715 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec527c-6afd-472b-8c24-7b338268544d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:29.329952 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec527c-6afd-472b-8c24-7b338268544d admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:29.330226 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec527c-6afd-472b-8c24-7b338268544d admin admin] PATH_INFO: `/v3/projects/7ad17c3e654e404c9e8b640236f8ff74` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:29.331372 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec527c-6afd-472b-8c24-7b338268544d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ad17c3e654e404c9e8b640236f8ff74)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:29.333257 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec527c-6afd-472b-8c24-7b338268544d admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:29.365019 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:29.382179 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-6cec527c-6afd-472b-8c24-7b338268544d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ad17c3e654e404c9e8b640236f8ff74', 'request_id': 'req-6cec527c-6afd-472b-8c24-7b338268544d'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:29.388375 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-6cec527c-6afd-472b-8c24-7b338268544d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ad17c3e654e404c9e8b640236f8ff74', 'request_id': 'req-6cec527c-6afd-472b-8c24-7b338268544d'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:29.394490 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-6cec527c-6afd-472b-8c24-7b338268544d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ad17c3e654e404c9e8b640236f8ff74', 'request_id': 'req-6cec527c-6afd-472b-8c24-7b338268544d'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:29.406491 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-6cec527c-6afd-472b-8c24-7b338268544d admin admin] The token cache is being invalidate because project 7ad17c3e654e404c9e8b640236f8ff74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:29.406776 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-6cec527c-6afd-472b-8c24-7b338268544d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:29.407415 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-6cec527c-6afd-472b-8c24-7b338268544d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:29.408941 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1230/2465] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:29 2022] DELETE /identity/v3/projects/7ad17c3e654e404c9e8b640236f8ff74 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:29.414465 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6595c-b94f-4630-9728-2dd153591b32 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:29.414941 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6595c-b94f-4630-9728-2dd153591b32 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:29.415035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6595c-b94f-4630-9728-2dd153591b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:29.435499 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-48c6595c-b94f-4630-9728-2dd153591b32 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:29.437373 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-48c6595c-b94f-4630-9728-2dd153591b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:29.450092 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:29.497372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1236/2466] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:00:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:29.505416 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdefc2db-fe4e-47fe-9f79-59f7608f8765 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:29.505736 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdefc2db-fe4e-47fe-9f79-59f7608f8765 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:29.506013 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdefc2db-fe4e-47fe-9f79-59f7608f8765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:29.527774 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-cdefc2db-fe4e-47fe-9f79-59f7608f8765 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:29.529071 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-cdefc2db-fe4e-47fe-9f79-59f7608f8765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:29.537315 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1231/2467] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:00:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:29.541893 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6595c-b94f-4630-9728-2dd153591b32 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:29.552068 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6595c-b94f-4630-9728-2dd153591b32 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:29.556615 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ac988-8c5d-45dd-9b5c-a0fab997a9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:29.557214 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ac988-8c5d-45dd-9b5c-a0fab997a9ba admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:29.557507 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ac988-8c5d-45dd-9b5c-a0fab997a9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:29.557792 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ac988-8c5d-45dd-9b5c-a0fab997a9ba admin admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:29.558486 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ac988-8c5d-45dd-9b5c-a0fab997a9ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:00:29.558786 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ac988-8c5d-45dd-9b5c-a0fab997a9ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:29.560366 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ac988-8c5d-45dd-9b5c-a0fab997a9ba admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:29.572381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1237/2468] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 13:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:00:29.576766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdefc2db-fe4e-47fe-9f79-59f7608f8765 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:29.586835 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdefc2db-fe4e-47fe-9f79-59f7608f8765 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:29.591484 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b34c79-a177-4d11-b77c-2a5be9fa6455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:29.592115 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b34c79-a177-4d11-b77c-2a5be9fa6455 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:29.592524 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b34c79-a177-4d11-b77c-2a5be9fa6455 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:29.592816 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b34c79-a177-4d11-b77c-2a5be9fa6455 admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:29.593558 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b34c79-a177-4d11-b77c-2a5be9fa6455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:29.595442 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b34c79-a177-4d11-b77c-2a5be9fa6455 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:29.621922 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1232/2469] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:29 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:29.626852 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ac988-8c5d-45dd-9b5c-a0fab997a9ba admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:29.637152 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ac988-8c5d-45dd-9b5c-a0fab997a9ba admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:29.698797 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4befbd-a141-4354-a7e4-f8a7e9c511f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:29.699424 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4befbd-a141-4354-a7e4-f8a7e9c511f0 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:29.699706 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4befbd-a141-4354-a7e4-f8a7e9c511f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:29.699982 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4befbd-a141-4354-a7e4-f8a7e9c511f0 admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:29.700645 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4befbd-a141-4354-a7e4-f8a7e9c511f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:29.702625 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4befbd-a141-4354-a7e4-f8a7e9c511f0 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:29.723092 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1238/2470] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:29 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:29.727125 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b34c79-a177-4d11-b77c-2a5be9fa6455 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:29.738111 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b34c79-a177-4d11-b77c-2a5be9fa6455 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:29.742717 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be64bc-de0a-4de1-9a11-1f3956ea8e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:29.743323 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be64bc-de0a-4de1-9a11-1f3956ea8e4c admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:29.743600 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be64bc-de0a-4de1-9a11-1f3956ea8e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:29.743873 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be64bc-de0a-4de1-9a11-1f3956ea8e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:29.744566 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be64bc-de0a-4de1-9a11-1f3956ea8e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:29.746187 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be64bc-de0a-4de1-9a11-1f3956ea8e4c admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:29.756764 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1233/2471] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:29.760869 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4befbd-a141-4354-a7e4-f8a7e9c511f0 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:29.770992 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4befbd-a141-4354-a7e4-f8a7e9c511f0 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:29.775853 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9a272-bcc3-474e-be36-d706cb42b272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:29.776461 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9a272-bcc3-474e-be36-d706cb42b272 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:29.776737 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9a272-bcc3-474e-be36-d706cb42b272 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:29.777009 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9a272-bcc3-474e-be36-d706cb42b272 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:29.777759 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9a272-bcc3-474e-be36-d706cb42b272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:29.779341 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9a272-bcc3-474e-be36-d706cb42b272 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:29.790243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1239/2472] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:29.794575 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be64bc-de0a-4de1-9a11-1f3956ea8e4c admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:29.805244 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be64bc-de0a-4de1-9a11-1f3956ea8e4c admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:29.810203 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a042b94-fceb-486e-aaad-ed8afa85dbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:29.810895 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a042b94-fceb-486e-aaad-ed8afa85dbb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:29.811786 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a042b94-fceb-486e-aaad-ed8afa85dbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:29.812065 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a042b94-fceb-486e-aaad-ed8afa85dbb1 admin admin] PATH_INFO: `/v3/projects/9981364202aa44ffba7255125d3d37be/users/9a80af467b0e4a17ab1894a1335bbefa/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:29.826793 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a042b94-fceb-486e-aaad-ed8afa85dbb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9981364202aa44ffba7255125d3d37be, user_id=9a80af467b0e4a17ab1894a1335bbefa, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:29.829686 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a042b94-fceb-486e-aaad-ed8afa85dbb1 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:29.842287 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1234/2473] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:29 2022] PUT /identity/v3/projects/9981364202aa44ffba7255125d3d37be/users/9a80af467b0e4a17ab1894a1335bbefa/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:00:29.852444 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd015fe7-48c2-46b2-92e8-50d6a614ffe4 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:29.852730 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd015fe7-48c2-46b2-92e8-50d6a614ffe4 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:29.853004 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd015fe7-48c2-46b2-92e8-50d6a614ffe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:29.881289 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-fd015fe7-48c2-46b2-92e8-50d6a614ffe4 None None] MFA Rules not processed for user `9a80af467b0e4a17ab1894a1335bbefa`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:29.882604 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-fd015fe7-48c2-46b2-92e8-50d6a614ffe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:29.946065 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1240/2474] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:00:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:29.950578 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a042b94-fceb-486e-aaad-ed8afa85dbb1 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:30.012112 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a042b94-fceb-486e-aaad-ed8afa85dbb1 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:30.016724 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b9b03-7184-43f7-be74-6b84b3dc4153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:30.017335 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b9b03-7184-43f7-be74-6b84b3dc4153 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:30.017650 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b9b03-7184-43f7-be74-6b84b3dc4153 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:30.017926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b9b03-7184-43f7-be74-6b84b3dc4153 admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:30.018589 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b9b03-7184-43f7-be74-6b84b3dc4153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:30.020482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b9b03-7184-43f7-be74-6b84b3dc4153 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:30.047002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1235/2475] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:29 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:30.051094 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd015fe7-48c2-46b2-92e8-50d6a614ffe4 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:30.061678 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd015fe7-48c2-46b2-92e8-50d6a614ffe4 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:30.072917 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:30.120051 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e3a51-e6c8-4c80-a5b2-290549f0f392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:30.120597 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e3a51-e6c8-4c80-a5b2-290549f0f392 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:30.120876 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e3a51-e6c8-4c80-a5b2-290549f0f392 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:30.121151 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e3a51-e6c8-4c80-a5b2-290549f0f392 admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:30.121865 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e3a51-e6c8-4c80-a5b2-290549f0f392 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:30.124180 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e3a51-e6c8-4c80-a5b2-290549f0f392 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:30.145242 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1241/2476] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:30 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:30.149167 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b9b03-7184-43f7-be74-6b84b3dc4153 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:30.160152 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b9b03-7184-43f7-be74-6b84b3dc4153 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:30.164705 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178bc8a-ba74-4004-b2a0-58c048f61810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:30.165313 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178bc8a-ba74-4004-b2a0-58c048f61810 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:30.165619 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178bc8a-ba74-4004-b2a0-58c048f61810 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:30.165896 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178bc8a-ba74-4004-b2a0-58c048f61810 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:30.166588 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178bc8a-ba74-4004-b2a0-58c048f61810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:30.168179 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178bc8a-ba74-4004-b2a0-58c048f61810 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:30.179156 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1236/2477] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:30.183156 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e3a51-e6c8-4c80-a5b2-290549f0f392 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:30.193055 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e3a51-e6c8-4c80-a5b2-290549f0f392 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:30.197672 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef0c70-6886-4b12-b12f-b4a666717737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:30.198326 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef0c70-6886-4b12-b12f-b4a666717737 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:30.198603 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef0c70-6886-4b12-b12f-b4a666717737 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:30.198873 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef0c70-6886-4b12-b12f-b4a666717737 admin admin] PATH_INFO: `/v3/projects/e8d6abfaded746839d15c1d2655a5663/users/034a7ece191c410e906fb02c37f6d719/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:30.213986 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef0c70-6886-4b12-b12f-b4a666717737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8d6abfaded746839d15c1d2655a5663, user_id=034a7ece191c410e906fb02c37f6d719, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:30.216670 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef0c70-6886-4b12-b12f-b4a666717737 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:30.229686 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1242/2478] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:30 2022] PUT /identity/v3/projects/e8d6abfaded746839d15c1d2655a5663/users/034a7ece191c410e906fb02c37f6d719/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:30.234170 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178bc8a-ba74-4004-b2a0-58c048f61810 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:30.244214 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178bc8a-ba74-4004-b2a0-58c048f61810 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:30.268395 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:30.303526 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78b754-fdeb-4874-b847-51a6211f1aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:30.304142 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78b754-fdeb-4874-b847-51a6211f1aae admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:30.304424 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78b754-fdeb-4874-b847-51a6211f1aae admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:30.304699 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78b754-fdeb-4874-b847-51a6211f1aae admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:30.305385 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78b754-fdeb-4874-b847-51a6211f1aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:30.306995 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78b754-fdeb-4874-b847-51a6211f1aae admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:30.316891 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1237/2479] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:30.321082 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef0c70-6886-4b12-b12f-b4a666717737 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:30.331495 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef0c70-6886-4b12-b12f-b4a666717737 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:30.336098 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d878e20-c9a1-4da2-a324-3e64c2ff0a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:30.336751 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d878e20-c9a1-4da2-a324-3e64c2ff0a2b admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:30.337069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d878e20-c9a1-4da2-a324-3e64c2ff0a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:30.337350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d878e20-c9a1-4da2-a324-3e64c2ff0a2b admin admin] PATH_INFO: `/v3/projects/e8d6abfaded746839d15c1d2655a5663/users/034a7ece191c410e906fb02c37f6d719/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:30.339319 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d878e20-c9a1-4da2-a324-3e64c2ff0a2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8d6abfaded746839d15c1d2655a5663, user_id=034a7ece191c410e906fb02c37f6d719, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:30.341990 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d878e20-c9a1-4da2-a324-3e64c2ff0a2b admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:30.352505 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1243/2480] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:30 2022] PUT /identity/v3/projects/e8d6abfaded746839d15c1d2655a5663/users/034a7ece191c410e906fb02c37f6d719/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:30.364258 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4cf59-f826-4665-adcb-315df0009c97 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:30.364721 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4cf59-f826-4665-adcb-315df0009c97 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:30.364816 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4cf59-f826-4665-adcb-315df0009c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:30.393937 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-6da4cf59-f826-4665-adcb-315df0009c97 None None] MFA Rules not processed for user `034a7ece191c410e906fb02c37f6d719`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:30.395098 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-6da4cf59-f826-4665-adcb-315df0009c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:30.462597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1238/2481] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:00:30 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:30.474481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d878e20-c9a1-4da2-a324-3e64c2ff0a2b admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:30.476279 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-1d878e20-c9a1-4da2-a324-3e64c2ff0a2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:30.534215 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d878e20-c9a1-4da2-a324-3e64c2ff0a2b admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:30.537957 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d9e348-6431-4c46-9970-d7277ae0dd2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:30.538568 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9e348-6431-4c46-9970-d7277ae0dd2a service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:30.538849 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9e348-6431-4c46-9970-d7277ae0dd2a service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:30.539124 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9e348-6431-4c46-9970-d7277ae0dd2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:30.548404 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d9e348-6431-4c46-9970-d7277ae0dd2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:30.549863 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d9e348-6431-4c46-9970-d7277ae0dd2a service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:30.559314 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1244/2482] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:30 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:00:30.650630 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4cf59-f826-4665-adcb-315df0009c97 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:30.660898 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4cf59-f826-4665-adcb-315df0009c97 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:30.664761 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc60da-a391-4d16-acc1-b15ab908c48f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:30.665375 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc60da-a391-4d16-acc1-b15ab908c48f service cinder] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:30.665693 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc60da-a391-4d16-acc1-b15ab908c48f service cinder] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:30.665974 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc60da-a391-4d16-acc1-b15ab908c48f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:30.731720 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc60da-a391-4d16-acc1-b15ab908c48f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:30.733436 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc60da-a391-4d16-acc1-b15ab908c48f service cinder] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:30.743000 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1239/2483] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:31.013229 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d9e348-6431-4c46-9970-d7277ae0dd2a service cinder] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:31.077691 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d9e348-6431-4c46-9970-d7277ae0dd2a service cinder] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:31.082194 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373bacc-fc51-4e31-b498-7f199810caca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:31.082826 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373bacc-fc51-4e31-b498-7f199810caca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:31.083109 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373bacc-fc51-4e31-b498-7f199810caca admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:31.083388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373bacc-fc51-4e31-b498-7f199810caca admin admin] PATH_INFO: `/v3/users/9a80af467b0e4a17ab1894a1335bbefa` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:31.084560 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373bacc-fc51-4e31-b498-7f199810caca admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a80af467b0e4a17ab1894a1335bbefa)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:31.086512 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373bacc-fc51-4e31-b498-7f199810caca admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:31.098893 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:31.132670 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-4373bacc-fc51-4e31-b498-7f199810caca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a80af467b0e4a17ab1894a1335bbefa'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:31.133725 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-4373bacc-fc51-4e31-b498-7f199810caca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a80af467b0e4a17ab1894a1335bbefa'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:31.134362 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-4373bacc-fc51-4e31-b498-7f199810caca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a80af467b0e4a17ab1894a1335bbefa'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:31.146777 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-4373bacc-fc51-4e31-b498-7f199810caca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a80af467b0e4a17ab1894a1335bbefa'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:31.153654 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-4373bacc-fc51-4e31-b498-7f199810caca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a80af467b0e4a17ab1894a1335bbefa'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:31.166729 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1245/2484] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:31 2022] DELETE /identity/v3/users/9a80af467b0e4a17ab1894a1335bbefa => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:31.171780 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11d77b-0f5b-4511-a56f-6de8aa7f83dc None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:31.172007 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11d77b-0f5b-4511-a56f-6de8aa7f83dc None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:31.172280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11d77b-0f5b-4511-a56f-6de8aa7f83dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:31.191531 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-8b11d77b-0f5b-4511-a56f-6de8aa7f83dc None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:31.192774 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-8b11d77b-0f5b-4511-a56f-6de8aa7f83dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:31.233925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:31.252197 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1240/2485] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:31.262156 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373bacc-fc51-4e31-b498-7f199810caca admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:31.263560 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-4373bacc-fc51-4e31-b498-7f199810caca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:31.322242 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373bacc-fc51-4e31-b498-7f199810caca admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:31.325905 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a6d03-ea1b-4b36-9dfe-4959d94a3b71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:31.326520 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a6d03-ea1b-4b36-9dfe-4959d94a3b71 service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:31.326806 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a6d03-ea1b-4b36-9dfe-4959d94a3b71 service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:31.327084 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a6d03-ea1b-4b36-9dfe-4959d94a3b71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:31.336002 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a6d03-ea1b-4b36-9dfe-4959d94a3b71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:31.337477 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a6d03-ea1b-4b36-9dfe-4959d94a3b71 service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:31.347114 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1246/2486] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:31.620414 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11d77b-0f5b-4511-a56f-6de8aa7f83dc None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:31.621884 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-8b11d77b-0f5b-4511-a56f-6de8aa7f83dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:31.636005 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11d77b-0f5b-4511-a56f-6de8aa7f83dc None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:31.641402 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a549e3-ca53-492a-9aae-369cd76c4766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:31.642294 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a549e3-ca53-492a-9aae-369cd76c4766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:31.642581 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a549e3-ca53-492a-9aae-369cd76c4766 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:31.642857 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a549e3-ca53-492a-9aae-369cd76c4766 admin admin] PATH_INFO: `/v3/projects/9981364202aa44ffba7255125d3d37be` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:31.644040 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a549e3-ca53-492a-9aae-369cd76c4766 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9981364202aa44ffba7255125d3d37be)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:31.645965 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a549e3-ca53-492a-9aae-369cd76c4766 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:31.693640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a0a549e3-ca53-492a-9aae-369cd76c4766 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9981364202aa44ffba7255125d3d37be', 'request_id': 'req-a0a549e3-ca53-492a-9aae-369cd76c4766'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:31.699759 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a0a549e3-ca53-492a-9aae-369cd76c4766 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9981364202aa44ffba7255125d3d37be', 'request_id': 'req-a0a549e3-ca53-492a-9aae-369cd76c4766'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:31.705922 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a0a549e3-ca53-492a-9aae-369cd76c4766 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9981364202aa44ffba7255125d3d37be', 'request_id': 'req-a0a549e3-ca53-492a-9aae-369cd76c4766'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:31.718782 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a0a549e3-ca53-492a-9aae-369cd76c4766 admin admin] The token cache is being invalidate because project 9981364202aa44ffba7255125d3d37be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:31.719066 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a0a549e3-ca53-492a-9aae-369cd76c4766 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:31.719691 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a0a549e3-ca53-492a-9aae-369cd76c4766 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:31.721199 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1241/2487] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:31 2022] DELETE /identity/v3/projects/9981364202aa44ffba7255125d3d37be => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:31.725283 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a6d03-ea1b-4b36-9dfe-4959d94a3b71 service neutron] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:31.735768 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a6d03-ea1b-4b36-9dfe-4959d94a3b71 service neutron] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:31.791451 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b099735-28c5-4cdf-868f-6cfcee29951e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:31.792084 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b099735-28c5-4cdf-868f-6cfcee29951e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:31.792392 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b099735-28c5-4cdf-868f-6cfcee29951e admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:31.792668 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b099735-28c5-4cdf-868f-6cfcee29951e admin admin] PATH_INFO: `/v3/users/034a7ece191c410e906fb02c37f6d719` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:31.793854 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b099735-28c5-4cdf-868f-6cfcee29951e admin admin] RBAC: Authorizing `identity:delete_user(user_id=034a7ece191c410e906fb02c37f6d719)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:31.796347 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b099735-28c5-4cdf-868f-6cfcee29951e admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:31.831909 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:31.842856 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-3b099735-28c5-4cdf-868f-6cfcee29951e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '034a7ece191c410e906fb02c37f6d719'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:31.843512 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-3b099735-28c5-4cdf-868f-6cfcee29951e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '034a7ece191c410e906fb02c37f6d719'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:31.844104 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-3b099735-28c5-4cdf-868f-6cfcee29951e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '034a7ece191c410e906fb02c37f6d719'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:31.855651 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-3b099735-28c5-4cdf-868f-6cfcee29951e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '034a7ece191c410e906fb02c37f6d719'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:31.862970 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-3b099735-28c5-4cdf-868f-6cfcee29951e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '034a7ece191c410e906fb02c37f6d719'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:31.876169 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1247/2488] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:31 2022] DELETE /identity/v3/users/034a7ece191c410e906fb02c37f6d719 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:32.151511 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a549e3-ca53-492a-9aae-369cd76c4766 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:32.153032 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-a0a549e3-ca53-492a-9aae-369cd76c4766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:32.166640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a549e3-ca53-492a-9aae-369cd76c4766 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:32.223820 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376bc6b-5643-4287-8cd7-343a5419dcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:32.224379 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376bc6b-5643-4287-8cd7-343a5419dcfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:32.224666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376bc6b-5643-4287-8cd7-343a5419dcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:32.224936 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376bc6b-5643-4287-8cd7-343a5419dcfe admin admin] PATH_INFO: `/v3/projects/e8d6abfaded746839d15c1d2655a5663` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:32.226097 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376bc6b-5643-4287-8cd7-343a5419dcfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8d6abfaded746839d15c1d2655a5663)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:32.227998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376bc6b-5643-4287-8cd7-343a5419dcfe admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:32.274571 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a376bc6b-5643-4287-8cd7-343a5419dcfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8d6abfaded746839d15c1d2655a5663', 'request_id': 'req-a376bc6b-5643-4287-8cd7-343a5419dcfe'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:32.280926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a376bc6b-5643-4287-8cd7-343a5419dcfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8d6abfaded746839d15c1d2655a5663', 'request_id': 'req-a376bc6b-5643-4287-8cd7-343a5419dcfe'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:32.286456 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a376bc6b-5643-4287-8cd7-343a5419dcfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8d6abfaded746839d15c1d2655a5663', 'request_id': 'req-a376bc6b-5643-4287-8cd7-343a5419dcfe'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:32.295828 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:32.301040 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a376bc6b-5643-4287-8cd7-343a5419dcfe admin admin] The token cache is being invalidate because project e8d6abfaded746839d15c1d2655a5663 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:32.301581 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a376bc6b-5643-4287-8cd7-343a5419dcfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:32.302636 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a376bc6b-5643-4287-8cd7-343a5419dcfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:32.304500 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1242/2489] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:32 2022] DELETE /identity/v3/projects/e8d6abfaded746839d15c1d2655a5663 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:32.309570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882acd88-4888-4850-a6ac-ab14d6e7e113 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:32.309863 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882acd88-4888-4850-a6ac-ab14d6e7e113 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:32.310142 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882acd88-4888-4850-a6ac-ab14d6e7e113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:32.330324 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-882acd88-4888-4850-a6ac-ab14d6e7e113 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:32.331548 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-882acd88-4888-4850-a6ac-ab14d6e7e113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:32.390158 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1248/2490] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:32.397995 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6917ce-2c01-4b1e-bc81-85cd768741c4 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:32.398317 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6917ce-2c01-4b1e-bc81-85cd768741c4 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:32.398593 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6917ce-2c01-4b1e-bc81-85cd768741c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:32.417835 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-ad6917ce-2c01-4b1e-bc81-85cd768741c4 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:32.419058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-ad6917ce-2c01-4b1e-bc81-85cd768741c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:32.426782 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1243/2491] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:32.431011 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882acd88-4888-4850-a6ac-ab14d6e7e113 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:32.441218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882acd88-4888-4850-a6ac-ab14d6e7e113 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:32.445782 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e1fa3-1b4c-48c1-878b-eac5d4afe318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:32.446385 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e1fa3-1b4c-48c1-878b-eac5d4afe318 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:32.446666 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e1fa3-1b4c-48c1-878b-eac5d4afe318 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:32.446940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e1fa3-1b4c-48c1-878b-eac5d4afe318 admin admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:32.447637 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e1fa3-1b4c-48c1-878b-eac5d4afe318 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:00:32.447940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e1fa3-1b4c-48c1-878b-eac5d4afe318 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:32.449549 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e1fa3-1b4c-48c1-878b-eac5d4afe318 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:32.461674 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1249/2492] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 13:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 13:00:32.465708 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6917ce-2c01-4b1e-bc81-85cd768741c4 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:32.475316 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6917ce-2c01-4b1e-bc81-85cd768741c4 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:32.479870 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4bb51-0b46-4473-8368-17d3e371a989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:32.480474 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4bb51-0b46-4473-8368-17d3e371a989 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:32.480756 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4bb51-0b46-4473-8368-17d3e371a989 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:32.481033 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4bb51-0b46-4473-8368-17d3e371a989 admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:32.481742 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4bb51-0b46-4473-8368-17d3e371a989 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:32.483889 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4bb51-0b46-4473-8368-17d3e371a989 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:32.511611 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1244/2493] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:32 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:00:32.516485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e1fa3-1b4c-48c1-878b-eac5d4afe318 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:32.526487 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e1fa3-1b4c-48c1-878b-eac5d4afe318 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:32.582795 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c812f8-8075-4fcd-ba7e-8fae03a3cc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:32.583411 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c812f8-8075-4fcd-ba7e-8fae03a3cc0b admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:32.583696 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c812f8-8075-4fcd-ba7e-8fae03a3cc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:32.583976 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c812f8-8075-4fcd-ba7e-8fae03a3cc0b admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:32.584642 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c812f8-8075-4fcd-ba7e-8fae03a3cc0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:32.586612 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c812f8-8075-4fcd-ba7e-8fae03a3cc0b admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:32.606750 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1250/2494] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:32 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:32.610777 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4bb51-0b46-4473-8368-17d3e371a989 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:32.620871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4bb51-0b46-4473-8368-17d3e371a989 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:32.626232 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d4c36-7beb-4ec5-910a-b99b15954537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:32.626838 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d4c36-7beb-4ec5-910a-b99b15954537 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:32.627124 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d4c36-7beb-4ec5-910a-b99b15954537 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:32.627401 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d4c36-7beb-4ec5-910a-b99b15954537 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:32.628095 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d4c36-7beb-4ec5-910a-b99b15954537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:32.629717 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d4c36-7beb-4ec5-910a-b99b15954537 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:32.640541 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1245/2495] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:32.644331 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c812f8-8075-4fcd-ba7e-8fae03a3cc0b admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:32.654267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c812f8-8075-4fcd-ba7e-8fae03a3cc0b admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:32.659219 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707603da-61e1-4445-9d31-e8b4f5cd69db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:32.659828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707603da-61e1-4445-9d31-e8b4f5cd69db admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:32.660113 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707603da-61e1-4445-9d31-e8b4f5cd69db admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:32.660393 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707603da-61e1-4445-9d31-e8b4f5cd69db admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:32.661089 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707603da-61e1-4445-9d31-e8b4f5cd69db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:32.671550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707603da-61e1-4445-9d31-e8b4f5cd69db admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:32.682468 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1251/2496] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:32.687216 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d4c36-7beb-4ec5-910a-b99b15954537 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:32.697196 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d4c36-7beb-4ec5-910a-b99b15954537 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:32.701932 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6753fc8-de41-4ad1-beb7-033c59632a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:32.702591 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6753fc8-de41-4ad1-beb7-033c59632a52 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:32.702877 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6753fc8-de41-4ad1-beb7-033c59632a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:32.703154 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6753fc8-de41-4ad1-beb7-033c59632a52 admin admin] PATH_INFO: `/v3/projects/c4e5f4880f7e4c3493b20a261649d210/users/c2af222d7697427e94bfe63bcd4ee7c5/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:32.717480 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6753fc8-de41-4ad1-beb7-033c59632a52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4e5f4880f7e4c3493b20a261649d210, user_id=c2af222d7697427e94bfe63bcd4ee7c5, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:32.720136 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6753fc8-de41-4ad1-beb7-033c59632a52 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:32.733559 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1246/2497] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:32 2022] PUT /identity/v3/projects/c4e5f4880f7e4c3493b20a261649d210/users/c2af222d7697427e94bfe63bcd4ee7c5/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:32.744854 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394cc14-2124-48cf-b743-cb256e6d9235 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:32.745320 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394cc14-2124-48cf-b743-cb256e6d9235 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:32.745434 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394cc14-2124-48cf-b743-cb256e6d9235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:32.773277 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-e394cc14-2124-48cf-b743-cb256e6d9235 None None] MFA Rules not processed for user `c2af222d7697427e94bfe63bcd4ee7c5`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:32.774535 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-e394cc14-2124-48cf-b743-cb256e6d9235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:32.779505 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:32.839274 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1252/2498] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:00:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:32.843693 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6753fc8-de41-4ad1-beb7-033c59632a52 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:32.904047 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6753fc8-de41-4ad1-beb7-033c59632a52 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:32.908794 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3787c-18f8-47df-8b19-294bb904b17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:32.909400 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3787c-18f8-47df-8b19-294bb904b17f admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:32.909716 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3787c-18f8-47df-8b19-294bb904b17f admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:32.909995 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3787c-18f8-47df-8b19-294bb904b17f admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:32.910647 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3787c-18f8-47df-8b19-294bb904b17f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:32.912554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3787c-18f8-47df-8b19-294bb904b17f admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:32.944183 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1247/2499] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:32 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:32.948045 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394cc14-2124-48cf-b743-cb256e6d9235 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:32.958845 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394cc14-2124-48cf-b743-cb256e6d9235 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:33.016084 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2df08-da15-4a20-94e7-3ba5c5400a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:33.016711 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2df08-da15-4a20-94e7-3ba5c5400a5c admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:33.016995 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2df08-da15-4a20-94e7-3ba5c5400a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:33.017274 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2df08-da15-4a20-94e7-3ba5c5400a5c admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:33.017979 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2df08-da15-4a20-94e7-3ba5c5400a5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:33.019915 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2df08-da15-4a20-94e7-3ba5c5400a5c admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:33.040954 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1253/2500] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:32 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:00:33.044890 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3787c-18f8-47df-8b19-294bb904b17f admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:33.055791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3787c-18f8-47df-8b19-294bb904b17f admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:33.060453 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e68090-e9d3-4c5f-8b2c-a335c26ceccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:33.061120 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e68090-e9d3-4c5f-8b2c-a335c26ceccd admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:33.061401 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e68090-e9d3-4c5f-8b2c-a335c26ceccd admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:33.061720 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e68090-e9d3-4c5f-8b2c-a335c26ceccd admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:33.062415 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e68090-e9d3-4c5f-8b2c-a335c26ceccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:33.064011 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e68090-e9d3-4c5f-8b2c-a335c26ceccd admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:33.075765 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1248/2501] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:33.079770 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2df08-da15-4a20-94e7-3ba5c5400a5c admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:33.090549 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2df08-da15-4a20-94e7-3ba5c5400a5c admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:33.096118 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b1fdf-3239-4c4a-ab9b-b5848c34b3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:33.096758 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b1fdf-3239-4c4a-ab9b-b5848c34b3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:33.097056 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b1fdf-3239-4c4a-ab9b-b5848c34b3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:33.097315 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b1fdf-3239-4c4a-ab9b-b5848c34b3a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:33.098050 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b1fdf-3239-4c4a-ab9b-b5848c34b3a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:33.099656 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b1fdf-3239-4c4a-ab9b-b5848c34b3a0 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:33.110638 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1254/2502] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:33.114934 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e68090-e9d3-4c5f-8b2c-a335c26ceccd admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:33.124971 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e68090-e9d3-4c5f-8b2c-a335c26ceccd admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:33.129599 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18d024-ff1e-4924-bd3b-6c2cd76fb646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:33.130262 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18d024-ff1e-4924-bd3b-6c2cd76fb646 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:33.130546 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18d024-ff1e-4924-bd3b-6c2cd76fb646 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:33.130822 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18d024-ff1e-4924-bd3b-6c2cd76fb646 admin admin] PATH_INFO: `/v3/projects/c2be1f753cc24fb98febc3f51842eacc/users/36ace6b3fec34413b8aa19d5627457f9/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:33.146884 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c18d024-ff1e-4924-bd3b-6c2cd76fb646 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2be1f753cc24fb98febc3f51842eacc, user_id=36ace6b3fec34413b8aa19d5627457f9, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:33.149600 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c18d024-ff1e-4924-bd3b-6c2cd76fb646 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:33.162627 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1249/2503] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:33 2022] PUT /identity/v3/projects/c2be1f753cc24fb98febc3f51842eacc/users/36ace6b3fec34413b8aa19d5627457f9/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:33.174412 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012d15b-0f76-4928-95b5-4cccfb0c10f0 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:33.174701 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012d15b-0f76-4928-95b5-4cccfb0c10f0 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:33.174981 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012d15b-0f76-4928-95b5-4cccfb0c10f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:33.202807 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-8012d15b-0f76-4928-95b5-4cccfb0c10f0 None None] MFA Rules not processed for user `36ace6b3fec34413b8aa19d5627457f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:33.204037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-8012d15b-0f76-4928-95b5-4cccfb0c10f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:33.268793 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1255/2504] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:00:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:33.273289 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18d024-ff1e-4924-bd3b-6c2cd76fb646 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:33.321650 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:33.336850 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18d024-ff1e-4924-bd3b-6c2cd76fb646 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:33.341467 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f56e5-f1fb-4db5-9a28-6e13c354ea31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:33.342610 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f56e5-f1fb-4db5-9a28-6e13c354ea31 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:33.342982 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f56e5-f1fb-4db5-9a28-6e13c354ea31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:33.343346 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f56e5-f1fb-4db5-9a28-6e13c354ea31 admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:33.344048 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f56e5-f1fb-4db5-9a28-6e13c354ea31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:33.345973 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f56e5-f1fb-4db5-9a28-6e13c354ea31 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:33.372410 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1250/2505] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:33 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:00:33.376750 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012d15b-0f76-4928-95b5-4cccfb0c10f0 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:33.390022 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012d15b-0f76-4928-95b5-4cccfb0c10f0 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:33.403538 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:33.451213 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1e9d6-8aab-4bb4-9049-a6f744b1c82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:33.452454 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1e9d6-8aab-4bb4-9049-a6f744b1c82c admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:33.452733 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1e9d6-8aab-4bb4-9049-a6f744b1c82c admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:33.453006 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1e9d6-8aab-4bb4-9049-a6f744b1c82c admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:33.453700 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1e9d6-8aab-4bb4-9049-a6f744b1c82c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:33.455641 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1e9d6-8aab-4bb4-9049-a6f744b1c82c admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:33.476492 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1256/2506] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:33 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:33.480452 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f56e5-f1fb-4db5-9a28-6e13c354ea31 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:33.490765 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f56e5-f1fb-4db5-9a28-6e13c354ea31 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:33.495441 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118aa368-3571-438c-b987-da80dfc66ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:33.496059 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118aa368-3571-438c-b987-da80dfc66ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:33.496450 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118aa368-3571-438c-b987-da80dfc66ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:33.496728 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118aa368-3571-438c-b987-da80dfc66ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:33.497425 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118aa368-3571-438c-b987-da80dfc66ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:33.499086 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118aa368-3571-438c-b987-da80dfc66ac0 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:33.510044 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1251/2507] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:33.514721 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1e9d6-8aab-4bb4-9049-a6f744b1c82c admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:33.524792 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1e9d6-8aab-4bb4-9049-a6f744b1c82c admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:33.529378 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f7961-b4e7-4ebb-8266-884c74fc70a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:33.530894 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f7961-b4e7-4ebb-8266-884c74fc70a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:33.531175 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f7961-b4e7-4ebb-8266-884c74fc70a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:33.531449 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f7961-b4e7-4ebb-8266-884c74fc70a7 admin admin] PATH_INFO: `/v3/projects/d5c97c92b1164aab9f424eb3dd44e6ba/users/066b4c71388c4643883d51aa7ee288ae/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:33.546205 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f7961-b4e7-4ebb-8266-884c74fc70a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5c97c92b1164aab9f424eb3dd44e6ba, user_id=066b4c71388c4643883d51aa7ee288ae, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:33.548865 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f7961-b4e7-4ebb-8266-884c74fc70a7 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:33.562033 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1257/2508] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:33 2022] PUT /identity/v3/projects/d5c97c92b1164aab9f424eb3dd44e6ba/users/066b4c71388c4643883d51aa7ee288ae/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:33.565962 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118aa368-3571-438c-b987-da80dfc66ac0 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:33.576105 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118aa368-3571-438c-b987-da80dfc66ac0 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:33.634441 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac3c83-4382-465c-998f-0ce55a75e372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:33.635235 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac3c83-4382-465c-998f-0ce55a75e372 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:33.635518 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac3c83-4382-465c-998f-0ce55a75e372 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:33.635789 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac3c83-4382-465c-998f-0ce55a75e372 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:33.636477 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac3c83-4382-465c-998f-0ce55a75e372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:33.638096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac3c83-4382-465c-998f-0ce55a75e372 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:33.648677 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1252/2509] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:33.652806 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f7961-b4e7-4ebb-8266-884c74fc70a7 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:33.663689 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f7961-b4e7-4ebb-8266-884c74fc70a7 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:33.668572 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2035d8-36b3-49db-8d4d-336ea180380a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:33.669244 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2035d8-36b3-49db-8d4d-336ea180380a admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:33.669556 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2035d8-36b3-49db-8d4d-336ea180380a admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:33.669836 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2035d8-36b3-49db-8d4d-336ea180380a admin admin] PATH_INFO: `/v3/projects/d5c97c92b1164aab9f424eb3dd44e6ba/users/066b4c71388c4643883d51aa7ee288ae/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:33.675904 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2035d8-36b3-49db-8d4d-336ea180380a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5c97c92b1164aab9f424eb3dd44e6ba, user_id=066b4c71388c4643883d51aa7ee288ae, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:33.678640 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2035d8-36b3-49db-8d4d-336ea180380a admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:33.689752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1258/2510] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:33 2022] PUT /identity/v3/projects/d5c97c92b1164aab9f424eb3dd44e6ba/users/066b4c71388c4643883d51aa7ee288ae/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:33.699920 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379822e5-713f-4195-b8bc-b37088df462e None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:33.700206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379822e5-713f-4195-b8bc-b37088df462e None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:33.700529 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379822e5-713f-4195-b8bc-b37088df462e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:33.728557 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-379822e5-713f-4195-b8bc-b37088df462e None None] MFA Rules not processed for user `066b4c71388c4643883d51aa7ee288ae`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:33.729825 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-379822e5-713f-4195-b8bc-b37088df462e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:33.799735 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1253/2511] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:00:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:33.810732 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2035d8-36b3-49db-8d4d-336ea180380a admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:33.813115 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-ad2035d8-36b3-49db-8d4d-336ea180380a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:33.869842 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2035d8-36b3-49db-8d4d-336ea180380a admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:33.874025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6aec7-9bf9-4dfa-bb2f-57c85e2c9319 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:33.874632 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6aec7-9bf9-4dfa-bb2f-57c85e2c9319 service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:33.874916 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6aec7-9bf9-4dfa-bb2f-57c85e2c9319 service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:33.875191 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6aec7-9bf9-4dfa-bb2f-57c85e2c9319 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:33.930299 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be6aec7-9bf9-4dfa-bb2f-57c85e2c9319 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:33.931739 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be6aec7-9bf9-4dfa-bb2f-57c85e2c9319 service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:33.941302 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1259/2512] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:35.455373 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379822e5-713f-4195-b8bc-b37088df462e None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:35.456949 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-379822e5-713f-4195-b8bc-b37088df462e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:35.468830 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379822e5-713f-4195-b8bc-b37088df462e None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:35.472345 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2bb206-c98e-4a6f-b720-2654038b0988 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:35.472969 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bb206-c98e-4a6f-b720-2654038b0988 service cinder] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:35.473244 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bb206-c98e-4a6f-b720-2654038b0988 service cinder] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:35.473543 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bb206-c98e-4a6f-b720-2654038b0988 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:35.513194 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:35.530713 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2bb206-c98e-4a6f-b720-2654038b0988 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:35.532171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2bb206-c98e-4a6f-b720-2654038b0988 service cinder] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:35.541225 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1254/2513] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:36.066216 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6aec7-9bf9-4dfa-bb2f-57c85e2c9319 service cinder] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:36.074822 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6aec7-9bf9-4dfa-bb2f-57c85e2c9319 service cinder] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:36.078739 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008b930-8a3e-476a-82f2-79c300d1de6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:36.079342 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008b930-8a3e-476a-82f2-79c300d1de6e service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:36.079625 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008b930-8a3e-476a-82f2-79c300d1de6e service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:36.079899 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008b930-8a3e-476a-82f2-79c300d1de6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:36.088687 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008b930-8a3e-476a-82f2-79c300d1de6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:36.090144 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008b930-8a3e-476a-82f2-79c300d1de6e service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:36.100998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1260/2514] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:36 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:39.964992 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2bb206-c98e-4a6f-b720-2654038b0988 service cinder] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:40.027950 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2bb206-c98e-4a6f-b720-2654038b0988 service cinder] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:40.032477 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285b287-658c-45dd-b7ce-9b7c9bd2e1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:40.033100 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285b287-658c-45dd-b7ce-9b7c9bd2e1a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:40.033379 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285b287-658c-45dd-b7ce-9b7c9bd2e1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:40.033694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285b287-658c-45dd-b7ce-9b7c9bd2e1a7 admin admin] PATH_INFO: `/v3/users/c2af222d7697427e94bfe63bcd4ee7c5` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:40.034842 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285b287-658c-45dd-b7ce-9b7c9bd2e1a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2af222d7697427e94bfe63bcd4ee7c5)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:40.036779 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285b287-658c-45dd-b7ce-9b7c9bd2e1a7 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:40.084100 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-e285b287-658c-45dd-b7ce-9b7c9bd2e1a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2af222d7697427e94bfe63bcd4ee7c5'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:40.091619 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-e285b287-658c-45dd-b7ce-9b7c9bd2e1a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2af222d7697427e94bfe63bcd4ee7c5'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:40.092426 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-e285b287-658c-45dd-b7ce-9b7c9bd2e1a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2af222d7697427e94bfe63bcd4ee7c5'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:40.093052 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-e285b287-658c-45dd-b7ce-9b7c9bd2e1a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2af222d7697427e94bfe63bcd4ee7c5'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:40.106754 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-e285b287-658c-45dd-b7ce-9b7c9bd2e1a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2af222d7697427e94bfe63bcd4ee7c5'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:40.119727 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1255/2515] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:39 2022] DELETE /identity/v3/users/c2af222d7697427e94bfe63bcd4ee7c5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:40.124781 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba22a6d-9783-4ece-a383-fb3bbd6a8a87 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:40.125271 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba22a6d-9783-4ece-a383-fb3bbd6a8a87 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:40.125385 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba22a6d-9783-4ece-a383-fb3bbd6a8a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:40.146048 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-aba22a6d-9783-4ece-a383-fb3bbd6a8a87 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:40.146948 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-aba22a6d-9783-4ece-a383-fb3bbd6a8a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:40.151178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:40.210186 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1261/2516] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:40.219881 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285b287-658c-45dd-b7ce-9b7c9bd2e1a7 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:40.221587 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-e285b287-658c-45dd-b7ce-9b7c9bd2e1a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:40.285349 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285b287-658c-45dd-b7ce-9b7c9bd2e1a7 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:40.289145 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aec26e-f63b-4a8e-aaa4-56294241f6c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:40.289805 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aec26e-f63b-4a8e-aaa4-56294241f6c5 service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:40.290084 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aec26e-f63b-4a8e-aaa4-56294241f6c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:40.290356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aec26e-f63b-4a8e-aaa4-56294241f6c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:40.300611 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aec26e-f63b-4a8e-aaa4-56294241f6c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:40.302084 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aec26e-f63b-4a8e-aaa4-56294241f6c5 service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:40.312768 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1256/2517] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:40.600553 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba22a6d-9783-4ece-a383-fb3bbd6a8a87 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:40.602092 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-aba22a6d-9783-4ece-a383-fb3bbd6a8a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:40.617981 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba22a6d-9783-4ece-a383-fb3bbd6a8a87 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:40.623398 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ad23d-7e22-4782-aa38-f7df754a933d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:40.624296 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ad23d-7e22-4782-aa38-f7df754a933d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:40.624657 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ad23d-7e22-4782-aa38-f7df754a933d admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:40.625000 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ad23d-7e22-4782-aa38-f7df754a933d admin admin] PATH_INFO: `/v3/projects/c4e5f4880f7e4c3493b20a261649d210` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:40.626323 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ad23d-7e22-4782-aa38-f7df754a933d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4e5f4880f7e4c3493b20a261649d210)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:40.628903 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ad23d-7e22-4782-aa38-f7df754a933d admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:40.676518 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-086ad23d-7e22-4782-aa38-f7df754a933d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4e5f4880f7e4c3493b20a261649d210', 'request_id': 'req-086ad23d-7e22-4782-aa38-f7df754a933d'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:40.682442 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-086ad23d-7e22-4782-aa38-f7df754a933d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4e5f4880f7e4c3493b20a261649d210', 'request_id': 'req-086ad23d-7e22-4782-aa38-f7df754a933d'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:40.690266 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-086ad23d-7e22-4782-aa38-f7df754a933d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4e5f4880f7e4c3493b20a261649d210', 'request_id': 'req-086ad23d-7e22-4782-aa38-f7df754a933d'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:40.700428 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-086ad23d-7e22-4782-aa38-f7df754a933d admin admin] The token cache is being invalidate because project c4e5f4880f7e4c3493b20a261649d210 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:40.700710 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-086ad23d-7e22-4782-aa38-f7df754a933d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:40.701381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-086ad23d-7e22-4782-aa38-f7df754a933d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:40.703476 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1262/2518] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:40 2022] DELETE /identity/v3/projects/c4e5f4880f7e4c3493b20a261649d210 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:40.707568 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aec26e-f63b-4a8e-aaa4-56294241f6c5 service neutron] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:40.712670 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:40.718903 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aec26e-f63b-4a8e-aaa4-56294241f6c5 service neutron] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:40.783427 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c935e38-d724-4999-8283-06115ebaae6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:40.784072 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c935e38-d724-4999-8283-06115ebaae6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:40.784355 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c935e38-d724-4999-8283-06115ebaae6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:40.784632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c935e38-d724-4999-8283-06115ebaae6c admin admin] PATH_INFO: `/v3/users/36ace6b3fec34413b8aa19d5627457f9` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:40.785830 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c935e38-d724-4999-8283-06115ebaae6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=36ace6b3fec34413b8aa19d5627457f9)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:40.787747 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c935e38-d724-4999-8283-06115ebaae6c admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:40.834695 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-9c935e38-d724-4999-8283-06115ebaae6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36ace6b3fec34413b8aa19d5627457f9'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:40.841791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-9c935e38-d724-4999-8283-06115ebaae6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36ace6b3fec34413b8aa19d5627457f9'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:40.842418 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-9c935e38-d724-4999-8283-06115ebaae6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36ace6b3fec34413b8aa19d5627457f9'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:40.843107 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-9c935e38-d724-4999-8283-06115ebaae6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36ace6b3fec34413b8aa19d5627457f9'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:40.854827 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-9c935e38-d724-4999-8283-06115ebaae6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36ace6b3fec34413b8aa19d5627457f9'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:40.866926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1257/2519] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:40 2022] DELETE /identity/v3/users/36ace6b3fec34413b8aa19d5627457f9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:41.139597 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ad23d-7e22-4782-aa38-f7df754a933d admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:41.141226 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-086ad23d-7e22-4782-aa38-f7df754a933d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:41.154484 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ad23d-7e22-4782-aa38-f7df754a933d admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:41.214355 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c06c7d-2d67-41de-b6ff-31316bdf8e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:41.214913 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c06c7d-2d67-41de-b6ff-31316bdf8e8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:41.215198 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c06c7d-2d67-41de-b6ff-31316bdf8e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:41.215478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c06c7d-2d67-41de-b6ff-31316bdf8e8a admin admin] PATH_INFO: `/v3/projects/c2be1f753cc24fb98febc3f51842eacc` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:41.216637 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c06c7d-2d67-41de-b6ff-31316bdf8e8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2be1f753cc24fb98febc3f51842eacc)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:41.218727 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c06c7d-2d67-41de-b6ff-31316bdf8e8a admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:41.256867 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:41.274343 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-82c06c7d-2d67-41de-b6ff-31316bdf8e8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2be1f753cc24fb98febc3f51842eacc', 'request_id': 'req-82c06c7d-2d67-41de-b6ff-31316bdf8e8a'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:41.282116 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-82c06c7d-2d67-41de-b6ff-31316bdf8e8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2be1f753cc24fb98febc3f51842eacc', 'request_id': 'req-82c06c7d-2d67-41de-b6ff-31316bdf8e8a'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:41.290966 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-82c06c7d-2d67-41de-b6ff-31316bdf8e8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2be1f753cc24fb98febc3f51842eacc', 'request_id': 'req-82c06c7d-2d67-41de-b6ff-31316bdf8e8a'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:41.303245 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-82c06c7d-2d67-41de-b6ff-31316bdf8e8a admin admin] The token cache is being invalidate because project c2be1f753cc24fb98febc3f51842eacc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:41.303535 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-82c06c7d-2d67-41de-b6ff-31316bdf8e8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:41.304164 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-82c06c7d-2d67-41de-b6ff-31316bdf8e8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:41.306069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1263/2520] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:41 2022] DELETE /identity/v3/projects/c2be1f753cc24fb98febc3f51842eacc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:41.310291 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c935e38-d724-4999-8283-06115ebaae6c admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:41.311968 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-9c935e38-d724-4999-8283-06115ebaae6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:41.324597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c935e38-d724-4999-8283-06115ebaae6c admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:41.383416 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd0d5b-3597-419a-bccf-b43cec39bce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:41.384058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd0d5b-3597-419a-bccf-b43cec39bce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:41.384333 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd0d5b-3597-419a-bccf-b43cec39bce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:41.384610 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd0d5b-3597-419a-bccf-b43cec39bce1 admin admin] PATH_INFO: `/v3/users/066b4c71388c4643883d51aa7ee288ae` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:41.385797 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd0d5b-3597-419a-bccf-b43cec39bce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=066b4c71388c4643883d51aa7ee288ae)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:41.387693 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd0d5b-3597-419a-bccf-b43cec39bce1 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:41.413197 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:41.451823 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-06fd0d5b-3597-419a-bccf-b43cec39bce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '066b4c71388c4643883d51aa7ee288ae'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:41.463427 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-06fd0d5b-3597-419a-bccf-b43cec39bce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '066b4c71388c4643883d51aa7ee288ae'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:41.464467 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-06fd0d5b-3597-419a-bccf-b43cec39bce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '066b4c71388c4643883d51aa7ee288ae'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:41.465679 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-06fd0d5b-3597-419a-bccf-b43cec39bce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '066b4c71388c4643883d51aa7ee288ae'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:41.480265 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-06fd0d5b-3597-419a-bccf-b43cec39bce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '066b4c71388c4643883d51aa7ee288ae'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:41.493049 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1258/2521] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:41 2022] DELETE /identity/v3/users/066b4c71388c4643883d51aa7ee288ae => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:41.787845 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c06c7d-2d67-41de-b6ff-31316bdf8e8a admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:41.789736 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-82c06c7d-2d67-41de-b6ff-31316bdf8e8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:41.805198 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c06c7d-2d67-41de-b6ff-31316bdf8e8a admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:41.873065 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603b73b-3e75-45ed-87b4-3694f3c145c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:41.873801 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603b73b-3e75-45ed-87b4-3694f3c145c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:41.874068 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603b73b-3e75-45ed-87b4-3694f3c145c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:41.874339 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603b73b-3e75-45ed-87b4-3694f3c145c9 admin admin] PATH_INFO: `/v3/projects/d5c97c92b1164aab9f424eb3dd44e6ba` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:41.875516 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603b73b-3e75-45ed-87b4-3694f3c145c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5c97c92b1164aab9f424eb3dd44e6ba)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:41.877460 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603b73b-3e75-45ed-87b4-3694f3c145c9 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:41.926889 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-5603b73b-3e75-45ed-87b4-3694f3c145c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5c97c92b1164aab9f424eb3dd44e6ba', 'request_id': 'req-5603b73b-3e75-45ed-87b4-3694f3c145c9'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:41.933508 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-5603b73b-3e75-45ed-87b4-3694f3c145c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5c97c92b1164aab9f424eb3dd44e6ba', 'request_id': 'req-5603b73b-3e75-45ed-87b4-3694f3c145c9'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:41.942513 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-5603b73b-3e75-45ed-87b4-3694f3c145c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5c97c92b1164aab9f424eb3dd44e6ba', 'request_id': 'req-5603b73b-3e75-45ed-87b4-3694f3c145c9'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:41.954767 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-5603b73b-3e75-45ed-87b4-3694f3c145c9 admin admin] The token cache is being invalidate because project d5c97c92b1164aab9f424eb3dd44e6ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:41.955067 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-5603b73b-3e75-45ed-87b4-3694f3c145c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:41.955714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-5603b73b-3e75-45ed-87b4-3694f3c145c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:41.957228 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1264/2522] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:41 2022] DELETE /identity/v3/projects/d5c97c92b1164aab9f424eb3dd44e6ba => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:41.967093 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34da2b-a318-4d2d-ac5e-07fd07c93184 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:41.967891 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34da2b-a318-4d2d-ac5e-07fd07c93184 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:41.968159 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34da2b-a318-4d2d-ac5e-07fd07c93184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:41.987541 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-7c34da2b-a318-4d2d-ac5e-07fd07c93184 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:41.988655 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-7c34da2b-a318-4d2d-ac5e-07fd07c93184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:42.048176 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1259/2523] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:00:42.057289 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc1c7e-8491-4e47-a7ce-8b3659e9524b None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:42.057619 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc1c7e-8491-4e47-a7ce-8b3659e9524b None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:42.057906 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc1c7e-8491-4e47-a7ce-8b3659e9524b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:42.079635 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-37dc1c7e-8491-4e47-a7ce-8b3659e9524b None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:42.080860 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-37dc1c7e-8491-4e47-a7ce-8b3659e9524b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:42.088875 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1265/2524] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:00:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:42.093356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34da2b-a318-4d2d-ac5e-07fd07c93184 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:42.104134 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34da2b-a318-4d2d-ac5e-07fd07c93184 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:42.109297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73155c9b-a994-452c-ab86-ffd52bc8f5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:42.109944 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73155c9b-a994-452c-ab86-ffd52bc8f5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:42.110229 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73155c9b-a994-452c-ab86-ffd52bc8f5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:42.110508 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73155c9b-a994-452c-ab86-ffd52bc8f5e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:42.111200 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73155c9b-a994-452c-ab86-ffd52bc8f5e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:00:42.111509 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73155c9b-a994-452c-ab86-ffd52bc8f5e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:42.113097 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73155c9b-a994-452c-ab86-ffd52bc8f5e1 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:42.125189 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1260/2525] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 13:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:00:42.129625 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc1c7e-8491-4e47-a7ce-8b3659e9524b None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:42.139864 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc1c7e-8491-4e47-a7ce-8b3659e9524b None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:42.144780 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8d69b-630d-487e-9ee1-a6a28ca81f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:42.145383 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8d69b-630d-487e-9ee1-a6a28ca81f4e admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:42.145696 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8d69b-630d-487e-9ee1-a6a28ca81f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:42.145973 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8d69b-630d-487e-9ee1-a6a28ca81f4e admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:42.146669 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c8d69b-630d-487e-9ee1-a6a28ca81f4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:42.148556 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c8d69b-630d-487e-9ee1-a6a28ca81f4e admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:42.177547 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1266/2526] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:42 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:42.179494 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73155c9b-a994-452c-ab86-ffd52bc8f5e1 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:42.190493 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73155c9b-a994-452c-ab86-ffd52bc8f5e1 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:42.245545 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82561f2d-e9cf-4cf7-9891-5a4e0b95e0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:42.246161 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82561f2d-e9cf-4cf7-9891-5a4e0b95e0ad admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:42.246443 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82561f2d-e9cf-4cf7-9891-5a4e0b95e0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:42.246721 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82561f2d-e9cf-4cf7-9891-5a4e0b95e0ad admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:42.247392 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82561f2d-e9cf-4cf7-9891-5a4e0b95e0ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:42.249910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82561f2d-e9cf-4cf7-9891-5a4e0b95e0ad admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:42.277918 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1261/2527] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:42 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:00:42.279159 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8d69b-630d-487e-9ee1-a6a28ca81f4e admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:42.289610 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8d69b-630d-487e-9ee1-a6a28ca81f4e admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:42.294257 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68947a5-1c4d-4261-aedd-2cdb5d25bd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:42.294860 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68947a5-1c4d-4261-aedd-2cdb5d25bd88 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:42.295173 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68947a5-1c4d-4261-aedd-2cdb5d25bd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:42.295457 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68947a5-1c4d-4261-aedd-2cdb5d25bd88 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:42.296138 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68947a5-1c4d-4261-aedd-2cdb5d25bd88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:42.297760 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68947a5-1c4d-4261-aedd-2cdb5d25bd88 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:42.308088 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1267/2528] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:42.312565 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82561f2d-e9cf-4cf7-9891-5a4e0b95e0ad admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:42.322659 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82561f2d-e9cf-4cf7-9891-5a4e0b95e0ad admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:42.328256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46325496-72ec-43eb-a663-1939bb9aa849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:42.328868 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46325496-72ec-43eb-a663-1939bb9aa849 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:42.329153 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46325496-72ec-43eb-a663-1939bb9aa849 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:42.329430 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46325496-72ec-43eb-a663-1939bb9aa849 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:42.330228 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46325496-72ec-43eb-a663-1939bb9aa849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:42.331810 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46325496-72ec-43eb-a663-1939bb9aa849 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:42.342492 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1262/2529] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:42.346714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68947a5-1c4d-4261-aedd-2cdb5d25bd88 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:42.356803 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68947a5-1c4d-4261-aedd-2cdb5d25bd88 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:42.361601 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb75c5-ff09-4a93-a091-5dd7f3974d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:42.362251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb75c5-ff09-4a93-a091-5dd7f3974d44 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:42.362533 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb75c5-ff09-4a93-a091-5dd7f3974d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:42.362811 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb75c5-ff09-4a93-a091-5dd7f3974d44 admin admin] PATH_INFO: `/v3/projects/8c4a1acacafb4745b14b8e72f930b43c/users/9d2219889ee44155adc5cc66c722a0e8/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:42.374452 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:42.379426 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eb75c5-ff09-4a93-a091-5dd7f3974d44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c4a1acacafb4745b14b8e72f930b43c, user_id=9d2219889ee44155adc5cc66c722a0e8, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:42.382634 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eb75c5-ff09-4a93-a091-5dd7f3974d44 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:42.396684 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1268/2530] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:42 2022] PUT /identity/v3/projects/8c4a1acacafb4745b14b8e72f930b43c/users/9d2219889ee44155adc5cc66c722a0e8/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:42.407022 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9cf04-2ff3-4726-872e-dbbdeb859398 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:42.407338 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9cf04-2ff3-4726-872e-dbbdeb859398 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:42.407618 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9cf04-2ff3-4726-872e-dbbdeb859398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:42.422341 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:42.439592 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-f7d9cf04-2ff3-4726-872e-dbbdeb859398 None None] MFA Rules not processed for user `9d2219889ee44155adc5cc66c722a0e8`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:42.440817 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-f7d9cf04-2ff3-4726-872e-dbbdeb859398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:42.504952 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1263/2531] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:00:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:42.516974 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb75c5-ff09-4a93-a091-5dd7f3974d44 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:42.518707 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-05eb75c5-ff09-4a93-a091-5dd7f3974d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:42.575674 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb75c5-ff09-4a93-a091-5dd7f3974d44 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:42.579504 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5891e-4f9b-473a-b73b-788f8b845ce0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2f23f4936684b63afc095986e43ec37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:42.580114 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5891e-4f9b-473a-b73b-788f8b845ce0 service glance] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:42.580399 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5891e-4f9b-473a-b73b-788f8b845ce0 service glance] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:42.580674 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5891e-4f9b-473a-b73b-788f8b845ce0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:42.588795 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5891e-4f9b-473a-b73b-788f8b845ce0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:42.590242 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5891e-4f9b-473a-b73b-788f8b845ce0 service glance] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:42.599072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1269/2532] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:49.820377 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9cf04-2ff3-4726-872e-dbbdeb859398 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:49.822001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-f7d9cf04-2ff3-4726-872e-dbbdeb859398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:49.879748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9cf04-2ff3-4726-872e-dbbdeb859398 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:49.883549 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd90a5-b2bf-47dc-a74f-2e97d9926f19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:49.884155 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd90a5-b2bf-47dc-a74f-2e97d9926f19 service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:49.884430 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd90a5-b2bf-47dc-a74f-2e97d9926f19 service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:49.884696 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd90a5-b2bf-47dc-a74f-2e97d9926f19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:49.886439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-e0fd90a5-b2bf-47dc-a74f-2e97d9926f19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:49.949521 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd90a5-b2bf-47dc-a74f-2e97d9926f19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:49.950885 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd90a5-b2bf-47dc-a74f-2e97d9926f19 service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:49.961262 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1264/2533] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:52.595160 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:52.942152 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5891e-4f9b-473a-b73b-788f8b845ce0 service glance] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:52.943750 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-44f5891e-4f9b-473a-b73b-788f8b845ce0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:52.958258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5891e-4f9b-473a-b73b-788f8b845ce0 service glance] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:52.962966 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa365c23-a4e5-45d8-89b8-64299a81931a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:52.963633 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa365c23-a4e5-45d8-89b8-64299a81931a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:52.963911 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa365c23-a4e5-45d8-89b8-64299a81931a admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:52.964211 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa365c23-a4e5-45d8-89b8-64299a81931a admin admin] PATH_INFO: `/v3/users/831d8776102847efbdae901f2b863226` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:52.965378 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa365c23-a4e5-45d8-89b8-64299a81931a admin admin] RBAC: Authorizing `identity:delete_user(user_id=831d8776102847efbdae901f2b863226)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:52.967352 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa365c23-a4e5-45d8-89b8-64299a81931a admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:53.014899 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-aa365c23-a4e5-45d8-89b8-64299a81931a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '831d8776102847efbdae901f2b863226'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:53.015561 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-aa365c23-a4e5-45d8-89b8-64299a81931a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '831d8776102847efbdae901f2b863226'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:53.016179 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-aa365c23-a4e5-45d8-89b8-64299a81931a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '831d8776102847efbdae901f2b863226'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:53.028373 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-aa365c23-a4e5-45d8-89b8-64299a81931a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '831d8776102847efbdae901f2b863226'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:53.035250 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-aa365c23-a4e5-45d8-89b8-64299a81931a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '831d8776102847efbdae901f2b863226'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:53.048842 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1270/2534] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:52 2022] DELETE /identity/v3/users/831d8776102847efbdae901f2b863226 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:53.230688 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd90a5-b2bf-47dc-a74f-2e97d9926f19 service neutron] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:53.241414 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd90a5-b2bf-47dc-a74f-2e97d9926f19 service neutron] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:53.288105 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:53.301368 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab86ff-25a7-45e5-b253-10e8fce1b60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:53.302103 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab86ff-25a7-45e5-b253-10e8fce1b60f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:53.302381 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab86ff-25a7-45e5-b253-10e8fce1b60f admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:53.302649 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab86ff-25a7-45e5-b253-10e8fce1b60f admin admin] PATH_INFO: `/v3/projects/6fbbc1d3d2634250bfd7f7b27c4b4245` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:53.303786 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab86ff-25a7-45e5-b253-10e8fce1b60f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fbbc1d3d2634250bfd7f7b27c4b4245)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:53.305696 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab86ff-25a7-45e5-b253-10e8fce1b60f admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:53.352621 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-6bab86ff-25a7-45e5-b253-10e8fce1b60f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fbbc1d3d2634250bfd7f7b27c4b4245', 'request_id': 'req-6bab86ff-25a7-45e5-b253-10e8fce1b60f'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:53.359450 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-6bab86ff-25a7-45e5-b253-10e8fce1b60f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fbbc1d3d2634250bfd7f7b27c4b4245', 'request_id': 'req-6bab86ff-25a7-45e5-b253-10e8fce1b60f'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:53.364834 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-6bab86ff-25a7-45e5-b253-10e8fce1b60f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fbbc1d3d2634250bfd7f7b27c4b4245', 'request_id': 'req-6bab86ff-25a7-45e5-b253-10e8fce1b60f'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:53.377035 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-6bab86ff-25a7-45e5-b253-10e8fce1b60f admin admin] The token cache is being invalidate because project 6fbbc1d3d2634250bfd7f7b27c4b4245 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:53.377321 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-6bab86ff-25a7-45e5-b253-10e8fce1b60f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:53.377979 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-6bab86ff-25a7-45e5-b253-10e8fce1b60f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:53.379528 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1265/2535] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:53 2022] DELETE /identity/v3/projects/6fbbc1d3d2634250bfd7f7b27c4b4245 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:53.384865 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c695bf-7d7c-434e-8e38-f899a9610b70 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:53.385150 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c695bf-7d7c-434e-8e38-f899a9610b70 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:53.385429 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c695bf-7d7c-434e-8e38-f899a9610b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:53.405417 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-24c695bf-7d7c-434e-8e38-f899a9610b70 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:53.406677 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-24c695bf-7d7c-434e-8e38-f899a9610b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:53.465277 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1271/2536] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:00:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:53.473234 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f155da9-20f0-4c27-b022-2c9f79a3d4ea None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:53.473539 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f155da9-20f0-4c27-b022-2c9f79a3d4ea None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:53.473815 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f155da9-20f0-4c27-b022-2c9f79a3d4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:53.493813 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-3f155da9-20f0-4c27-b022-2c9f79a3d4ea None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:53.495033 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-3f155da9-20f0-4c27-b022-2c9f79a3d4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:53.502958 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1266/2537] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:00:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:53.507098 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c695bf-7d7c-434e-8e38-f899a9610b70 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:53.517023 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c695bf-7d7c-434e-8e38-f899a9610b70 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:53.522096 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b5660-0d26-48fa-89bd-27a393da5834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:53.522953 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b5660-0d26-48fa-89bd-27a393da5834 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:53.523243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b5660-0d26-48fa-89bd-27a393da5834 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:53.523518 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b5660-0d26-48fa-89bd-27a393da5834 admin admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:53.524224 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398b5660-0d26-48fa-89bd-27a393da5834 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:00:53.524532 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398b5660-0d26-48fa-89bd-27a393da5834 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:53.526199 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398b5660-0d26-48fa-89bd-27a393da5834 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:53.540579 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1272/2538] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 13:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:00:53.543650 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f155da9-20f0-4c27-b022-2c9f79a3d4ea None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:53.555605 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f155da9-20f0-4c27-b022-2c9f79a3d4ea None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:53.560434 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efdfbb8-ff81-40cd-b512-e31cba84c652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:53.561137 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdfbb8-ff81-40cd-b512-e31cba84c652 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:53.561417 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdfbb8-ff81-40cd-b512-e31cba84c652 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:53.561729 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdfbb8-ff81-40cd-b512-e31cba84c652 admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:53.562390 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efdfbb8-ff81-40cd-b512-e31cba84c652 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:53.564285 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efdfbb8-ff81-40cd-b512-e31cba84c652 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:53.591618 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1267/2539] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:53 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:53.596520 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b5660-0d26-48fa-89bd-27a393da5834 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:53.606577 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b5660-0d26-48fa-89bd-27a393da5834 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:53.664134 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd8544-6fbd-4aa4-948e-000840f8194f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:53.664759 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd8544-6fbd-4aa4-948e-000840f8194f admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:53.665038 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd8544-6fbd-4aa4-948e-000840f8194f admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:53.665308 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd8544-6fbd-4aa4-948e-000840f8194f admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:53.666005 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd8544-6fbd-4aa4-948e-000840f8194f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:53.667921 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd8544-6fbd-4aa4-948e-000840f8194f admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:53.676099 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:53.692370 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1273/2540] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:53 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:53.696586 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efdfbb8-ff81-40cd-b512-e31cba84c652 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:53.707911 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efdfbb8-ff81-40cd-b512-e31cba84c652 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:53.712523 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb42d7-9c1f-4cd9-90cb-1beb60f1fe69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:53.713129 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb42d7-9c1f-4cd9-90cb-1beb60f1fe69 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:53.713407 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb42d7-9c1f-4cd9-90cb-1beb60f1fe69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:53.713708 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb42d7-9c1f-4cd9-90cb-1beb60f1fe69 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:53.714432 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb42d7-9c1f-4cd9-90cb-1beb60f1fe69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:53.716095 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb42d7-9c1f-4cd9-90cb-1beb60f1fe69 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:53.727357 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1268/2541] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:00:53.731852 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd8544-6fbd-4aa4-948e-000840f8194f admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:53.741975 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd8544-6fbd-4aa4-948e-000840f8194f admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:53.746679 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e38b1-3665-4633-a25b-b984544b16e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:53.747310 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e38b1-3665-4633-a25b-b984544b16e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:53.747573 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e38b1-3665-4633-a25b-b984544b16e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:53.747849 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e38b1-3665-4633-a25b-b984544b16e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:53.748601 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e38b1-3665-4633-a25b-b984544b16e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:53.750324 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e38b1-3665-4633-a25b-b984544b16e5 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:53.761723 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1274/2542] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:53.766463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb42d7-9c1f-4cd9-90cb-1beb60f1fe69 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:53.776811 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb42d7-9c1f-4cd9-90cb-1beb60f1fe69 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:53.782482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189fdc7-9926-4f10-a1b1-5ec238d7f9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:53.783154 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189fdc7-9926-4f10-a1b1-5ec238d7f9fb admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:53.783440 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189fdc7-9926-4f10-a1b1-5ec238d7f9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:53.783715 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189fdc7-9926-4f10-a1b1-5ec238d7f9fb admin admin] PATH_INFO: `/v3/projects/2ee93410192b4d47b26fa10aa2923477/users/ab5c37aa7913449c8c6847650c853367/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:53.799788 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189fdc7-9926-4f10-a1b1-5ec238d7f9fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ee93410192b4d47b26fa10aa2923477, user_id=ab5c37aa7913449c8c6847650c853367, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:53.802491 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189fdc7-9926-4f10-a1b1-5ec238d7f9fb admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:53.816058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1269/2543] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:53 2022] PUT /identity/v3/projects/2ee93410192b4d47b26fa10aa2923477/users/ab5c37aa7913449c8c6847650c853367/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:00:53.826911 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae524cd-2dc9-4eec-abe3-baf7e22d5f38 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:53.827276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae524cd-2dc9-4eec-abe3-baf7e22d5f38 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:53.827597 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae524cd-2dc9-4eec-abe3-baf7e22d5f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:53.856395 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-4ae524cd-2dc9-4eec-abe3-baf7e22d5f38 None None] MFA Rules not processed for user `ab5c37aa7913449c8c6847650c853367`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:53.857685 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-4ae524cd-2dc9-4eec-abe3-baf7e22d5f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:53.922543 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1275/2544] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:00:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:53.933644 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189fdc7-9926-4f10-a1b1-5ec238d7f9fb admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:53.935339 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-3189fdc7-9926-4f10-a1b1-5ec238d7f9fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:54.009587 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189fdc7-9926-4f10-a1b1-5ec238d7f9fb admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:54.016325 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd09b0-b331-4ca8-ae79-c98852594f90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:54.016969 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd09b0-b331-4ca8-ae79-c98852594f90 service nova] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:54.017251 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd09b0-b331-4ca8-ae79-c98852594f90 service nova] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:54.017549 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd09b0-b331-4ca8-ae79-c98852594f90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:54.025623 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd09b0-b331-4ca8-ae79-c98852594f90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:54.027479 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd09b0-b331-4ca8-ae79-c98852594f90 service nova] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:54.031099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:54.041427 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1270/2545] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:54.248913 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae524cd-2dc9-4eec-abe3-baf7e22d5f38 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:54.311519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae524cd-2dc9-4eec-abe3-baf7e22d5f38 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:54.316064 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a7b65-c0d3-49c6-8433-82d9e6b75063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:54.316704 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a7b65-c0d3-49c6-8433-82d9e6b75063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:54.316988 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a7b65-c0d3-49c6-8433-82d9e6b75063 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:54.317268 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a7b65-c0d3-49c6-8433-82d9e6b75063 admin admin] PATH_INFO: `/v3/users/ab5c37aa7913449c8c6847650c853367` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:54.318467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a7b65-c0d3-49c6-8433-82d9e6b75063 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab5c37aa7913449c8c6847650c853367)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:54.320395 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a7b65-c0d3-49c6-8433-82d9e6b75063 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:54.367415 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-618a7b65-c0d3-49c6-8433-82d9e6b75063 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab5c37aa7913449c8c6847650c853367'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:54.368066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-618a7b65-c0d3-49c6-8433-82d9e6b75063 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab5c37aa7913449c8c6847650c853367'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:54.368669 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-618a7b65-c0d3-49c6-8433-82d9e6b75063 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab5c37aa7913449c8c6847650c853367'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:54.380614 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-618a7b65-c0d3-49c6-8433-82d9e6b75063 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab5c37aa7913449c8c6847650c853367'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:54.385374 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:54.390509 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-618a7b65-c0d3-49c6-8433-82d9e6b75063 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab5c37aa7913449c8c6847650c853367'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:54.405106 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1276/2546] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:54 2022] DELETE /identity/v3/users/ab5c37aa7913449c8c6847650c853367 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:54.409677 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90276c9-4950-4666-a4d8-b917f59099ac None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:54.410162 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90276c9-4950-4666-a4d8-b917f59099ac None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:54.410269 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90276c9-4950-4666-a4d8-b917f59099ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:54.429040 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-c90276c9-4950-4666-a4d8-b917f59099ac None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:54.430303 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-c90276c9-4950-4666-a4d8-b917f59099ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:54.488193 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1271/2547] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:00:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:54.497903 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a7b65-c0d3-49c6-8433-82d9e6b75063 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:54.499554 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-618a7b65-c0d3-49c6-8433-82d9e6b75063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:54.557401 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a7b65-c0d3-49c6-8433-82d9e6b75063 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:54.561243 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d2fb8-f9a2-49c5-8ebd-442f377b69ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:54.561952 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d2fb8-f9a2-49c5-8ebd-442f377b69ca service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:54.562172 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d2fb8-f9a2-49c5-8ebd-442f377b69ca service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:54.562445 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d2fb8-f9a2-49c5-8ebd-442f377b69ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:54.571434 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d2fb8-f9a2-49c5-8ebd-442f377b69ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:54.572865 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d2fb8-f9a2-49c5-8ebd-442f377b69ca service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:54.583001 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1277/2548] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:54.848670 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90276c9-4950-4666-a4d8-b917f59099ac None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:54.850376 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-c90276c9-4950-4666-a4d8-b917f59099ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:54.868648 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90276c9-4950-4666-a4d8-b917f59099ac None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:54.874573 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d00ce-34ea-4876-8a60-9e345c325db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:54.875211 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d00ce-34ea-4876-8a60-9e345c325db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:54.875486 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d00ce-34ea-4876-8a60-9e345c325db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:54.875790 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d00ce-34ea-4876-8a60-9e345c325db7 admin admin] PATH_INFO: `/v3/projects/2ee93410192b4d47b26fa10aa2923477` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:54.876967 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d00ce-34ea-4876-8a60-9e345c325db7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ee93410192b4d47b26fa10aa2923477)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:54.879007 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d00ce-34ea-4876-8a60-9e345c325db7 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:54.932425 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a84d00ce-34ea-4876-8a60-9e345c325db7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ee93410192b4d47b26fa10aa2923477', 'request_id': 'req-a84d00ce-34ea-4876-8a60-9e345c325db7'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:54.939375 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a84d00ce-34ea-4876-8a60-9e345c325db7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ee93410192b4d47b26fa10aa2923477', 'request_id': 'req-a84d00ce-34ea-4876-8a60-9e345c325db7'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:54.945251 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a84d00ce-34ea-4876-8a60-9e345c325db7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ee93410192b4d47b26fa10aa2923477', 'request_id': 'req-a84d00ce-34ea-4876-8a60-9e345c325db7'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:54.958442 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a84d00ce-34ea-4876-8a60-9e345c325db7 admin admin] The token cache is being invalidate because project 2ee93410192b4d47b26fa10aa2923477 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:54.958763 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a84d00ce-34ea-4876-8a60-9e345c325db7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:54.959366 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a84d00ce-34ea-4876-8a60-9e345c325db7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:54.960861 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1272/2549] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:54 2022] DELETE /identity/v3/projects/2ee93410192b4d47b26fa10aa2923477 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:54.965752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5011674-15b4-48fd-8e42-33dd5dd29eef None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:54.966261 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5011674-15b4-48fd-8e42-33dd5dd29eef None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:54.966375 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5011674-15b4-48fd-8e42-33dd5dd29eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:54.985842 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-a5011674-15b4-48fd-8e42-33dd5dd29eef None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:54.987055 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-a5011674-15b4-48fd-8e42-33dd5dd29eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:55.046124 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1278/2550] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:00:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:55.055173 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8f19c-94c7-4b58-afc8-776fbc8d6dd0 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:55.055465 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8f19c-94c7-4b58-afc8-776fbc8d6dd0 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:55.055746 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8f19c-94c7-4b58-afc8-776fbc8d6dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:55.075625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-56a8f19c-94c7-4b58-afc8-776fbc8d6dd0 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:55.077451 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-56a8f19c-94c7-4b58-afc8-776fbc8d6dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:55.085382 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1273/2551] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:00:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:55.089442 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5011674-15b4-48fd-8e42-33dd5dd29eef None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:55.099531 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5011674-15b4-48fd-8e42-33dd5dd29eef None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:55.104287 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b80f5-92cd-41a9-ab80-702ecf71d4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:55.104897 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b80f5-92cd-41a9-ab80-702ecf71d4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:55.105179 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b80f5-92cd-41a9-ab80-702ecf71d4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:55.105458 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b80f5-92cd-41a9-ab80-702ecf71d4a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:55.106193 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b80f5-92cd-41a9-ab80-702ecf71d4a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:00:55.106502 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b80f5-92cd-41a9-ab80-702ecf71d4a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:55.108284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b80f5-92cd-41a9-ab80-702ecf71d4a2 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:55.119954 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1279/2552] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 13:00:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 13:00:55.124648 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8f19c-94c7-4b58-afc8-776fbc8d6dd0 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:55.134368 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8f19c-94c7-4b58-afc8-776fbc8d6dd0 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:55.139822 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a9f8a-0c85-473a-b535-99092482a938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:55.140429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a9f8a-0c85-473a-b535-99092482a938 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:55.140711 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a9f8a-0c85-473a-b535-99092482a938 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:55.140987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a9f8a-0c85-473a-b535-99092482a938 admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:55.141705 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a9f8a-0c85-473a-b535-99092482a938 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:55.143612 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a9f8a-0c85-473a-b535-99092482a938 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:55.170903 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1274/2553] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:55 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:55.175171 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b80f5-92cd-41a9-ab80-702ecf71d4a2 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:55.185137 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b80f5-92cd-41a9-ab80-702ecf71d4a2 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:55.243077 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f72b3e-c5b8-442b-b005-60939486f2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:55.243697 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f72b3e-c5b8-442b-b005-60939486f2fb admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:55.243981 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f72b3e-c5b8-442b-b005-60939486f2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:55.244258 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f72b3e-c5b8-442b-b005-60939486f2fb admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:55.244936 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f72b3e-c5b8-442b-b005-60939486f2fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:55.246995 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f72b3e-c5b8-442b-b005-60939486f2fb admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:55.268729 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1280/2554] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:55 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:55.272989 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a9f8a-0c85-473a-b535-99092482a938 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:55.283775 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a9f8a-0c85-473a-b535-99092482a938 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:55.288367 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b31b4-279c-49d1-bbcd-d56eaf18991c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:55.288980 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b31b4-279c-49d1-bbcd-d56eaf18991c admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:55.289264 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b31b4-279c-49d1-bbcd-d56eaf18991c admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:55.289570 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b31b4-279c-49d1-bbcd-d56eaf18991c admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:55.290302 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b31b4-279c-49d1-bbcd-d56eaf18991c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:55.291924 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b31b4-279c-49d1-bbcd-d56eaf18991c admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:55.302681 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1275/2555] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:00:55.306697 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f72b3e-c5b8-442b-b005-60939486f2fb admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:55.317348 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f72b3e-c5b8-442b-b005-60939486f2fb admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:55.322028 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38dcadf-cdc0-42cb-b274-345f09ee81f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:55.322633 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38dcadf-cdc0-42cb-b274-345f09ee81f3 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:55.322920 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38dcadf-cdc0-42cb-b274-345f09ee81f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:55.323199 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38dcadf-cdc0-42cb-b274-345f09ee81f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:55.323896 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38dcadf-cdc0-42cb-b274-345f09ee81f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:55.325565 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38dcadf-cdc0-42cb-b274-345f09ee81f3 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:55.326958 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:55.337274 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1281/2556] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:00:55.341460 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b31b4-279c-49d1-bbcd-d56eaf18991c admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:55.351659 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b31b4-279c-49d1-bbcd-d56eaf18991c admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:55.356183 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9dc26e-5ae1-4049-8751-eca799c82107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:55.356834 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9dc26e-5ae1-4049-8751-eca799c82107 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:55.357114 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9dc26e-5ae1-4049-8751-eca799c82107 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:55.357993 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9dc26e-5ae1-4049-8751-eca799c82107 admin admin] PATH_INFO: `/v3/projects/cd8fe1e6ed124407a8e8870402f5b0de/users/2fee086bfe2e42ea965e422be3a045d7/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:55.372301 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9dc26e-5ae1-4049-8751-eca799c82107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd8fe1e6ed124407a8e8870402f5b0de, user_id=2fee086bfe2e42ea965e422be3a045d7, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:55.375675 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9dc26e-5ae1-4049-8751-eca799c82107 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:55.388615 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1276/2557] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:55 2022] PUT /identity/v3/projects/cd8fe1e6ed124407a8e8870402f5b0de/users/2fee086bfe2e42ea965e422be3a045d7/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:55.399014 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0249d0-c358-4ccc-8db0-f3d2e665c5db None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:55.399305 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0249d0-c358-4ccc-8db0-f3d2e665c5db None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:55.399584 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0249d0-c358-4ccc-8db0-f3d2e665c5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:55.427918 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-db0249d0-c358-4ccc-8db0-f3d2e665c5db None None] MFA Rules not processed for user `2fee086bfe2e42ea965e422be3a045d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:55.429235 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-db0249d0-c358-4ccc-8db0-f3d2e665c5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:55.493405 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1282/2558] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:00:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:55.497981 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9dc26e-5ae1-4049-8751-eca799c82107 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:55.518248 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:55.564304 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9dc26e-5ae1-4049-8751-eca799c82107 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:55.568938 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e98e9-21d2-4ee1-94e0-d2fe5aee54d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:55.569571 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e98e9-21d2-4ee1-94e0-d2fe5aee54d7 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:55.569853 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e98e9-21d2-4ee1-94e0-d2fe5aee54d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:55.570126 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e98e9-21d2-4ee1-94e0-d2fe5aee54d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:55.570783 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e98e9-21d2-4ee1-94e0-d2fe5aee54d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:55.572667 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e98e9-21d2-4ee1-94e0-d2fe5aee54d7 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:55.598351 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1277/2559] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:55 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:00:55.602368 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0249d0-c358-4ccc-8db0-f3d2e665c5db None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:55.614045 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0249d0-c358-4ccc-8db0-f3d2e665c5db None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:55.673107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d2d63-79f7-4e40-a6fe-a2cdd03cd62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:55.673787 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d2d63-79f7-4e40-a6fe-a2cdd03cd62e admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:55.674101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d2d63-79f7-4e40-a6fe-a2cdd03cd62e admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:55.674385 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d2d63-79f7-4e40-a6fe-a2cdd03cd62e admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:55.675074 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d2d63-79f7-4e40-a6fe-a2cdd03cd62e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:55.677095 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d2d63-79f7-4e40-a6fe-a2cdd03cd62e admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:55.700943 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1283/2560] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:55 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:55.702582 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e98e9-21d2-4ee1-94e0-d2fe5aee54d7 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:55.712944 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e98e9-21d2-4ee1-94e0-d2fe5aee54d7 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:55.718221 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffe5a6-e8b8-4305-af5a-d198ec6f52bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:55.718829 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffe5a6-e8b8-4305-af5a-d198ec6f52bd admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:55.719112 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffe5a6-e8b8-4305-af5a-d198ec6f52bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:55.719420 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffe5a6-e8b8-4305-af5a-d198ec6f52bd admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:55.720112 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ffe5a6-e8b8-4305-af5a-d198ec6f52bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:55.721729 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ffe5a6-e8b8-4305-af5a-d198ec6f52bd admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:55.733184 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1278/2561] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:55.743658 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d2d63-79f7-4e40-a6fe-a2cdd03cd62e admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:55.753757 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d2d63-79f7-4e40-a6fe-a2cdd03cd62e admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:55.758691 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9f31d-92cd-438b-8383-f81f874f7667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:55.759349 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9f31d-92cd-438b-8383-f81f874f7667 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:55.759634 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9f31d-92cd-438b-8383-f81f874f7667 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:55.759914 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9f31d-92cd-438b-8383-f81f874f7667 admin admin] PATH_INFO: `/v3/projects/3be95798ec0445a781f74cb2d9288715/users/91cf796398d24ff0b5ede6a1081caacc/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:55.774505 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9f31d-92cd-438b-8383-f81f874f7667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3be95798ec0445a781f74cb2d9288715, user_id=91cf796398d24ff0b5ede6a1081caacc, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:55.777160 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9f31d-92cd-438b-8383-f81f874f7667 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:55.790833 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1284/2562] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:55 2022] PUT /identity/v3/projects/3be95798ec0445a781f74cb2d9288715/users/91cf796398d24ff0b5ede6a1081caacc/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:55.795588 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffe5a6-e8b8-4305-af5a-d198ec6f52bd admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:55.805673 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffe5a6-e8b8-4305-af5a-d198ec6f52bd admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:55.861386 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ec1e3-c6cc-470e-9651-7d3d938e5602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:55.861957 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ec1e3-c6cc-470e-9651-7d3d938e5602 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:55.862235 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ec1e3-c6cc-470e-9651-7d3d938e5602 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:55.862506 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ec1e3-c6cc-470e-9651-7d3d938e5602 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:55.863196 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ec1e3-c6cc-470e-9651-7d3d938e5602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:55.864775 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ec1e3-c6cc-470e-9651-7d3d938e5602 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:55.874509 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1279/2563] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:00:55.878655 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9f31d-92cd-438b-8383-f81f874f7667 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:55.889832 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9f31d-92cd-438b-8383-f81f874f7667 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:55.894390 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49f44e-c8eb-4580-9cd4-8226f2d4d670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:55.895047 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49f44e-c8eb-4580-9cd4-8226f2d4d670 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:55.895325 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49f44e-c8eb-4580-9cd4-8226f2d4d670 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:55.895602 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49f44e-c8eb-4580-9cd4-8226f2d4d670 admin admin] PATH_INFO: `/v3/projects/3be95798ec0445a781f74cb2d9288715/users/91cf796398d24ff0b5ede6a1081caacc/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:55.897583 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c49f44e-c8eb-4580-9cd4-8226f2d4d670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3be95798ec0445a781f74cb2d9288715, user_id=91cf796398d24ff0b5ede6a1081caacc, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:55.900221 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c49f44e-c8eb-4580-9cd4-8226f2d4d670 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:55.910963 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1285/2564] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:55 2022] PUT /identity/v3/projects/3be95798ec0445a781f74cb2d9288715/users/91cf796398d24ff0b5ede6a1081caacc/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:55.921139 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cdb75-e5d7-4a2e-98dc-7326a87eca8b None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:55.921456 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cdb75-e5d7-4a2e-98dc-7326a87eca8b None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:55.921765 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cdb75-e5d7-4a2e-98dc-7326a87eca8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:55.948781 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-086cdb75-e5d7-4a2e-98dc-7326a87eca8b None None] MFA Rules not processed for user `91cf796398d24ff0b5ede6a1081caacc`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:55.950043 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-086cdb75-e5d7-4a2e-98dc-7326a87eca8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:56.017378 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1280/2565] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:00:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:56.028599 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49f44e-c8eb-4580-9cd4-8226f2d4d670 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:56.031068 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-1c49f44e-c8eb-4580-9cd4-8226f2d4d670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:56.072372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:56.088828 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49f44e-c8eb-4580-9cd4-8226f2d4d670 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:56.093291 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1f8ec-7ee5-4d7b-88cd-4873862c4ffc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:56.093944 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1f8ec-7ee5-4d7b-88cd-4873862c4ffc service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:56.094226 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1f8ec-7ee5-4d7b-88cd-4873862c4ffc service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:56.094505 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1f8ec-7ee5-4d7b-88cd-4873862c4ffc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:56.103783 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1f8ec-7ee5-4d7b-88cd-4873862c4ffc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:56.105219 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1f8ec-7ee5-4d7b-88cd-4873862c4ffc service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:56.114862 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1286/2566] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:56 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:56.543856 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086cdb75-e5d7-4a2e-98dc-7326a87eca8b None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:56.557053 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:56.606243 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086cdb75-e5d7-4a2e-98dc-7326a87eca8b None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:56.610829 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5dfb43-adbb-4d12-9fbf-9b3d9448db79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:56.611462 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5dfb43-adbb-4d12-9fbf-9b3d9448db79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:56.611748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5dfb43-adbb-4d12-9fbf-9b3d9448db79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:56.612024 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5dfb43-adbb-4d12-9fbf-9b3d9448db79 admin admin] PATH_INFO: `/v3/users/2fee086bfe2e42ea965e422be3a045d7` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:56.613182 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5dfb43-adbb-4d12-9fbf-9b3d9448db79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fee086bfe2e42ea965e422be3a045d7)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:56.615137 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5dfb43-adbb-4d12-9fbf-9b3d9448db79 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:56.661038 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-be5dfb43-adbb-4d12-9fbf-9b3d9448db79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fee086bfe2e42ea965e422be3a045d7'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:56.668373 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-be5dfb43-adbb-4d12-9fbf-9b3d9448db79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fee086bfe2e42ea965e422be3a045d7'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:56.668984 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-be5dfb43-adbb-4d12-9fbf-9b3d9448db79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fee086bfe2e42ea965e422be3a045d7'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:56.669633 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-be5dfb43-adbb-4d12-9fbf-9b3d9448db79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fee086bfe2e42ea965e422be3a045d7'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:56.681818 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-be5dfb43-adbb-4d12-9fbf-9b3d9448db79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fee086bfe2e42ea965e422be3a045d7'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:56.694234 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1281/2567] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:56 2022] DELETE /identity/v3/users/2fee086bfe2e42ea965e422be3a045d7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:56.698730 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fba992-7716-4e7d-a61c-b720f4e5ea66 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:56.699099 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fba992-7716-4e7d-a61c-b720f4e5ea66 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:56.699377 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fba992-7716-4e7d-a61c-b720f4e5ea66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:56.719787 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-64fba992-7716-4e7d-a61c-b720f4e5ea66 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:56.721001 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-64fba992-7716-4e7d-a61c-b720f4e5ea66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:56.781336 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1287/2568] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:00:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:56.791155 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5dfb43-adbb-4d12-9fbf-9b3d9448db79 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:56.792560 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-be5dfb43-adbb-4d12-9fbf-9b3d9448db79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:56.849701 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5dfb43-adbb-4d12-9fbf-9b3d9448db79 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:56.853272 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427d1e6-2363-4b87-90ef-43cb0e397217 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:56.853924 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427d1e6-2363-4b87-90ef-43cb0e397217 service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:56.854208 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427d1e6-2363-4b87-90ef-43cb0e397217 service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:56.854479 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427d1e6-2363-4b87-90ef-43cb0e397217 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:56.863861 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427d1e6-2363-4b87-90ef-43cb0e397217 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:56.865288 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427d1e6-2363-4b87-90ef-43cb0e397217 service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:56.875289 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1282/2569] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:57.399530 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fba992-7716-4e7d-a61c-b720f4e5ea66 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:57.401314 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-64fba992-7716-4e7d-a61c-b720f4e5ea66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:57.415862 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fba992-7716-4e7d-a61c-b720f4e5ea66 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:57.420702 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10b1ca-6bb9-488d-8bac-d85efa1f443a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:57.421388 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10b1ca-6bb9-488d-8bac-d85efa1f443a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:57.421710 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10b1ca-6bb9-488d-8bac-d85efa1f443a admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:57.421985 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10b1ca-6bb9-488d-8bac-d85efa1f443a admin admin] PATH_INFO: `/v3/projects/cd8fe1e6ed124407a8e8870402f5b0de` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:57.423191 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10b1ca-6bb9-488d-8bac-d85efa1f443a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd8fe1e6ed124407a8e8870402f5b0de)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:57.425076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10b1ca-6bb9-488d-8bac-d85efa1f443a admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:57.474469 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-bd10b1ca-6bb9-488d-8bac-d85efa1f443a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd8fe1e6ed124407a8e8870402f5b0de', 'request_id': 'req-bd10b1ca-6bb9-488d-8bac-d85efa1f443a'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:57.480891 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-bd10b1ca-6bb9-488d-8bac-d85efa1f443a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd8fe1e6ed124407a8e8870402f5b0de', 'request_id': 'req-bd10b1ca-6bb9-488d-8bac-d85efa1f443a'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:57.488685 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-bd10b1ca-6bb9-488d-8bac-d85efa1f443a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd8fe1e6ed124407a8e8870402f5b0de', 'request_id': 'req-bd10b1ca-6bb9-488d-8bac-d85efa1f443a'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:57.499246 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-bd10b1ca-6bb9-488d-8bac-d85efa1f443a admin admin] The token cache is being invalidate because project cd8fe1e6ed124407a8e8870402f5b0de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:57.499532 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-bd10b1ca-6bb9-488d-8bac-d85efa1f443a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:57.500149 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-bd10b1ca-6bb9-488d-8bac-d85efa1f443a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:57.501691 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1288/2570] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:57 2022] DELETE /identity/v3/projects/cd8fe1e6ed124407a8e8870402f5b0de => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:57.505602 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427d1e6-2363-4b87-90ef-43cb0e397217 service neutron] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:57.516047 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427d1e6-2363-4b87-90ef-43cb0e397217 service neutron] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:57.548880 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:57.574679 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1e960-ecf9-4d1a-a405-7d138ad456d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:57.575383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1e960-ecf9-4d1a-a405-7d138ad456d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:57.575699 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1e960-ecf9-4d1a-a405-7d138ad456d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:57.575935 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1e960-ecf9-4d1a-a405-7d138ad456d6 admin admin] PATH_INFO: `/v3/users/91cf796398d24ff0b5ede6a1081caacc` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:57.577868 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1e960-ecf9-4d1a-a405-7d138ad456d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91cf796398d24ff0b5ede6a1081caacc)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:57.580150 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1e960-ecf9-4d1a-a405-7d138ad456d6 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:57.625437 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-47d1e960-ecf9-4d1a-a405-7d138ad456d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91cf796398d24ff0b5ede6a1081caacc'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:57.632601 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-47d1e960-ecf9-4d1a-a405-7d138ad456d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91cf796398d24ff0b5ede6a1081caacc'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:57.633213 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-47d1e960-ecf9-4d1a-a405-7d138ad456d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91cf796398d24ff0b5ede6a1081caacc'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:57.634109 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-47d1e960-ecf9-4d1a-a405-7d138ad456d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91cf796398d24ff0b5ede6a1081caacc'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:57.646223 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-47d1e960-ecf9-4d1a-a405-7d138ad456d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91cf796398d24ff0b5ede6a1081caacc'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:57.659308 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1283/2571] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:00:57 2022] DELETE /identity/v3/users/91cf796398d24ff0b5ede6a1081caacc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:57.930272 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10b1ca-6bb9-488d-8bac-d85efa1f443a admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:57.932183 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-bd10b1ca-6bb9-488d-8bac-d85efa1f443a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:57.947720 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10b1ca-6bb9-488d-8bac-d85efa1f443a admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:58.008672 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb763a-2c6c-4fff-af92-b417b9220f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:58.009316 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb763a-2c6c-4fff-af92-b417b9220f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:58.009638 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb763a-2c6c-4fff-af92-b417b9220f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:58.009918 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb763a-2c6c-4fff-af92-b417b9220f89 admin admin] PATH_INFO: `/v3/projects/3be95798ec0445a781f74cb2d9288715` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:58.011078 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb763a-2c6c-4fff-af92-b417b9220f89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3be95798ec0445a781f74cb2d9288715)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:58.013067 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb763a-2c6c-4fff-af92-b417b9220f89 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:58.019387 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:58.061425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-5fdb763a-2c6c-4fff-af92-b417b9220f89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3be95798ec0445a781f74cb2d9288715', 'request_id': 'req-5fdb763a-2c6c-4fff-af92-b417b9220f89'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:58.067542 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-5fdb763a-2c6c-4fff-af92-b417b9220f89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3be95798ec0445a781f74cb2d9288715', 'request_id': 'req-5fdb763a-2c6c-4fff-af92-b417b9220f89'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:58.074499 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-5fdb763a-2c6c-4fff-af92-b417b9220f89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3be95798ec0445a781f74cb2d9288715', 'request_id': 'req-5fdb763a-2c6c-4fff-af92-b417b9220f89'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:58.085028 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-5fdb763a-2c6c-4fff-af92-b417b9220f89 admin admin] The token cache is being invalidate because project 3be95798ec0445a781f74cb2d9288715 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:00:58.085313 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-5fdb763a-2c6c-4fff-af92-b417b9220f89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:58.085977 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-5fdb763a-2c6c-4fff-af92-b417b9220f89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:00:58.087484 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1289/2572] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:00:57 2022] DELETE /identity/v3/projects/3be95798ec0445a781f74cb2d9288715 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:58.093115 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c27ac-3907-4760-97e9-5d940e258c57 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:58.093405 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c27ac-3907-4760-97e9-5d940e258c57 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:58.093718 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c27ac-3907-4760-97e9-5d940e258c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:58.113730 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-625c27ac-3907-4760-97e9-5d940e258c57 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:58.114957 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-625c27ac-3907-4760-97e9-5d940e258c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:58.175520 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1284/2573] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:00:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:58.184618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d5ccd-9ff0-4934-8090-94f8b6ceed70 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:58.184900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d5ccd-9ff0-4934-8090-94f8b6ceed70 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:58.185171 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d5ccd-9ff0-4934-8090-94f8b6ceed70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:58.205305 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-c59d5ccd-9ff0-4934-8090-94f8b6ceed70 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:58.206540 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-c59d5ccd-9ff0-4934-8090-94f8b6ceed70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:58.214277 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1290/2574] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:00:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:58.219104 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c27ac-3907-4760-97e9-5d940e258c57 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:58.228619 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c27ac-3907-4760-97e9-5d940e258c57 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:58.233935 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2ef98-0fbb-4cb0-9b5b-1f58d9bebd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:58.234533 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2ef98-0fbb-4cb0-9b5b-1f58d9bebd32 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:58.234811 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2ef98-0fbb-4cb0-9b5b-1f58d9bebd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:58.235082 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2ef98-0fbb-4cb0-9b5b-1f58d9bebd32 admin admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:58.235768 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2ef98-0fbb-4cb0-9b5b-1f58d9bebd32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:00:58.236070 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2ef98-0fbb-4cb0-9b5b-1f58d9bebd32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:58.237682 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2ef98-0fbb-4cb0-9b5b-1f58d9bebd32 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:58.249237 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1285/2575] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 13:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:00:58.253359 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d5ccd-9ff0-4934-8090-94f8b6ceed70 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:58.262679 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d5ccd-9ff0-4934-8090-94f8b6ceed70 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:58.268111 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005728cc-70ad-4d5b-972e-c097a03b3356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:58.268730 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005728cc-70ad-4d5b-972e-c097a03b3356 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:58.269016 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005728cc-70ad-4d5b-972e-c097a03b3356 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:58.269297 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005728cc-70ad-4d5b-972e-c097a03b3356 admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:58.270021 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005728cc-70ad-4d5b-972e-c097a03b3356 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:58.272490 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005728cc-70ad-4d5b-972e-c097a03b3356 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:58.300608 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1291/2576] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:58 2022] POST /identity/v3/projects => generated 357 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:58.304761 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2ef98-0fbb-4cb0-9b5b-1f58d9bebd32 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:58.314939 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2ef98-0fbb-4cb0-9b5b-1f58d9bebd32 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:58.356100 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:58.373617 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885188ca-21ee-477f-9bc5-bbc8a2747538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:58.374235 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885188ca-21ee-477f-9bc5-bbc8a2747538 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:58.374518 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885188ca-21ee-477f-9bc5-bbc8a2747538 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:58.374797 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885188ca-21ee-477f-9bc5-bbc8a2747538 admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:58.375450 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885188ca-21ee-477f-9bc5-bbc8a2747538 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:58.377361 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885188ca-21ee-477f-9bc5-bbc8a2747538 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:58.398410 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1286/2577] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:58 2022] POST /identity/v3/users => generated 279 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:58.402669 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005728cc-70ad-4d5b-972e-c097a03b3356 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:58.413473 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005728cc-70ad-4d5b-972e-c097a03b3356 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:58.418082 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e2349-10f5-4f99-b910-93a35afb204f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:58.418684 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e2349-10f5-4f99-b910-93a35afb204f admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:58.418964 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e2349-10f5-4f99-b910-93a35afb204f admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:58.419237 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e2349-10f5-4f99-b910-93a35afb204f admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:58.419933 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e2349-10f5-4f99-b910-93a35afb204f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:58.421541 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e2349-10f5-4f99-b910-93a35afb204f admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:58.431594 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1292/2578] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:58.435551 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885188ca-21ee-477f-9bc5-bbc8a2747538 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:58.446012 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885188ca-21ee-477f-9bc5-bbc8a2747538 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:58.450550 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d9ff6-d06d-4f2a-b8e8-ce3af603e0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:58.451650 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d9ff6-d06d-4f2a-b8e8-ce3af603e0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:58.451924 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d9ff6-d06d-4f2a-b8e8-ce3af603e0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:58.452190 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d9ff6-d06d-4f2a-b8e8-ce3af603e0d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:58.452874 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d9ff6-d06d-4f2a-b8e8-ce3af603e0d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:58.454479 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d9ff6-d06d-4f2a-b8e8-ce3af603e0d8 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:58.464866 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1287/2579] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:58.469571 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e2349-10f5-4f99-b910-93a35afb204f admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:58.479474 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e2349-10f5-4f99-b910-93a35afb204f admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:58.484700 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf47a75-cf96-4243-a1c1-dae99d01eebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:58.485348 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf47a75-cf96-4243-a1c1-dae99d01eebc admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:58.485670 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf47a75-cf96-4243-a1c1-dae99d01eebc admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:58.485949 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf47a75-cf96-4243-a1c1-dae99d01eebc admin admin] PATH_INFO: `/v3/projects/e325f2c99cca4bd8b126e63ed6303910/users/9a75cf47a57e4282af1f23eb4f6467ec/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:58.500882 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf47a75-cf96-4243-a1c1-dae99d01eebc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e325f2c99cca4bd8b126e63ed6303910, user_id=9a75cf47a57e4282af1f23eb4f6467ec, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:58.503545 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf47a75-cf96-4243-a1c1-dae99d01eebc admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:58.516381 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1293/2580] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:58 2022] PUT /identity/v3/projects/e325f2c99cca4bd8b126e63ed6303910/users/9a75cf47a57e4282af1f23eb4f6467ec/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:58.526759 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fd21b-f9e2-4d12-b3d2-7bdc65dd27df None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:58.527066 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fd21b-f9e2-4d12-b3d2-7bdc65dd27df None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:58.527342 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fd21b-f9e2-4d12-b3d2-7bdc65dd27df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:58.555781 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-c04fd21b-f9e2-4d12-b3d2-7bdc65dd27df None None] MFA Rules not processed for user `9a75cf47a57e4282af1f23eb4f6467ec`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:58.556982 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-c04fd21b-f9e2-4d12-b3d2-7bdc65dd27df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:58.620059 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1288/2581] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:00:58 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:00:58.624724 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf47a75-cf96-4243-a1c1-dae99d01eebc admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:58.686600 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf47a75-cf96-4243-a1c1-dae99d01eebc admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:58.691240 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb019268-f0b8-442e-938e-bb29696a3c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:58.691846 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb019268-f0b8-442e-938e-bb29696a3c3a admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:58.692129 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb019268-f0b8-442e-938e-bb29696a3c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:58.692405 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb019268-f0b8-442e-938e-bb29696a3c3a admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:58.693058 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb019268-f0b8-442e-938e-bb29696a3c3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:58.694999 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb019268-f0b8-442e-938e-bb29696a3c3a admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:58.721090 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1294/2582] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 13:00:58 2022] POST /identity/v3/projects => generated 355 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:58.725238 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04fd21b-f9e2-4d12-b3d2-7bdc65dd27df None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:58.736894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04fd21b-f9e2-4d12-b3d2-7bdc65dd27df None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:58.792849 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7dfa32-d350-43fb-9003-b58593e8eec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:58.793467 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7dfa32-d350-43fb-9003-b58593e8eec8 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:58.793780 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7dfa32-d350-43fb-9003-b58593e8eec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:58.794059 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7dfa32-d350-43fb-9003-b58593e8eec8 admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:58.794742 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7dfa32-d350-43fb-9003-b58593e8eec8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:58.796669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7dfa32-d350-43fb-9003-b58593e8eec8 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:58.822283 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1289/2583] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 13:00:58 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:00:58.823369 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb019268-f0b8-442e-938e-bb29696a3c3a admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:58.834296 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb019268-f0b8-442e-938e-bb29696a3c3a admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:58.839125 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b52b1-de10-4c23-98fa-e1bd07a80f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:58.839730 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b52b1-de10-4c23-98fa-e1bd07a80f6a admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:58.840042 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b52b1-de10-4c23-98fa-e1bd07a80f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:58.840387 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b52b1-de10-4c23-98fa-e1bd07a80f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:58.841015 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b52b1-de10-4c23-98fa-e1bd07a80f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:58.843215 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b52b1-de10-4c23-98fa-e1bd07a80f6a admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:58.854332 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1295/2584] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:00:58.859019 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7dfa32-d350-43fb-9003-b58593e8eec8 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:58.869042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7dfa32-d350-43fb-9003-b58593e8eec8 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:58.873790 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb57b8-9026-4d5f-bce3-ac03aeaa378c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:58.874391 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb57b8-9026-4d5f-bce3-ac03aeaa378c admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:58.874676 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb57b8-9026-4d5f-bce3-ac03aeaa378c admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:58.874955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb57b8-9026-4d5f-bce3-ac03aeaa378c admin admin] PATH_INFO: `/v3/projects/cd932cdd450945fd88792570e3c025bd/users/e2ae6df8ac9447cf95a08ca006ee84a4/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:58.890257 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb57b8-9026-4d5f-bce3-ac03aeaa378c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd932cdd450945fd88792570e3c025bd, user_id=e2ae6df8ac9447cf95a08ca006ee84a4, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:58.892897 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb57b8-9026-4d5f-bce3-ac03aeaa378c admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:58.906871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1290/2585] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:58 2022] PUT /identity/v3/projects/cd932cdd450945fd88792570e3c025bd/users/e2ae6df8ac9447cf95a08ca006ee84a4/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:00:58.910665 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b52b1-de10-4c23-98fa-e1bd07a80f6a admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:58.917867 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:58.922218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b52b1-de10-4c23-98fa-e1bd07a80f6a admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:58.983906 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c48892-f5de-406c-b02d-ce8eab4c0cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:58.984534 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c48892-f5de-406c-b02d-ce8eab4c0cbb admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:58.984815 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c48892-f5de-406c-b02d-ce8eab4c0cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:58.985090 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c48892-f5de-406c-b02d-ce8eab4c0cbb admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:58.985824 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c48892-f5de-406c-b02d-ce8eab4c0cbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:58.987452 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c48892-f5de-406c-b02d-ce8eab4c0cbb admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:58.997448 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1296/2586] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:00:59.001998 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb57b8-9026-4d5f-bce3-ac03aeaa378c admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:59.012545 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb57b8-9026-4d5f-bce3-ac03aeaa378c admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:59.018072 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7fbbb1-7674-4cfa-9856-4e856042b0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:59.018732 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fbbb1-7674-4cfa-9856-4e856042b0f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:59.019012 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fbbb1-7674-4cfa-9856-4e856042b0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:59.019287 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fbbb1-7674-4cfa-9856-4e856042b0f7 admin admin] PATH_INFO: `/v3/projects/cd932cdd450945fd88792570e3c025bd/users/e2ae6df8ac9447cf95a08ca006ee84a4/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:59.021237 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7fbbb1-7674-4cfa-9856-4e856042b0f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd932cdd450945fd88792570e3c025bd, user_id=e2ae6df8ac9447cf95a08ca006ee84a4, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:59.023874 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7fbbb1-7674-4cfa-9856-4e856042b0f7 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:59.034827 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1291/2587] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:00:59 2022] PUT /identity/v3/projects/cd932cdd450945fd88792570e3c025bd/users/e2ae6df8ac9447cf95a08ca006ee84a4/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:00:59.046358 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab656e22-f640-44c8-b96d-33fd99976b5f None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:59.046654 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab656e22-f640-44c8-b96d-33fd99976b5f None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:59.046939 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab656e22-f640-44c8-b96d-33fd99976b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:59.074366 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-ab656e22-f640-44c8-b96d-33fd99976b5f None None] MFA Rules not processed for user `e2ae6df8ac9447cf95a08ca006ee84a4`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:00:59.075588 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-ab656e22-f640-44c8-b96d-33fd99976b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:59.144328 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1297/2588] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:00:59 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:00:59.157555 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7fbbb1-7674-4cfa-9856-4e856042b0f7 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:59.159260 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-6a7fbbb1-7674-4cfa-9856-4e856042b0f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:00:59.164659 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:00:59.218403 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7fbbb1-7674-4cfa-9856-4e856042b0f7 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:59.221978 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28add83d-bf5a-4996-b664-e934d6f983f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:59.222582 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28add83d-bf5a-4996-b664-e934d6f983f8 service cinder] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:59.222861 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28add83d-bf5a-4996-b664-e934d6f983f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:59.223129 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28add83d-bf5a-4996-b664-e934d6f983f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:59.231903 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28add83d-bf5a-4996-b664-e934d6f983f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:59.233459 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28add83d-bf5a-4996-b664-e934d6f983f8 service cinder] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:59.242711 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1292/2589] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:59 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:00:59.317432 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab656e22-f640-44c8-b96d-33fd99976b5f None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:00:59.327897 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab656e22-f640-44c8-b96d-33fd99976b5f None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:00:59.331596 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1872f2-db09-4131-a0b0-78a3ad700c31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:00:59.332227 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1872f2-db09-4131-a0b0-78a3ad700c31 service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:00:59.332507 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1872f2-db09-4131-a0b0-78a3ad700c31 service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:00:59.332782 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1872f2-db09-4131-a0b0-78a3ad700c31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:00:59.389691 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1872f2-db09-4131-a0b0-78a3ad700c31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:00:59.391131 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1872f2-db09-4131-a0b0-78a3ad700c31 service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:00:59.400174 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1298/2590] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:00:59 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:01:09.238661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=25 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:09.395997 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:09.447742 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28add83d-bf5a-4996-b664-e934d6f983f8 service cinder] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:09.449281 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-28add83d-bf5a-4996-b664-e934d6f983f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:09.513230 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28add83d-bf5a-4996-b664-e934d6f983f8 service cinder] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:09.518542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496ab7a-0b2a-4952-bae1-f202b1a898b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:09.519181 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496ab7a-0b2a-4952-bae1-f202b1a898b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:09.519460 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496ab7a-0b2a-4952-bae1-f202b1a898b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:09.519734 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496ab7a-0b2a-4952-bae1-f202b1a898b9 admin admin] PATH_INFO: `/v3/users/9d2219889ee44155adc5cc66c722a0e8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:09.520883 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496ab7a-0b2a-4952-bae1-f202b1a898b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d2219889ee44155adc5cc66c722a0e8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:09.522822 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496ab7a-0b2a-4952-bae1-f202b1a898b9 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:09.568833 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-3496ab7a-0b2a-4952-bae1-f202b1a898b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d2219889ee44155adc5cc66c722a0e8'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:09.576499 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-3496ab7a-0b2a-4952-bae1-f202b1a898b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d2219889ee44155adc5cc66c722a0e8'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:09.577056 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-3496ab7a-0b2a-4952-bae1-f202b1a898b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d2219889ee44155adc5cc66c722a0e8'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:09.577687 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-3496ab7a-0b2a-4952-bae1-f202b1a898b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d2219889ee44155adc5cc66c722a0e8'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:09.589477 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-3496ab7a-0b2a-4952-bae1-f202b1a898b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d2219889ee44155adc5cc66c722a0e8'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:09.602109 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1293/2591] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:01:09 2022] DELETE /identity/v3/users/9d2219889ee44155adc5cc66c722a0e8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:09.606577 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f8e38-f195-461d-869c-7398daf3dace None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:09.606867 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f8e38-f195-461d-869c-7398daf3dace None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:09.607263 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f8e38-f195-461d-869c-7398daf3dace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:09.626016 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-fc6f8e38-f195-461d-869c-7398daf3dace None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:09.627237 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-fc6f8e38-f195-461d-869c-7398daf3dace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:09.686940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1299/2592] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:09.697032 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496ab7a-0b2a-4952-bae1-f202b1a898b9 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:09.698719 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-3496ab7a-0b2a-4952-bae1-f202b1a898b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:09.758066 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496ab7a-0b2a-4952-bae1-f202b1a898b9 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:09.762149 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b1e38-8aea-4f7e-a2be-9026f6a5cc6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:09.762826 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b1e38-8aea-4f7e-a2be-9026f6a5cc6d service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:09.764155 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b1e38-8aea-4f7e-a2be-9026f6a5cc6d service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:09.764155 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b1e38-8aea-4f7e-a2be-9026f6a5cc6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:09.774142 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b1e38-8aea-4f7e-a2be-9026f6a5cc6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:09.775698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b1e38-8aea-4f7e-a2be-9026f6a5cc6d service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:09.787092 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1294/2593] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:01:10.054092 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f8e38-f195-461d-869c-7398daf3dace None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:10.055915 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-fc6f8e38-f195-461d-869c-7398daf3dace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:10.068537 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f8e38-f195-461d-869c-7398daf3dace None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:10.073712 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50300d-176b-4c6a-953a-b27e3774ccef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:10.074372 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50300d-176b-4c6a-953a-b27e3774ccef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:10.074653 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50300d-176b-4c6a-953a-b27e3774ccef admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:10.074928 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50300d-176b-4c6a-953a-b27e3774ccef admin admin] PATH_INFO: `/v3/projects/8c4a1acacafb4745b14b8e72f930b43c` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:10.076863 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba50300d-176b-4c6a-953a-b27e3774ccef admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c4a1acacafb4745b14b8e72f930b43c)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:10.078831 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba50300d-176b-4c6a-953a-b27e3774ccef admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:10.125081 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-ba50300d-176b-4c6a-953a-b27e3774ccef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c4a1acacafb4745b14b8e72f930b43c', 'request_id': 'req-ba50300d-176b-4c6a-953a-b27e3774ccef'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:10.131445 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-ba50300d-176b-4c6a-953a-b27e3774ccef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c4a1acacafb4745b14b8e72f930b43c', 'request_id': 'req-ba50300d-176b-4c6a-953a-b27e3774ccef'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:10.139131 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-ba50300d-176b-4c6a-953a-b27e3774ccef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c4a1acacafb4745b14b8e72f930b43c', 'request_id': 'req-ba50300d-176b-4c6a-953a-b27e3774ccef'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:10.149750 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-ba50300d-176b-4c6a-953a-b27e3774ccef admin admin] The token cache is being invalidate because project 8c4a1acacafb4745b14b8e72f930b43c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:01:10.150045 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-ba50300d-176b-4c6a-953a-b27e3774ccef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:10.150888 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-ba50300d-176b-4c6a-953a-b27e3774ccef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:10.152628 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1300/2594] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:01:10 2022] DELETE /identity/v3/projects/8c4a1acacafb4745b14b8e72f930b43c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:10.157438 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbc764-fed9-4e69-93fb-b4d94f216a1c None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:10.157834 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbc764-fed9-4e69-93fb-b4d94f216a1c None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:10.158115 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbc764-fed9-4e69-93fb-b4d94f216a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:10.178020 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-8efbc764-fed9-4e69-93fb-b4d94f216a1c None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:10.179233 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-8efbc764-fed9-4e69-93fb-b4d94f216a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:10.198088 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:10.243393 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1295/2595] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:10.312274 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad06989-1760-4a14-9cc2-b1d4f736c2d1 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:10.312569 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad06989-1760-4a14-9cc2-b1d4f736c2d1 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:10.312870 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad06989-1760-4a14-9cc2-b1d4f736c2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:10.334200 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-1ad06989-1760-4a14-9cc2-b1d4f736c2d1 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:10.335423 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-1ad06989-1760-4a14-9cc2-b1d4f736c2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:10.343981 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1301/2596] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:10.348240 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbc764-fed9-4e69-93fb-b4d94f216a1c None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:10.358721 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbc764-fed9-4e69-93fb-b4d94f216a1c None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:10.363409 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e4b22-3749-4d82-a869-9bb3bb01429a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:10.364090 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e4b22-3749-4d82-a869-9bb3bb01429a admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:10.364344 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e4b22-3749-4d82-a869-9bb3bb01429a admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:10.364655 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e4b22-3749-4d82-a869-9bb3bb01429a admin admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:10.365339 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e4b22-3749-4d82-a869-9bb3bb01429a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:01:10.365720 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e4b22-3749-4d82-a869-9bb3bb01429a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:10.367270 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e4b22-3749-4d82-a869-9bb3bb01429a admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:10.379223 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1296/2597] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 13:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:01:10.383486 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad06989-1760-4a14-9cc2-b1d4f736c2d1 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:10.393748 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad06989-1760-4a14-9cc2-b1d4f736c2d1 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:10.398527 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df377314-8403-4e13-885c-7745b0de6e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:10.399136 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df377314-8403-4e13-885c-7745b0de6e15 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:10.399418 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df377314-8403-4e13-885c-7745b0de6e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:10.399693 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df377314-8403-4e13-885c-7745b0de6e15 admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:10.400366 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df377314-8403-4e13-885c-7745b0de6e15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:10.402301 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df377314-8403-4e13-885c-7745b0de6e15 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:10.429916 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1302/2598] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 13:01:10 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:01:10.433805 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e4b22-3749-4d82-a869-9bb3bb01429a admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:10.443822 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e4b22-3749-4d82-a869-9bb3bb01429a admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:10.499679 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa640875-be0c-4a56-8cc6-df8a961a112a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:10.500281 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa640875-be0c-4a56-8cc6-df8a961a112a admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:10.500560 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa640875-be0c-4a56-8cc6-df8a961a112a admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:10.500832 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa640875-be0c-4a56-8cc6-df8a961a112a admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:10.501474 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa640875-be0c-4a56-8cc6-df8a961a112a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:10.503392 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa640875-be0c-4a56-8cc6-df8a961a112a admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:10.524910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1297/2599] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 13:01:10 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:01:10.529248 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df377314-8403-4e13-885c-7745b0de6e15 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:10.539719 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df377314-8403-4e13-885c-7745b0de6e15 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:10.544661 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e1383e-5de6-4195-9343-cc56b22f1a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:10.545327 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1383e-5de6-4195-9343-cc56b22f1a29 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:10.545626 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1383e-5de6-4195-9343-cc56b22f1a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:10.545903 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1383e-5de6-4195-9343-cc56b22f1a29 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:10.546655 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e1383e-5de6-4195-9343-cc56b22f1a29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:10.548363 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e1383e-5de6-4195-9343-cc56b22f1a29 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:10.558408 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1303/2600] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:01:10.563008 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa640875-be0c-4a56-8cc6-df8a961a112a admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:10.572897 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa640875-be0c-4a56-8cc6-df8a961a112a admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:10.578888 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63589030-75cc-4d3b-b955-b9071f5a9bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:10.579497 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63589030-75cc-4d3b-b955-b9071f5a9bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:10.579784 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63589030-75cc-4d3b-b955-b9071f5a9bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:10.580058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63589030-75cc-4d3b-b955-b9071f5a9bc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:10.580754 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63589030-75cc-4d3b-b955-b9071f5a9bc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:10.582385 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63589030-75cc-4d3b-b955-b9071f5a9bc6 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:10.593042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1298/2601] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:01:10.597302 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e1383e-5de6-4195-9343-cc56b22f1a29 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:10.607510 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e1383e-5de6-4195-9343-cc56b22f1a29 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:10.612167 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351f74b-f30a-46f8-9718-c139b221bccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:10.612819 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351f74b-f30a-46f8-9718-c139b221bccf admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:10.613100 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351f74b-f30a-46f8-9718-c139b221bccf admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:10.613376 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351f74b-f30a-46f8-9718-c139b221bccf admin admin] PATH_INFO: `/v3/projects/34b4544652b9419682c7de707d1d945f/users/764b978c482946a688c9a3a903b1d3d1/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:10.628329 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4351f74b-f30a-46f8-9718-c139b221bccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=34b4544652b9419682c7de707d1d945f, user_id=764b978c482946a688c9a3a903b1d3d1, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:10.631004 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4351f74b-f30a-46f8-9718-c139b221bccf admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:10.644534 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1304/2602] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:01:10 2022] PUT /identity/v3/projects/34b4544652b9419682c7de707d1d945f/users/764b978c482946a688c9a3a903b1d3d1/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:01:10.654668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae6564-d8a1-4805-8a89-6330bf361350 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:10.654954 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae6564-d8a1-4805-8a89-6330bf361350 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:10.655227 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae6564-d8a1-4805-8a89-6330bf361350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:10.684000 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-5eae6564-d8a1-4805-8a89-6330bf361350 None None] MFA Rules not processed for user `764b978c482946a688c9a3a903b1d3d1`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:10.685969 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-5eae6564-d8a1-4805-8a89-6330bf361350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:10.756792 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1299/2603] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:01:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:10.764963 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351f74b-f30a-46f8-9718-c139b221bccf admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:10.766911 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-4351f74b-f30a-46f8-9718-c139b221bccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:10.791769 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:10.831041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351f74b-f30a-46f8-9718-c139b221bccf admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:10.835244 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b39135-f781-46f2-be28-14667701b189 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:10.835876 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b39135-f781-46f2-be28-14667701b189 service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:10.836161 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b39135-f781-46f2-be28-14667701b189 service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:10.836431 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b39135-f781-46f2-be28-14667701b189 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:10.846646 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b39135-f781-46f2-be28-14667701b189 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:10.848076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b39135-f781-46f2-be28-14667701b189 service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:10.857990 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1305/2604] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:01:14.399875 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae6564-d8a1-4805-8a89-6330bf361350 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:14.401305 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-5eae6564-d8a1-4805-8a89-6330bf361350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:14.423355 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:14.474780 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae6564-d8a1-4805-8a89-6330bf361350 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:14.479588 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3268e-b1c4-4260-9fef-e05724e0071b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:14.480234 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3268e-b1c4-4260-9fef-e05724e0071b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:14.480513 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3268e-b1c4-4260-9fef-e05724e0071b admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:14.480807 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3268e-b1c4-4260-9fef-e05724e0071b admin admin] PATH_INFO: `/v3/users/9a75cf47a57e4282af1f23eb4f6467ec` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:14.482584 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3268e-b1c4-4260-9fef-e05724e0071b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a75cf47a57e4282af1f23eb4f6467ec)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:14.484607 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3268e-b1c4-4260-9fef-e05724e0071b admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:14.532489 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-b2b3268e-b1c4-4260-9fef-e05724e0071b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a75cf47a57e4282af1f23eb4f6467ec'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:14.540935 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-b2b3268e-b1c4-4260-9fef-e05724e0071b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a75cf47a57e4282af1f23eb4f6467ec'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:14.541606 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-b2b3268e-b1c4-4260-9fef-e05724e0071b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a75cf47a57e4282af1f23eb4f6467ec'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:14.542220 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-b2b3268e-b1c4-4260-9fef-e05724e0071b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a75cf47a57e4282af1f23eb4f6467ec'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:14.555267 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-b2b3268e-b1c4-4260-9fef-e05724e0071b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a75cf47a57e4282af1f23eb4f6467ec'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:14.568054 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1300/2605] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:01:14 2022] DELETE /identity/v3/users/9a75cf47a57e4282af1f23eb4f6467ec => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:14.572362 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70d383-72bf-401b-a99c-991dbfad4387 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:14.572890 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70d383-72bf-401b-a99c-991dbfad4387 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:14.573103 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70d383-72bf-401b-a99c-991dbfad4387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:14.593239 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-dc70d383-72bf-401b-a99c-991dbfad4387 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:14.594549 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-dc70d383-72bf-401b-a99c-991dbfad4387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:14.658774 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1306/2606] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:14.668412 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3268e-b1c4-4260-9fef-e05724e0071b admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:14.670001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-b2b3268e-b1c4-4260-9fef-e05724e0071b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:14.734581 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3268e-b1c4-4260-9fef-e05724e0071b admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:14.738730 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a468ae-2ffa-473c-93ee-97ff3e0b5bed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:14.739293 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a468ae-2ffa-473c-93ee-97ff3e0b5bed service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:14.739577 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a468ae-2ffa-473c-93ee-97ff3e0b5bed service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:14.739852 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a468ae-2ffa-473c-93ee-97ff3e0b5bed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:14.750684 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a468ae-2ffa-473c-93ee-97ff3e0b5bed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:14.752218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a468ae-2ffa-473c-93ee-97ff3e0b5bed service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:14.762677 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1301/2607] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:01:15.191482 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70d383-72bf-401b-a99c-991dbfad4387 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:15.193182 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-dc70d383-72bf-401b-a99c-991dbfad4387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:15.212693 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70d383-72bf-401b-a99c-991dbfad4387 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:15.225895 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4d6f8-73d4-403d-96b1-1306f1537cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:15.226600 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4d6f8-73d4-403d-96b1-1306f1537cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:15.226883 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4d6f8-73d4-403d-96b1-1306f1537cde admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:15.227156 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4d6f8-73d4-403d-96b1-1306f1537cde admin admin] PATH_INFO: `/v3/projects/e325f2c99cca4bd8b126e63ed6303910` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:15.228604 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4d6f8-73d4-403d-96b1-1306f1537cde admin admin] RBAC: Authorizing `identity:delete_project(project_id=e325f2c99cca4bd8b126e63ed6303910)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:15.230558 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4d6f8-73d4-403d-96b1-1306f1537cde admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:15.287433 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-e3b4d6f8-73d4-403d-96b1-1306f1537cde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e325f2c99cca4bd8b126e63ed6303910', 'request_id': 'req-e3b4d6f8-73d4-403d-96b1-1306f1537cde'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:15.293957 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-e3b4d6f8-73d4-403d-96b1-1306f1537cde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e325f2c99cca4bd8b126e63ed6303910', 'request_id': 'req-e3b4d6f8-73d4-403d-96b1-1306f1537cde'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:15.303384 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-e3b4d6f8-73d4-403d-96b1-1306f1537cde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e325f2c99cca4bd8b126e63ed6303910', 'request_id': 'req-e3b4d6f8-73d4-403d-96b1-1306f1537cde'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:15.315392 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-e3b4d6f8-73d4-403d-96b1-1306f1537cde admin admin] The token cache is being invalidate because project e325f2c99cca4bd8b126e63ed6303910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:01:15.315672 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-e3b4d6f8-73d4-403d-96b1-1306f1537cde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:15.316318 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-e3b4d6f8-73d4-403d-96b1-1306f1537cde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:15.318041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1307/2608] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:01:15 2022] DELETE /identity/v3/projects/e325f2c99cca4bd8b126e63ed6303910 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:15.322023 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a468ae-2ffa-473c-93ee-97ff3e0b5bed service neutron] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:15.332561 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a468ae-2ffa-473c-93ee-97ff3e0b5bed service neutron] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:15.379722 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:15.405107 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dca1a0-0c1c-4674-bb94-28ff33ee14e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:15.406554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dca1a0-0c1c-4674-bb94-28ff33ee14e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:15.406836 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dca1a0-0c1c-4674-bb94-28ff33ee14e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:15.407112 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dca1a0-0c1c-4674-bb94-28ff33ee14e7 admin admin] PATH_INFO: `/v3/users/e2ae6df8ac9447cf95a08ca006ee84a4` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:15.408309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dca1a0-0c1c-4674-bb94-28ff33ee14e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2ae6df8ac9447cf95a08ca006ee84a4)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:15.410455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dca1a0-0c1c-4674-bb94-28ff33ee14e7 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:15.464021 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-86dca1a0-0c1c-4674-bb94-28ff33ee14e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2ae6df8ac9447cf95a08ca006ee84a4'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:15.474746 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-86dca1a0-0c1c-4674-bb94-28ff33ee14e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2ae6df8ac9447cf95a08ca006ee84a4'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:15.475828 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-86dca1a0-0c1c-4674-bb94-28ff33ee14e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2ae6df8ac9447cf95a08ca006ee84a4'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:15.476710 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-86dca1a0-0c1c-4674-bb94-28ff33ee14e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2ae6df8ac9447cf95a08ca006ee84a4'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:15.491430 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-86dca1a0-0c1c-4674-bb94-28ff33ee14e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2ae6df8ac9447cf95a08ca006ee84a4'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:15.504924 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1302/2609] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:01:15 2022] DELETE /identity/v3/users/e2ae6df8ac9447cf95a08ca006ee84a4 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:01:15.839376 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4d6f8-73d4-403d-96b1-1306f1537cde admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:15.842068 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-e3b4d6f8-73d4-403d-96b1-1306f1537cde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:15.858284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4d6f8-73d4-403d-96b1-1306f1537cde admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:15.910208 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:15.926687 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0a168-e659-4dd6-97ee-b09e41473c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:15.927528 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0a168-e659-4dd6-97ee-b09e41473c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:15.927910 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0a168-e659-4dd6-97ee-b09e41473c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:15.928285 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0a168-e659-4dd6-97ee-b09e41473c77 admin admin] PATH_INFO: `/v3/projects/cd932cdd450945fd88792570e3c025bd` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:15.929748 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0a168-e659-4dd6-97ee-b09e41473c77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd932cdd450945fd88792570e3c025bd)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:15.931852 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0a168-e659-4dd6-97ee-b09e41473c77 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:15.983888 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-52f0a168-e659-4dd6-97ee-b09e41473c77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd932cdd450945fd88792570e3c025bd', 'request_id': 'req-52f0a168-e659-4dd6-97ee-b09e41473c77'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:15.990862 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-52f0a168-e659-4dd6-97ee-b09e41473c77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd932cdd450945fd88792570e3c025bd', 'request_id': 'req-52f0a168-e659-4dd6-97ee-b09e41473c77'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:16.000411 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-52f0a168-e659-4dd6-97ee-b09e41473c77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd932cdd450945fd88792570e3c025bd', 'request_id': 'req-52f0a168-e659-4dd6-97ee-b09e41473c77'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:16.012942 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-52f0a168-e659-4dd6-97ee-b09e41473c77 admin admin] The token cache is being invalidate because project cd932cdd450945fd88792570e3c025bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:01:16.013174 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-52f0a168-e659-4dd6-97ee-b09e41473c77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:16.013984 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-52f0a168-e659-4dd6-97ee-b09e41473c77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:16.015750 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1308/2610] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:01:15 2022] DELETE /identity/v3/projects/cd932cdd450945fd88792570e3c025bd => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:16.020868 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c7105-645b-4143-81db-a0f1f37c80b7 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:16.021158 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c7105-645b-4143-81db-a0f1f37c80b7 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:16.021438 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c7105-645b-4143-81db-a0f1f37c80b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:16.043022 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-2f7c7105-645b-4143-81db-a0f1f37c80b7 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:16.044255 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-2f7c7105-645b-4143-81db-a0f1f37c80b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:16.106467 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1303/2611] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:16.115079 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cb976-3edd-4fc4-b07a-b57a4dc6e4a1 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:16.115374 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cb976-3edd-4fc4-b07a-b57a4dc6e4a1 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:16.115654 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cb976-3edd-4fc4-b07a-b57a4dc6e4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:16.136587 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-2f6cb976-3edd-4fc4-b07a-b57a4dc6e4a1 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:16.137933 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-2f6cb976-3edd-4fc4-b07a-b57a4dc6e4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:16.147084 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1309/2612] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:16.151643 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c7105-645b-4143-81db-a0f1f37c80b7 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:16.163638 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c7105-645b-4143-81db-a0f1f37c80b7 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:16.168505 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee83af1-dca2-454d-ad4a-4fb8f8eb7770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:16.169154 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee83af1-dca2-454d-ad4a-4fb8f8eb7770 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:16.169488 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee83af1-dca2-454d-ad4a-4fb8f8eb7770 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:16.169863 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee83af1-dca2-454d-ad4a-4fb8f8eb7770 admin admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:16.170681 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee83af1-dca2-454d-ad4a-4fb8f8eb7770 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:01:16.170990 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee83af1-dca2-454d-ad4a-4fb8f8eb7770 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:16.172657 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee83af1-dca2-454d-ad4a-4fb8f8eb7770 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:16.185897 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1304/2613] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 13:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:01:16.190734 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6cb976-3edd-4fc4-b07a-b57a4dc6e4a1 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:16.200441 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6cb976-3edd-4fc4-b07a-b57a4dc6e4a1 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:16.206091 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5aa27-1530-43e7-976e-4810501c7c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:16.206770 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5aa27-1530-43e7-976e-4810501c7c9e admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:16.207051 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5aa27-1530-43e7-976e-4810501c7c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:16.207329 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5aa27-1530-43e7-976e-4810501c7c9e admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:16.208018 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5aa27-1530-43e7-976e-4810501c7c9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:16.210010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5aa27-1530-43e7-976e-4810501c7c9e admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:16.243822 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1310/2614] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 13:01:16 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:01:16.245138 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee83af1-dca2-454d-ad4a-4fb8f8eb7770 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:16.256431 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee83af1-dca2-454d-ad4a-4fb8f8eb7770 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:16.305546 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:16.319593 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e45cf-a930-44f1-84a7-642424ce00f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:16.320659 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e45cf-a930-44f1-84a7-642424ce00f6 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:16.321240 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e45cf-a930-44f1-84a7-642424ce00f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:16.321697 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e45cf-a930-44f1-84a7-642424ce00f6 admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:16.322515 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e45cf-a930-44f1-84a7-642424ce00f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:16.324749 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e45cf-a930-44f1-84a7-642424ce00f6 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:16.349550 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1305/2615] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 13:01:16 2022] POST /identity/v3/users => generated 283 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:01:16.351782 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5aa27-1530-43e7-976e-4810501c7c9e admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:16.363210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5aa27-1530-43e7-976e-4810501c7c9e admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:16.367958 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81fb24-dab8-4214-b1c3-e950e23fd789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:16.368575 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81fb24-dab8-4214-b1c3-e950e23fd789 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:16.368860 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81fb24-dab8-4214-b1c3-e950e23fd789 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:16.369137 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81fb24-dab8-4214-b1c3-e950e23fd789 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:16.369905 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81fb24-dab8-4214-b1c3-e950e23fd789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:16.371497 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81fb24-dab8-4214-b1c3-e950e23fd789 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:16.385527 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1311/2616] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:01:16.387248 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e45cf-a930-44f1-84a7-642424ce00f6 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:16.397867 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e45cf-a930-44f1-84a7-642424ce00f6 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:16.402525 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e47303-f5eb-4cb7-aaef-7ed508c56114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:16.403142 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e47303-f5eb-4cb7-aaef-7ed508c56114 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:16.403419 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e47303-f5eb-4cb7-aaef-7ed508c56114 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:16.403692 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e47303-f5eb-4cb7-aaef-7ed508c56114 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:16.404453 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e47303-f5eb-4cb7-aaef-7ed508c56114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:16.406178 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e47303-f5eb-4cb7-aaef-7ed508c56114 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:16.418613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1306/2617] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:01:16.423279 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81fb24-dab8-4214-b1c3-e950e23fd789 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:16.433327 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81fb24-dab8-4214-b1c3-e950e23fd789 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:16.438852 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b74b1-3277-493a-be82-acdf10ee6055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:16.439539 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b74b1-3277-493a-be82-acdf10ee6055 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:16.439794 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b74b1-3277-493a-be82-acdf10ee6055 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:16.440129 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b74b1-3277-493a-be82-acdf10ee6055 admin admin] PATH_INFO: `/v3/projects/664cebf000b84ccf86497b86f72940c9/users/fbf4b9cde8424ade84292ba2df1ec185/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:16.455866 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b74b1-3277-493a-be82-acdf10ee6055 admin admin] RBAC: Authorizing `identity:create_grant(project_id=664cebf000b84ccf86497b86f72940c9, user_id=fbf4b9cde8424ade84292ba2df1ec185, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:16.458670 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b74b1-3277-493a-be82-acdf10ee6055 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:16.472245 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1312/2618] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:01:16 2022] PUT /identity/v3/projects/664cebf000b84ccf86497b86f72940c9/users/fbf4b9cde8424ade84292ba2df1ec185/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:16.483097 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d566e-2d9f-4a5c-a93a-624bad3811ab None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:16.483388 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d566e-2d9f-4a5c-a93a-624bad3811ab None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:16.483666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d566e-2d9f-4a5c-a93a-624bad3811ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:16.511352 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-dd6d566e-2d9f-4a5c-a93a-624bad3811ab None None] MFA Rules not processed for user `fbf4b9cde8424ade84292ba2df1ec185`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:16.512581 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-dd6d566e-2d9f-4a5c-a93a-624bad3811ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:16.579011 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1307/2619] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:01:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:16.583428 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b74b1-3277-493a-be82-acdf10ee6055 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:16.648470 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b74b1-3277-493a-be82-acdf10ee6055 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:16.653126 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad6d36-8abf-415d-9504-f39052957ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:16.654259 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad6d36-8abf-415d-9504-f39052957ba3 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:16.654546 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad6d36-8abf-415d-9504-f39052957ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:16.654817 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad6d36-8abf-415d-9504-f39052957ba3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:16.655485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad6d36-8abf-415d-9504-f39052957ba3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:16.657369 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad6d36-8abf-415d-9504-f39052957ba3 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:16.677754 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:16.693824 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1313/2620] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 13:01:16 2022] POST /identity/v3/projects => generated 363 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:01:16.694957 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d566e-2d9f-4a5c-a93a-624bad3811ab None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:16.707485 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d566e-2d9f-4a5c-a93a-624bad3811ab None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:16.776508 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe215a-0499-4ffd-a30f-24625d603b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:16.777208 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe215a-0499-4ffd-a30f-24625d603b29 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:16.777584 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe215a-0499-4ffd-a30f-24625d603b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:16.777926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe215a-0499-4ffd-a30f-24625d603b29 admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:16.778649 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe215a-0499-4ffd-a30f-24625d603b29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:16.781892 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe215a-0499-4ffd-a30f-24625d603b29 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:16.813931 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1308/2621] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 13:01:16 2022] POST /identity/v3/users => generated 288 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:01:16.814073 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad6d36-8abf-415d-9504-f39052957ba3 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:16.824478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad6d36-8abf-415d-9504-f39052957ba3 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:16.829432 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb662bd-5bec-4a6d-94af-4783c20fbf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:16.830093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb662bd-5bec-4a6d-94af-4783c20fbf1e admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:16.830376 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb662bd-5bec-4a6d-94af-4783c20fbf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:16.830716 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb662bd-5bec-4a6d-94af-4783c20fbf1e admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:16.831422 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb662bd-5bec-4a6d-94af-4783c20fbf1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:16.833001 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb662bd-5bec-4a6d-94af-4783c20fbf1e admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:16.846271 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1314/2622] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:01:16.850800 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe215a-0499-4ffd-a30f-24625d603b29 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:16.863694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe215a-0499-4ffd-a30f-24625d603b29 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:16.871670 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6465f0-d275-46f2-b103-3faf640fe1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:16.872347 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6465f0-d275-46f2-b103-3faf640fe1c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:16.872760 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6465f0-d275-46f2-b103-3faf640fe1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:16.873078 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6465f0-d275-46f2-b103-3faf640fe1c2 admin admin] PATH_INFO: `/v3/projects/9c7afcf63b784fbfa9b30ef5a55de3f0/users/2459cf1d33ce47b2be65722071644f8f/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:16.897300 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6465f0-d275-46f2-b103-3faf640fe1c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c7afcf63b784fbfa9b30ef5a55de3f0, user_id=2459cf1d33ce47b2be65722071644f8f, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:16.900079 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6465f0-d275-46f2-b103-3faf640fe1c2 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:16.917098 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1309/2623] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:01:16 2022] PUT /identity/v3/projects/9c7afcf63b784fbfa9b30ef5a55de3f0/users/2459cf1d33ce47b2be65722071644f8f/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:16.922071 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb662bd-5bec-4a6d-94af-4783c20fbf1e admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:16.932215 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb662bd-5bec-4a6d-94af-4783c20fbf1e admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:16.997142 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9093600-d788-4e80-9deb-e49f9cee79bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:16.998383 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9093600-d788-4e80-9deb-e49f9cee79bd admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:16.998710 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9093600-d788-4e80-9deb-e49f9cee79bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:16.999085 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9093600-d788-4e80-9deb-e49f9cee79bd admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:16.999838 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9093600-d788-4e80-9deb-e49f9cee79bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:17.001488 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9093600-d788-4e80-9deb-e49f9cee79bd admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:17.015786 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1315/2624] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:01:17.017110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6465f0-d275-46f2-b103-3faf640fe1c2 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:17.027752 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6465f0-d275-46f2-b103-3faf640fe1c2 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:17.032692 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d68cdd-1e4f-47b0-b2e7-02a288cfba51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:17.033355 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d68cdd-1e4f-47b0-b2e7-02a288cfba51 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:17.033694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d68cdd-1e4f-47b0-b2e7-02a288cfba51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:17.033997 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d68cdd-1e4f-47b0-b2e7-02a288cfba51 admin admin] PATH_INFO: `/v3/projects/9c7afcf63b784fbfa9b30ef5a55de3f0/users/2459cf1d33ce47b2be65722071644f8f/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:17.035923 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d68cdd-1e4f-47b0-b2e7-02a288cfba51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c7afcf63b784fbfa9b30ef5a55de3f0, user_id=2459cf1d33ce47b2be65722071644f8f, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:17.038690 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d68cdd-1e4f-47b0-b2e7-02a288cfba51 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:17.051799 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1310/2625] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:01:17 2022] PUT /identity/v3/projects/9c7afcf63b784fbfa9b30ef5a55de3f0/users/2459cf1d33ce47b2be65722071644f8f/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:17.064448 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913cf06-ddf8-4d7c-9ed1-0c7ec675e1a4 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:17.064856 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913cf06-ddf8-4d7c-9ed1-0c7ec675e1a4 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:17.065221 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913cf06-ddf8-4d7c-9ed1-0c7ec675e1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:17.094130 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-5913cf06-ddf8-4d7c-9ed1-0c7ec675e1a4 None None] MFA Rules not processed for user `2459cf1d33ce47b2be65722071644f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:17.095206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-5913cf06-ddf8-4d7c-9ed1-0c7ec675e1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:17.173709 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1316/2626] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:01:17 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:17.183019 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d68cdd-1e4f-47b0-b2e7-02a288cfba51 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:17.184909 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-79d68cdd-1e4f-47b0-b2e7-02a288cfba51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:17.195871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:17.247145 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d68cdd-1e4f-47b0-b2e7-02a288cfba51 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:17.251642 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8661f6-b67e-415d-a8b6-6328d79af22c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:17.252466 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8661f6-b67e-415d-a8b6-6328d79af22c service cinder] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:17.252578 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8661f6-b67e-415d-a8b6-6328d79af22c service cinder] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:17.252803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8661f6-b67e-415d-a8b6-6328d79af22c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:17.263260 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8661f6-b67e-415d-a8b6-6328d79af22c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:17.264709 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8661f6-b67e-415d-a8b6-6328d79af22c service cinder] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:17.275520 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1311/2627] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:01:17.352076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913cf06-ddf8-4d7c-9ed1-0c7ec675e1a4 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:17.362677 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913cf06-ddf8-4d7c-9ed1-0c7ec675e1a4 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:17.366297 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a90b3-8ed8-464e-b4af-496ceebc8ade service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:17.366906 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a90b3-8ed8-464e-b4af-496ceebc8ade service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:17.367187 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a90b3-8ed8-464e-b4af-496ceebc8ade service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:17.367466 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a90b3-8ed8-464e-b4af-496ceebc8ade service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:17.428410 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a90b3-8ed8-464e-b4af-496ceebc8ade service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:17.429902 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a90b3-8ed8-464e-b4af-496ceebc8ade service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:17.439336 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1317/2628] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:01:18.047382 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8661f6-b67e-415d-a8b6-6328d79af22c service cinder] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:18.048817 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-4b8661f6-b67e-415d-a8b6-6328d79af22c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:18.107746 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8661f6-b67e-415d-a8b6-6328d79af22c service cinder] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:18.111286 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d99795-13f4-482b-ad6f-d115b02010b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:18.111900 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d99795-13f4-482b-ad6f-d115b02010b1 service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:18.112182 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d99795-13f4-482b-ad6f-d115b02010b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:18.112456 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d99795-13f4-482b-ad6f-d115b02010b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:18.114255 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-62d99795-13f4-482b-ad6f-d115b02010b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:18.181738 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d99795-13f4-482b-ad6f-d115b02010b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:18.183181 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d99795-13f4-482b-ad6f-d115b02010b1 service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:18.193559 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1312/2629] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:01:20.251620 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a90b3-8ed8-464e-b4af-496ceebc8ade service cinder] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:20.278859 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a90b3-8ed8-464e-b4af-496ceebc8ade service cinder] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:20.284568 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be41c7-004a-4e71-9298-065f1ca25a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:20.285412 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be41c7-004a-4e71-9298-065f1ca25a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:20.285782 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be41c7-004a-4e71-9298-065f1ca25a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:20.286337 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be41c7-004a-4e71-9298-065f1ca25a8b admin admin] PATH_INFO: `/v3/users/fbf4b9cde8424ade84292ba2df1ec185` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:20.287257 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be41c7-004a-4e71-9298-065f1ca25a8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbf4b9cde8424ade84292ba2df1ec185)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:20.289257 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be41c7-004a-4e71-9298-065f1ca25a8b admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:20.291029 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:20.355756 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-44be41c7-004a-4e71-9298-065f1ca25a8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbf4b9cde8424ade84292ba2df1ec185'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:20.356716 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-44be41c7-004a-4e71-9298-065f1ca25a8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbf4b9cde8424ade84292ba2df1ec185'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:20.357608 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-44be41c7-004a-4e71-9298-065f1ca25a8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbf4b9cde8424ade84292ba2df1ec185'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:20.372423 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-44be41c7-004a-4e71-9298-065f1ca25a8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbf4b9cde8424ade84292ba2df1ec185'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:20.380466 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-44be41c7-004a-4e71-9298-065f1ca25a8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbf4b9cde8424ade84292ba2df1ec185'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:20.394824 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1318/2630] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:01:20 2022] DELETE /identity/v3/users/fbf4b9cde8424ade84292ba2df1ec185 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:20.399356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a1dd3-a550-4d82-bba4-7ccc5c8d1da3 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:20.399882 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a1dd3-a550-4d82-bba4-7ccc5c8d1da3 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:20.400257 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a1dd3-a550-4d82-bba4-7ccc5c8d1da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:20.420673 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-290a1dd3-a550-4d82-bba4-7ccc5c8d1da3 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:20.422314 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-290a1dd3-a550-4d82-bba4-7ccc5c8d1da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:20.478776 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:20.487533 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1313/2631] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:01:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:01:20.499881 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be41c7-004a-4e71-9298-065f1ca25a8b admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:20.501726 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-44be41c7-004a-4e71-9298-065f1ca25a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:20.564761 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be41c7-004a-4e71-9298-065f1ca25a8b admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:20.570599 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ee122-30bb-4138-a728-605fb92e5dd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:20.571261 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ee122-30bb-4138-a728-605fb92e5dd9 service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:20.571968 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ee122-30bb-4138-a728-605fb92e5dd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:20.571968 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ee122-30bb-4138-a728-605fb92e5dd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:20.583396 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ee122-30bb-4138-a728-605fb92e5dd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:20.584837 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ee122-30bb-4138-a728-605fb92e5dd9 service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:20.599338 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1319/2632] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:01:21.104417 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a1dd3-a550-4d82-bba4-7ccc5c8d1da3 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:21.106271 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-290a1dd3-a550-4d82-bba4-7ccc5c8d1da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:21.120698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a1dd3-a550-4d82-bba4-7ccc5c8d1da3 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:21.125954 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a160c15-e1e0-4337-b2c3-2bc98c9d63e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:21.126698 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a160c15-e1e0-4337-b2c3-2bc98c9d63e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:21.127090 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a160c15-e1e0-4337-b2c3-2bc98c9d63e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:21.127431 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a160c15-e1e0-4337-b2c3-2bc98c9d63e1 admin admin] PATH_INFO: `/v3/projects/664cebf000b84ccf86497b86f72940c9` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:21.130447 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a160c15-e1e0-4337-b2c3-2bc98c9d63e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=664cebf000b84ccf86497b86f72940c9)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:21.136436 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a160c15-e1e0-4337-b2c3-2bc98c9d63e1 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:21.203787 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-1a160c15-e1e0-4337-b2c3-2bc98c9d63e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '664cebf000b84ccf86497b86f72940c9', 'request_id': 'req-1a160c15-e1e0-4337-b2c3-2bc98c9d63e1'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:21.211497 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-1a160c15-e1e0-4337-b2c3-2bc98c9d63e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '664cebf000b84ccf86497b86f72940c9', 'request_id': 'req-1a160c15-e1e0-4337-b2c3-2bc98c9d63e1'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:21.229033 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-1a160c15-e1e0-4337-b2c3-2bc98c9d63e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '664cebf000b84ccf86497b86f72940c9', 'request_id': 'req-1a160c15-e1e0-4337-b2c3-2bc98c9d63e1'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:21.247478 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-1a160c15-e1e0-4337-b2c3-2bc98c9d63e1 admin admin] The token cache is being invalidate because project 664cebf000b84ccf86497b86f72940c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:01:21.247887 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-1a160c15-e1e0-4337-b2c3-2bc98c9d63e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:21.248614 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-1a160c15-e1e0-4337-b2c3-2bc98c9d63e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:21.252961 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1314/2633] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:01:21 2022] DELETE /identity/v3/projects/664cebf000b84ccf86497b86f72940c9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:01:21.257100 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ee122-30bb-4138-a728-605fb92e5dd9 service neutron] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:21.267878 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ee122-30bb-4138-a728-605fb92e5dd9 service neutron] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:21.339677 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a160c15-e1e0-4337-b2c3-2bc98c9d63e1 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:21.341145 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-1a160c15-e1e0-4337-b2c3-2bc98c9d63e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:21.360835 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc12cc-b8e5-476c-b45a-526013ac5352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:21.363859 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc12cc-b8e5-476c-b45a-526013ac5352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:21.364147 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc12cc-b8e5-476c-b45a-526013ac5352 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:21.364425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc12cc-b8e5-476c-b45a-526013ac5352 admin admin] PATH_INFO: `/v3/users/2459cf1d33ce47b2be65722071644f8f` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:21.366170 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc12cc-b8e5-476c-b45a-526013ac5352 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2459cf1d33ce47b2be65722071644f8f)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:21.368339 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc12cc-b8e5-476c-b45a-526013ac5352 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:21.401351 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:21.441861 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-9ffc12cc-b8e5-476c-b45a-526013ac5352 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2459cf1d33ce47b2be65722071644f8f'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:21.442959 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-9ffc12cc-b8e5-476c-b45a-526013ac5352 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2459cf1d33ce47b2be65722071644f8f'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:21.443776 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-9ffc12cc-b8e5-476c-b45a-526013ac5352 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2459cf1d33ce47b2be65722071644f8f'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:21.448377 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a160c15-e1e0-4337-b2c3-2bc98c9d63e1 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:21.453719 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ed40b-75ba-4c2e-87ea-a32756f59458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:21.454396 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ed40b-75ba-4c2e-87ea-a32756f59458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:21.454681 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ed40b-75ba-4c2e-87ea-a32756f59458 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:21.454959 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ed40b-75ba-4c2e-87ea-a32756f59458 admin admin] PATH_INFO: `/v3/users/764b978c482946a688c9a3a903b1d3d1` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:21.456144 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ed40b-75ba-4c2e-87ea-a32756f59458 admin admin] RBAC: Authorizing `identity:delete_user(user_id=764b978c482946a688c9a3a903b1d3d1)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:21.457773 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-9ffc12cc-b8e5-476c-b45a-526013ac5352 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2459cf1d33ce47b2be65722071644f8f'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:21.458099 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ed40b-75ba-4c2e-87ea-a32756f59458 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:21.465944 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-9ffc12cc-b8e5-476c-b45a-526013ac5352 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2459cf1d33ce47b2be65722071644f8f'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:21.485488 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1320/2634] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:01:21 2022] DELETE /identity/v3/users/2459cf1d33ce47b2be65722071644f8f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:01:21.485488 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc12cc-b8e5-476c-b45a-526013ac5352 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:21.485488 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-9ffc12cc-b8e5-476c-b45a-526013ac5352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:21.521772 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-4e2ed40b-75ba-4c2e-87ea-a32756f59458 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '764b978c482946a688c9a3a903b1d3d1'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:21.532136 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-4e2ed40b-75ba-4c2e-87ea-a32756f59458 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '764b978c482946a688c9a3a903b1d3d1'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:21.533007 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-4e2ed40b-75ba-4c2e-87ea-a32756f59458 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '764b978c482946a688c9a3a903b1d3d1'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:21.533689 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-4e2ed40b-75ba-4c2e-87ea-a32756f59458 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '764b978c482946a688c9a3a903b1d3d1'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:21.552047 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-4e2ed40b-75ba-4c2e-87ea-a32756f59458 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '764b978c482946a688c9a3a903b1d3d1'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:21.569668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1315/2635] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:01:21 2022] DELETE /identity/v3/users/764b978c482946a688c9a3a903b1d3d1 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:01:21.570420 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc12cc-b8e5-476c-b45a-526013ac5352 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:21.574063 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2230f11-cbce-48bd-85a5-ab6af2b9ebd6 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:21.574565 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2230f11-cbce-48bd-85a5-ab6af2b9ebd6 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:21.574839 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2230f11-cbce-48bd-85a5-ab6af2b9ebd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:21.585574 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:21.600364 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-c2230f11-cbce-48bd-85a5-ab6af2b9ebd6 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:21.601965 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-c2230f11-cbce-48bd-85a5-ab6af2b9ebd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:21.649964 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae866ab8-6ad9-4590-86fe-0be804464512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:21.650768 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae866ab8-6ad9-4590-86fe-0be804464512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:21.651116 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae866ab8-6ad9-4590-86fe-0be804464512 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:21.651393 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae866ab8-6ad9-4590-86fe-0be804464512 admin admin] PATH_INFO: `/v3/users/7a109db9f7754b5a8f5b53fa7030691c` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:21.652596 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae866ab8-6ad9-4590-86fe-0be804464512 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a109db9f7754b5a8f5b53fa7030691c)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:21.655131 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae866ab8-6ad9-4590-86fe-0be804464512 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:21.678089 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1316/2636] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:21.687925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2230f11-cbce-48bd-85a5-ab6af2b9ebd6 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:21.689384 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-c2230f11-cbce-48bd-85a5-ab6af2b9ebd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:21.719319 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-ae866ab8-6ad9-4590-86fe-0be804464512 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a109db9f7754b5a8f5b53fa7030691c'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:21.720276 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-ae866ab8-6ad9-4590-86fe-0be804464512 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a109db9f7754b5a8f5b53fa7030691c'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:21.721160 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-ae866ab8-6ad9-4590-86fe-0be804464512 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a109db9f7754b5a8f5b53fa7030691c'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:21.739295 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:21.749974 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-ae866ab8-6ad9-4590-86fe-0be804464512 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a109db9f7754b5a8f5b53fa7030691c'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:21.765143 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-ae866ab8-6ad9-4590-86fe-0be804464512 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a109db9f7754b5a8f5b53fa7030691c'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:21.769148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2230f11-cbce-48bd-85a5-ab6af2b9ebd6 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:21.774133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770586d9-41ea-46d6-a804-bce1d1ea7a4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:21.775021 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770586d9-41ea-46d6-a804-bce1d1ea7a4a service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:21.775146 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770586d9-41ea-46d6-a804-bce1d1ea7a4a service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:21.775571 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770586d9-41ea-46d6-a804-bce1d1ea7a4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:21.777576 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-770586d9-41ea-46d6-a804-bce1d1ea7a4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:21.793520 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770586d9-41ea-46d6-a804-bce1d1ea7a4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:21.794409 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1321/2637] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:01:21 2022] DELETE /identity/v3/users/7a109db9f7754b5a8f5b53fa7030691c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:21.795057 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770586d9-41ea-46d6-a804-bce1d1ea7a4a service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:21.811157 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1317/2638] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:01:21.846193 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae866ab8-6ad9-4590-86fe-0be804464512 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:21.847848 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-ae866ab8-6ad9-4590-86fe-0be804464512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:21.953102 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae866ab8-6ad9-4590-86fe-0be804464512 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:21.957993 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ebc99-73e9-4533-8717-dbbc258a9cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:21.958796 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ebc99-73e9-4533-8717-dbbc258a9cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:21.958934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ebc99-73e9-4533-8717-dbbc258a9cde admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:21.959216 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ebc99-73e9-4533-8717-dbbc258a9cde admin admin] PATH_INFO: `/v3/projects/9c7afcf63b784fbfa9b30ef5a55de3f0` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:21.960544 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ebc99-73e9-4533-8717-dbbc258a9cde admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c7afcf63b784fbfa9b30ef5a55de3f0)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:21.962556 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ebc99-73e9-4533-8717-dbbc258a9cde admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:22.025733 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-4f6ebc99-73e9-4533-8717-dbbc258a9cde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c7afcf63b784fbfa9b30ef5a55de3f0', 'request_id': 'req-4f6ebc99-73e9-4533-8717-dbbc258a9cde'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:22.034128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-4f6ebc99-73e9-4533-8717-dbbc258a9cde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c7afcf63b784fbfa9b30ef5a55de3f0', 'request_id': 'req-4f6ebc99-73e9-4533-8717-dbbc258a9cde'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:22.047078 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-4f6ebc99-73e9-4533-8717-dbbc258a9cde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c7afcf63b784fbfa9b30ef5a55de3f0', 'request_id': 'req-4f6ebc99-73e9-4533-8717-dbbc258a9cde'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:22.064866 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-4f6ebc99-73e9-4533-8717-dbbc258a9cde admin admin] The token cache is being invalidate because project 9c7afcf63b784fbfa9b30ef5a55de3f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:01:22.065475 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-4f6ebc99-73e9-4533-8717-dbbc258a9cde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:22.066820 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-4f6ebc99-73e9-4533-8717-dbbc258a9cde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:22.068754 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1322/2639] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:01:21 2022] DELETE /identity/v3/projects/9c7afcf63b784fbfa9b30ef5a55de3f0 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:22.077404 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bea57-9380-4a59-a3e7-c9333fd5261a None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:22.078145 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bea57-9380-4a59-a3e7-c9333fd5261a None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:22.079074 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bea57-9380-4a59-a3e7-c9333fd5261a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:22.101855 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-216bea57-9380-4a59-a3e7-c9333fd5261a None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:22.103108 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-216bea57-9380-4a59-a3e7-c9333fd5261a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:22.166983 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ebc99-73e9-4533-8717-dbbc258a9cde admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:22.168584 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-4f6ebc99-73e9-4533-8717-dbbc258a9cde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:22.199096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1318/2640] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:22.207406 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba1806-e577-4504-96da-ea2a7f9b401a None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:22.207907 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba1806-e577-4504-96da-ea2a7f9b401a None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:22.208454 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba1806-e577-4504-96da-ea2a7f9b401a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:22.231314 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-0aba1806-e577-4504-96da-ea2a7f9b401a None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:22.233055 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-0aba1806-e577-4504-96da-ea2a7f9b401a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:22.240859 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:22.241844 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1319/2641] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:22.245061 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ebc99-73e9-4533-8717-dbbc258a9cde admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:22.245879 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba1806-e577-4504-96da-ea2a7f9b401a None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:22.253768 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b085da-0cf4-47e5-8a45-e17d7fcc5bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:22.254435 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b085da-0cf4-47e5-8a45-e17d7fcc5bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:22.254877 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b085da-0cf4-47e5-8a45-e17d7fcc5bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:22.255168 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b085da-0cf4-47e5-8a45-e17d7fcc5bd9 admin admin] PATH_INFO: `/v3/projects/34b4544652b9419682c7de707d1d945f` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:22.257140 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b085da-0cf4-47e5-8a45-e17d7fcc5bd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34b4544652b9419682c7de707d1d945f)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:22.259417 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba1806-e577-4504-96da-ea2a7f9b401a None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:22.260046 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b085da-0cf4-47e5-8a45-e17d7fcc5bd9 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:22.268671 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc31200-8769-41ef-a1de-433b3a95fccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:22.269439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc31200-8769-41ef-a1de-433b3a95fccc admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:22.270027 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc31200-8769-41ef-a1de-433b3a95fccc admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:22.270371 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc31200-8769-41ef-a1de-433b3a95fccc admin admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:22.271472 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc31200-8769-41ef-a1de-433b3a95fccc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:01:22.271946 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc31200-8769-41ef-a1de-433b3a95fccc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:22.274449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc31200-8769-41ef-a1de-433b3a95fccc admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:22.295891 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1320/2642] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 13:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:01:22.297222 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc31200-8769-41ef-a1de-433b3a95fccc admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:22.309475 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc31200-8769-41ef-a1de-433b3a95fccc admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:22.316090 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-28b085da-0cf4-47e5-8a45-e17d7fcc5bd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34b4544652b9419682c7de707d1d945f', 'request_id': 'req-28b085da-0cf4-47e5-8a45-e17d7fcc5bd9'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:22.329854 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-28b085da-0cf4-47e5-8a45-e17d7fcc5bd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34b4544652b9419682c7de707d1d945f', 'request_id': 'req-28b085da-0cf4-47e5-8a45-e17d7fcc5bd9'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:22.338205 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-28b085da-0cf4-47e5-8a45-e17d7fcc5bd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34b4544652b9419682c7de707d1d945f', 'request_id': 'req-28b085da-0cf4-47e5-8a45-e17d7fcc5bd9'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:22.339962 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:22.352548 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-28b085da-0cf4-47e5-8a45-e17d7fcc5bd9 admin admin] The token cache is being invalidate because project 34b4544652b9419682c7de707d1d945f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:01:22.352852 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-28b085da-0cf4-47e5-8a45-e17d7fcc5bd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:22.353593 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-28b085da-0cf4-47e5-8a45-e17d7fcc5bd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:22.369775 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1323/2643] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:01:22 2022] DELETE /identity/v3/projects/34b4544652b9419682c7de707d1d945f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:01:22.369775 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b085da-0cf4-47e5-8a45-e17d7fcc5bd9 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:22.369775 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-28b085da-0cf4-47e5-8a45-e17d7fcc5bd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:22.381465 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17e0c8-5f1f-46c3-bb89-8fb9ff02bd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:22.382405 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17e0c8-5f1f-46c3-bb89-8fb9ff02bd4d admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:22.382842 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17e0c8-5f1f-46c3-bb89-8fb9ff02bd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:22.383201 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17e0c8-5f1f-46c3-bb89-8fb9ff02bd4d admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:22.384247 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f17e0c8-5f1f-46c3-bb89-8fb9ff02bd4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:22.386371 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f17e0c8-5f1f-46c3-bb89-8fb9ff02bd4d admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:22.422256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1321/2644] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 13:01:22 2022] POST /identity/v3/projects => generated 367 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:01:22.423764 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17e0c8-5f1f-46c3-bb89-8fb9ff02bd4d admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:22.427376 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-7f17e0c8-5f1f-46c3-bb89-8fb9ff02bd4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:22.447737 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b085da-0cf4-47e5-8a45-e17d7fcc5bd9 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:22.505726 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17e0c8-5f1f-46c3-bb89-8fb9ff02bd4d admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:22.511121 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed175e7-bc2d-45a4-8751-bddde2e66a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:22.512491 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed175e7-bc2d-45a4-8751-bddde2e66a22 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:22.512778 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed175e7-bc2d-45a4-8751-bddde2e66a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:22.513790 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed175e7-bc2d-45a4-8751-bddde2e66a22 admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:22.515112 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed175e7-bc2d-45a4-8751-bddde2e66a22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:22.517131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed175e7-bc2d-45a4-8751-bddde2e66a22 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:22.525650 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ef236-4b4c-4a4d-bd19-edf67aabc75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:22.526427 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ef236-4b4c-4a4d-bd19-edf67aabc75b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:22.527223 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ef236-4b4c-4a4d-bd19-edf67aabc75b admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:22.527504 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ef236-4b4c-4a4d-bd19-edf67aabc75b admin admin] PATH_INFO: `/v3/projects/21a63ad619b644089c218675b219b734` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:22.530799 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ef236-4b4c-4a4d-bd19-edf67aabc75b admin admin] RBAC: Authorizing `identity:delete_project(project_id=21a63ad619b644089c218675b219b734)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:22.533098 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ef236-4b4c-4a4d-bd19-edf67aabc75b admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:22.541253 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1322/2645] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 13:01:22 2022] POST /identity/v3/users => generated 284 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:01:22.546119 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed175e7-bc2d-45a4-8751-bddde2e66a22 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:22.556666 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed175e7-bc2d-45a4-8751-bddde2e66a22 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:22.562914 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2221431-0c9e-4453-a66f-b734cf63e3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:22.563566 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2221431-0c9e-4453-a66f-b734cf63e3b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:22.563848 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2221431-0c9e-4453-a66f-b734cf63e3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:22.564125 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2221431-0c9e-4453-a66f-b734cf63e3b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:22.564842 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2221431-0c9e-4453-a66f-b734cf63e3b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:22.566527 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2221431-0c9e-4453-a66f-b734cf63e3b4 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:22.581756 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1323/2646] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:01:22.582906 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2221431-0c9e-4453-a66f-b734cf63e3b4 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:22.590478 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:22.594876 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2221431-0c9e-4453-a66f-b734cf63e3b4 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:22.604911 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-001ef236-4b4c-4a4d-bd19-edf67aabc75b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21a63ad619b644089c218675b219b734', 'request_id': 'req-001ef236-4b4c-4a4d-bd19-edf67aabc75b'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:22.614901 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-001ef236-4b4c-4a4d-bd19-edf67aabc75b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21a63ad619b644089c218675b219b734', 'request_id': 'req-001ef236-4b4c-4a4d-bd19-edf67aabc75b'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:22.625257 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-001ef236-4b4c-4a4d-bd19-edf67aabc75b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21a63ad619b644089c218675b219b734', 'request_id': 'req-001ef236-4b4c-4a4d-bd19-edf67aabc75b'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:22.636766 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-001ef236-4b4c-4a4d-bd19-edf67aabc75b admin admin] The token cache is being invalidate because project 21a63ad619b644089c218675b219b734 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:01:22.637052 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-001ef236-4b4c-4a4d-bd19-edf67aabc75b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:22.637738 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-001ef236-4b4c-4a4d-bd19-edf67aabc75b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:22.639340 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1324/2647] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:01:22 2022] DELETE /identity/v3/projects/21a63ad619b644089c218675b219b734 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:22.644073 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb00a2-d732-483a-9eef-7139a4d9f235 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:22.644356 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb00a2-d732-483a-9eef-7139a4d9f235 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:22.644635 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb00a2-d732-483a-9eef-7139a4d9f235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:22.661571 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f70e4f-0a09-4e34-93b5-8cc84c787616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:22.662185 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f70e4f-0a09-4e34-93b5-8cc84c787616 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:22.662468 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f70e4f-0a09-4e34-93b5-8cc84c787616 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:22.662740 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f70e4f-0a09-4e34-93b5-8cc84c787616 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:22.663434 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f70e4f-0a09-4e34-93b5-8cc84c787616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:22.664217 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-39cb00a2-d732-483a-9eef-7139a4d9f235 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:22.665011 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f70e4f-0a09-4e34-93b5-8cc84c787616 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:22.665447 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-39cb00a2-d732-483a-9eef-7139a4d9f235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:22.674208 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1325/2648] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:22.675681 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1324/2649] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:01:22.681810 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb00a2-d732-483a-9eef-7139a4d9f235 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:22.682288 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d289ba-c39f-410a-9dfc-026b83bfe458 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:22.682574 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d289ba-c39f-410a-9dfc-026b83bfe458 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:22.682849 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d289ba-c39f-410a-9dfc-026b83bfe458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:22.683147 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-39cb00a2-d732-483a-9eef-7139a4d9f235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:22.695627 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb00a2-d732-483a-9eef-7139a4d9f235 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:22.700345 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e631e-5aee-4b15-9727-8a4e6bd7b380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:22.701799 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e631e-5aee-4b15-9727-8a4e6bd7b380 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:22.702049 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e631e-5aee-4b15-9727-8a4e6bd7b380 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:22.702326 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e631e-5aee-4b15-9727-8a4e6bd7b380 admin admin] PATH_INFO: `/v3/projects/d97f4d598a944e18a53c5cb2a210bd88/users/5755645fcb7b429d9ffe0de3c5486a16/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:22.704050 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-91d289ba-c39f-410a-9dfc-026b83bfe458 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:22.705273 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-91d289ba-c39f-410a-9dfc-026b83bfe458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:22.713274 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1325/2650] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:22.717626 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d289ba-c39f-410a-9dfc-026b83bfe458 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:22.717875 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e631e-5aee-4b15-9727-8a4e6bd7b380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d97f4d598a944e18a53c5cb2a210bd88, user_id=5755645fcb7b429d9ffe0de3c5486a16, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:22.720560 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e631e-5aee-4b15-9727-8a4e6bd7b380 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:22.726652 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d289ba-c39f-410a-9dfc-026b83bfe458 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:22.732295 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2e541-2c28-4ee2-b5b7-87a20fa07874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:22.733045 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2e541-2c28-4ee2-b5b7-87a20fa07874 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:22.733428 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2e541-2c28-4ee2-b5b7-87a20fa07874 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:22.733565 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1326/2651] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:01:22 2022] PUT /identity/v3/projects/d97f4d598a944e18a53c5cb2a210bd88/users/5755645fcb7b429d9ffe0de3c5486a16/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:22.733904 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2e541-2c28-4ee2-b5b7-87a20fa07874 admin admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:22.734681 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2e541-2c28-4ee2-b5b7-87a20fa07874 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:01:22.734994 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2e541-2c28-4ee2-b5b7-87a20fa07874 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:22.736571 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2e541-2c28-4ee2-b5b7-87a20fa07874 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:22.750069 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1326/2652] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 13:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 13:01:22.754401 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e631e-5aee-4b15-9727-8a4e6bd7b380 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:22.804734 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5800bc7-955f-4e7b-a063-45bd8e1c7859 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:22.804949 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5800bc7-955f-4e7b-a063-45bd8e1c7859 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:22.805225 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5800bc7-955f-4e7b-a063-45bd8e1c7859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:22.819454 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:22.823472 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e631e-5aee-4b15-9727-8a4e6bd7b380 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:22.828866 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1533e36-2ae8-413c-b69b-60e33671b38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:22.829588 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1533e36-2ae8-413c-b69b-60e33671b38a admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:22.829940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1533e36-2ae8-413c-b69b-60e33671b38a admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:22.830285 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1533e36-2ae8-413c-b69b-60e33671b38a admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:22.831051 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1533e36-2ae8-413c-b69b-60e33671b38a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:22.833052 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1533e36-2ae8-413c-b69b-60e33671b38a admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:22.835320 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-c5800bc7-955f-4e7b-a063-45bd8e1c7859 None None] MFA Rules not processed for user `5755645fcb7b429d9ffe0de3c5486a16`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:22.836542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-c5800bc7-955f-4e7b-a063-45bd8e1c7859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:22.861564 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1327/2653] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 13:01:22 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:01:22.865882 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1533e36-2ae8-413c-b69b-60e33671b38a admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:22.904324 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1327/2654] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:01:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:01:22.908917 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5800bc7-955f-4e7b-a063-45bd8e1c7859 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:22.920243 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5800bc7-955f-4e7b-a063-45bd8e1c7859 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:22.929868 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1533e36-2ae8-413c-b69b-60e33671b38a admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:22.934581 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2a2e7-c476-44ea-84c2-86ce09fadae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:22.935468 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2a2e7-c476-44ea-84c2-86ce09fadae1 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:22.935753 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2a2e7-c476-44ea-84c2-86ce09fadae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:22.936031 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2a2e7-c476-44ea-84c2-86ce09fadae1 admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:22.936705 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2a2e7-c476-44ea-84c2-86ce09fadae1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:22.938837 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2a2e7-c476-44ea-84c2-86ce09fadae1 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:22.964961 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1328/2655] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 13:01:22 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:01:22.966143 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2a2e7-c476-44ea-84c2-86ce09fadae1 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:22.977071 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2a2e7-c476-44ea-84c2-86ce09fadae1 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:22.980564 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065365a0-c974-4a88-ac85-c67091112adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:22.981185 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065365a0-c974-4a88-ac85-c67091112adc admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:22.981472 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065365a0-c974-4a88-ac85-c67091112adc admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:22.981804 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065365a0-c974-4a88-ac85-c67091112adc admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:22.982308 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a96dd-6aa1-4271-af53-311890ad432a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:22.982470 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065365a0-c974-4a88-ac85-c67091112adc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:22.983211 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a96dd-6aa1-4271-af53-311890ad432a admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:22.983558 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a96dd-6aa1-4271-af53-311890ad432a admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:22.983898 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a96dd-6aa1-4271-af53-311890ad432a admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:22.984366 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065365a0-c974-4a88-ac85-c67091112adc admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:22.984727 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a96dd-6aa1-4271-af53-311890ad432a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:22.986421 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a96dd-6aa1-4271-af53-311890ad432a admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:22.988509 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:22.999348 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1329/2656] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:01:23.003613 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a96dd-6aa1-4271-af53-311890ad432a admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:23.012179 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1328/2657] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 13:01:22 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:01:23.014471 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a96dd-6aa1-4271-af53-311890ad432a admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:23.016492 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065365a0-c974-4a88-ac85-c67091112adc admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:23.073386 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36366069-ab27-4493-b1a4-0ee9377161cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:23.073954 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36366069-ab27-4493-b1a4-0ee9377161cd admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:23.074236 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36366069-ab27-4493-b1a4-0ee9377161cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:23.074516 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36366069-ab27-4493-b1a4-0ee9377161cd admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:23.075224 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36366069-ab27-4493-b1a4-0ee9377161cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:23.077466 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36366069-ab27-4493-b1a4-0ee9377161cd admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:23.079143 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065365a0-c974-4a88-ac85-c67091112adc admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:23.084009 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162a18f-3eb6-4d03-9966-f9621837d44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:23.084706 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162a18f-3eb6-4d03-9966-f9621837d44a admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:23.084987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162a18f-3eb6-4d03-9966-f9621837d44a admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:23.085260 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162a18f-3eb6-4d03-9966-f9621837d44a admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:23.085945 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7162a18f-3eb6-4d03-9966-f9621837d44a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:23.090443 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1330/2658] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:01:23.090613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7162a18f-3eb6-4d03-9966-f9621837d44a admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:23.092154 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36366069-ab27-4493-b1a4-0ee9377161cd admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:23.102300 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36366069-ab27-4493-b1a4-0ee9377161cd admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:23.107271 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6e954-37bc-4f23-9882-c8a575417371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:23.107928 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6e954-37bc-4f23-9882-c8a575417371 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:23.108212 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6e954-37bc-4f23-9882-c8a575417371 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:23.108587 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6e954-37bc-4f23-9882-c8a575417371 admin admin] PATH_INFO: `/v3/projects/b029bcf8f79a493c94a891fec753ea78/users/66986de289b747b582cb48cb22624591/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:23.111226 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1329/2659] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 13:01:23 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:01:23.115056 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162a18f-3eb6-4d03-9966-f9621837d44a admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:23.124927 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162a18f-3eb6-4d03-9966-f9621837d44a admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:23.127120 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6e954-37bc-4f23-9882-c8a575417371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b029bcf8f79a493c94a891fec753ea78, user_id=66986de289b747b582cb48cb22624591, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:23.129784 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af44af-bc8e-4460-81f2-e3256dfda2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:23.129937 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6e954-37bc-4f23-9882-c8a575417371 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:23.130387 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af44af-bc8e-4460-81f2-e3256dfda2bf admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:23.130671 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af44af-bc8e-4460-81f2-e3256dfda2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:23.130950 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af44af-bc8e-4460-81f2-e3256dfda2bf admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:23.131674 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af44af-bc8e-4460-81f2-e3256dfda2bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:23.133246 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af44af-bc8e-4460-81f2-e3256dfda2bf admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:23.141696 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:23.156099 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1331/2660] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:01:23 2022] PUT /identity/v3/projects/b029bcf8f79a493c94a891fec753ea78/users/66986de289b747b582cb48cb22624591/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:01:23.156210 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1330/2661] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:01:23.159813 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af44af-bc8e-4460-81f2-e3256dfda2bf admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:23.160299 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc22d8a-8aaf-4f5f-97ae-7376943e250f None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:23.160593 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc22d8a-8aaf-4f5f-97ae-7376943e250f None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:23.160872 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc22d8a-8aaf-4f5f-97ae-7376943e250f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:23.170098 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af44af-bc8e-4460-81f2-e3256dfda2bf admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:23.189155 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-6bc22d8a-8aaf-4f5f-97ae-7376943e250f None None] MFA Rules not processed for user `66986de289b747b582cb48cb22624591`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:23.190429 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-6bc22d8a-8aaf-4f5f-97ae-7376943e250f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:23.229766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e6d8c-a552-4822-8760-5e5446777409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:23.230435 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e6d8c-a552-4822-8760-5e5446777409 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:23.230711 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e6d8c-a552-4822-8760-5e5446777409 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:23.230981 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e6d8c-a552-4822-8760-5e5446777409 admin admin] PATH_INFO: `/v3/projects/c2e249aaf65e4ab7bbf73e053f6782fd/users/2dd83d9e0464480ab99f3a4c0531caef/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:23.245246 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e6d8c-a552-4822-8760-5e5446777409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2e249aaf65e4ab7bbf73e053f6782fd, user_id=2dd83d9e0464480ab99f3a4c0531caef, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:23.247918 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e6d8c-a552-4822-8760-5e5446777409 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:23.269183 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1332/2662] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:01:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:23.274574 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1331/2663] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:01:23 2022] PUT /identity/v3/projects/c2e249aaf65e4ab7bbf73e053f6782fd/users/2dd83d9e0464480ab99f3a4c0531caef/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:01:23.275367 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e6d8c-a552-4822-8760-5e5446777409 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:23.275746 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc22d8a-8aaf-4f5f-97ae-7376943e250f None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:23.287560 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc22d8a-8aaf-4f5f-97ae-7376943e250f None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:23.339596 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e6d8c-a552-4822-8760-5e5446777409 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:23.344357 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cecefe-d93e-4bf5-b6ae-e257cc3ddc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:23.344968 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cecefe-d93e-4bf5-b6ae-e257cc3ddc18 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:23.345247 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cecefe-d93e-4bf5-b6ae-e257cc3ddc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:23.345553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cecefe-d93e-4bf5-b6ae-e257cc3ddc18 admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:23.346166 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bde1ba-f506-4902-82c8-8dd3e6b89780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:23.346298 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cecefe-d93e-4bf5-b6ae-e257cc3ddc18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:23.346792 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bde1ba-f506-4902-82c8-8dd3e6b89780 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:23.347075 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bde1ba-f506-4902-82c8-8dd3e6b89780 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:23.347350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bde1ba-f506-4902-82c8-8dd3e6b89780 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:23.348057 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bde1ba-f506-4902-82c8-8dd3e6b89780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:23.348184 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cecefe-d93e-4bf5-b6ae-e257cc3ddc18 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:23.349814 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bde1ba-f506-4902-82c8-8dd3e6b89780 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:23.351101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:23.361769 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1333/2664] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:01:23.365854 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bde1ba-f506-4902-82c8-8dd3e6b89780 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:23.378685 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1332/2665] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 13:01:23 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:01:23.378894 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bde1ba-f506-4902-82c8-8dd3e6b89780 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:23.379654 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cecefe-d93e-4bf5-b6ae-e257cc3ddc18 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:23.434476 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0ea29-42cf-4ec4-aee3-31276f596ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:23.435210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0ea29-42cf-4ec4-aee3-31276f596ca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:23.435495 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0ea29-42cf-4ec4-aee3-31276f596ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:23.435772 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0ea29-42cf-4ec4-aee3-31276f596ca2 admin admin] PATH_INFO: `/v3/projects/c2e249aaf65e4ab7bbf73e053f6782fd/users/2dd83d9e0464480ab99f3a4c0531caef/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:23.437824 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b0ea29-42cf-4ec4-aee3-31276f596ca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2e249aaf65e4ab7bbf73e053f6782fd, user_id=2dd83d9e0464480ab99f3a4c0531caef, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:23.440528 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b0ea29-42cf-4ec4-aee3-31276f596ca2 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:23.443484 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cecefe-d93e-4bf5-b6ae-e257cc3ddc18 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:23.448353 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dda1ac-a4e0-49b3-9c95-71625d4ed445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:23.448967 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dda1ac-a4e0-49b3-9c95-71625d4ed445 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:23.449250 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dda1ac-a4e0-49b3-9c95-71625d4ed445 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:23.449548 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dda1ac-a4e0-49b3-9c95-71625d4ed445 admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:23.450214 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dda1ac-a4e0-49b3-9c95-71625d4ed445 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:23.450818 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1334/2666] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:01:23 2022] PUT /identity/v3/projects/c2e249aaf65e4ab7bbf73e053f6782fd/users/2dd83d9e0464480ab99f3a4c0531caef/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:01:23.452285 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dda1ac-a4e0-49b3-9c95-71625d4ed445 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:23.460722 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8d768-255c-4a8b-9414-253af7bb9226 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:23.461007 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8d768-255c-4a8b-9414-253af7bb9226 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:23.461297 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8d768-255c-4a8b-9414-253af7bb9226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:23.469222 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:23.475839 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1333/2667] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 13:01:23 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:01:23.479745 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dda1ac-a4e0-49b3-9c95-71625d4ed445 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:23.491540 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dda1ac-a4e0-49b3-9c95-71625d4ed445 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:23.493776 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-1ed8d768-255c-4a8b-9414-253af7bb9226 None None] MFA Rules not processed for user `2dd83d9e0464480ab99f3a4c0531caef`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:23.495004 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-1ed8d768-255c-4a8b-9414-253af7bb9226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:23.551517 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f67b1f-86bd-498a-905e-26db12618eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:23.552267 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f67b1f-86bd-498a-905e-26db12618eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:23.552550 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f67b1f-86bd-498a-905e-26db12618eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:23.552928 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f67b1f-86bd-498a-905e-26db12618eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:23.553708 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f67b1f-86bd-498a-905e-26db12618eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:23.555294 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f67b1f-86bd-498a-905e-26db12618eb2 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:23.565474 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1334/2668] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:01:23.566067 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1335/2669] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:01:23 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:01:23.572292 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f67b1f-86bd-498a-905e-26db12618eb2 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:23.577528 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8d768-255c-4a8b-9414-253af7bb9226 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:23.579051 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-1ed8d768-255c-4a8b-9414-253af7bb9226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:23.582619 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f67b1f-86bd-498a-905e-26db12618eb2 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:23.587293 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25ced0-6afc-445a-84f5-9da0d7f8dd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:23.587943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25ced0-6afc-445a-84f5-9da0d7f8dd29 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:23.588246 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25ced0-6afc-445a-84f5-9da0d7f8dd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:23.588524 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25ced0-6afc-445a-84f5-9da0d7f8dd29 admin admin] PATH_INFO: `/v3/projects/f6c502ad8d8c4563b9ed6e096e52277e/users/2eff2c0059834f0791d2fa686267aa94/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:23.604425 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25ced0-6afc-445a-84f5-9da0d7f8dd29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6c502ad8d8c4563b9ed6e096e52277e, user_id=2eff2c0059834f0791d2fa686267aa94, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:23.607847 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25ced0-6afc-445a-84f5-9da0d7f8dd29 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:23.621275 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1335/2670] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:01:23 2022] PUT /identity/v3/projects/f6c502ad8d8c4563b9ed6e096e52277e/users/2eff2c0059834f0791d2fa686267aa94/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:23.625172 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25ced0-6afc-445a-84f5-9da0d7f8dd29 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:23.639230 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8d768-255c-4a8b-9414-253af7bb9226 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:23.670335 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:23.690154 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25ced0-6afc-445a-84f5-9da0d7f8dd29 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:23.695001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b45ad-6fbc-41e5-a668-638431e241a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:23.695617 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b45ad-6fbc-41e5-a668-638431e241a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:23.695902 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b45ad-6fbc-41e5-a668-638431e241a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:23.696184 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b45ad-6fbc-41e5-a668-638431e241a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:23.696880 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b45ad-6fbc-41e5-a668-638431e241a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:23.698116 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aaa80c-1d75-4524-ad31-f32462f34d55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:23.698510 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b45ad-6fbc-41e5-a668-638431e241a1 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:23.698741 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aaa80c-1d75-4524-ad31-f32462f34d55 service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:23.699021 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aaa80c-1d75-4524-ad31-f32462f34d55 service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:23.699295 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aaa80c-1d75-4524-ad31-f32462f34d55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:23.711853 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1336/2671] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:01:23.713825 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b45ad-6fbc-41e5-a668-638431e241a1 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:23.723515 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b45ad-6fbc-41e5-a668-638431e241a1 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:23.728261 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5e6c2-7db9-4a5d-a697-e5a04960ec82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:23.728923 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5e6c2-7db9-4a5d-a697-e5a04960ec82 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:23.729208 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5e6c2-7db9-4a5d-a697-e5a04960ec82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:23.729484 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5e6c2-7db9-4a5d-a697-e5a04960ec82 admin admin] PATH_INFO: `/v3/projects/f6c502ad8d8c4563b9ed6e096e52277e/users/2eff2c0059834f0791d2fa686267aa94/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:23.731520 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd5e6c2-7db9-4a5d-a697-e5a04960ec82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6c502ad8d8c4563b9ed6e096e52277e, user_id=2eff2c0059834f0791d2fa686267aa94, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:23.734920 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd5e6c2-7db9-4a5d-a697-e5a04960ec82 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:23.745258 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1337/2672] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:01:23 2022] PUT /identity/v3/projects/f6c502ad8d8c4563b9ed6e096e52277e/users/2eff2c0059834f0791d2fa686267aa94/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:23.758081 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cede49-4089-4296-b159-f76ca69d4d10 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:23.758398 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cede49-4089-4296-b159-f76ca69d4d10 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:23.758676 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cede49-4089-4296-b159-f76ca69d4d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:23.763325 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aaa80c-1d75-4524-ad31-f32462f34d55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:23.764779 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aaa80c-1d75-4524-ad31-f32462f34d55 service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:23.774635 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1336/2673] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:01:23.788511 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-d6cede49-4089-4296-b159-f76ca69d4d10 None None] MFA Rules not processed for user `2eff2c0059834f0791d2fa686267aa94`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:23.789779 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-d6cede49-4089-4296-b159-f76ca69d4d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:23.836184 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:23.860153 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aaa80c-1d75-4524-ad31-f32462f34d55 service cinder] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:23.865430 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1338/2674] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:01:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:23.869572 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aaa80c-1d75-4524-ad31-f32462f34d55 service cinder] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:23.877278 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cede49-4089-4296-b159-f76ca69d4d10 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:23.878876 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-d6cede49-4089-4296-b159-f76ca69d4d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:23.920757 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bda3b-bc40-4a79-b558-390a1d1922da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:23.921608 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bda3b-bc40-4a79-b558-390a1d1922da service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:23.921899 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bda3b-bc40-4a79-b558-390a1d1922da service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:23.922180 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bda3b-bc40-4a79-b558-390a1d1922da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:23.938696 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cede49-4089-4296-b159-f76ca69d4d10 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:23.943669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b4f88-eba1-466f-bf4d-f7d402046770 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:23.944287 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b4f88-eba1-466f-bf4d-f7d402046770 service cinder] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:23.944569 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b4f88-eba1-466f-bf4d-f7d402046770 service cinder] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:23.944862 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b4f88-eba1-466f-bf4d-f7d402046770 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:23.954092 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b4f88-eba1-466f-bf4d-f7d402046770 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:23.955615 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b4f88-eba1-466f-bf4d-f7d402046770 service cinder] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:23.965343 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1339/2675] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:01:23.979050 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1bda3b-bc40-4a79-b558-390a1d1922da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:23.980490 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1bda3b-bc40-4a79-b558-390a1d1922da service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:23.993222 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1337/2676] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:01:24.041352 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b4f88-eba1-466f-bf4d-f7d402046770 service cinder] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:24.051692 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b4f88-eba1-466f-bf4d-f7d402046770 service cinder] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:24.055416 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b3342-57c4-4251-b15d-cafb975eceaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:24.056025 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b3342-57c4-4251-b15d-cafb975eceaf service cinder] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:24.056304 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b3342-57c4-4251-b15d-cafb975eceaf service cinder] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:24.056582 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b3342-57c4-4251-b15d-cafb975eceaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:24.119531 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b3342-57c4-4251-b15d-cafb975eceaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:24.120906 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b3342-57c4-4251-b15d-cafb975eceaf service cinder] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:24.130173 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1340/2677] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:01:28.719895 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bda3b-bc40-4a79-b558-390a1d1922da service cinder] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:28.758345 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:28.783351 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bda3b-bc40-4a79-b558-390a1d1922da service cinder] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:28.787847 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8356551-fe05-4fdc-b14c-fe72c8e254d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:28.788485 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8356551-fe05-4fdc-b14c-fe72c8e254d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:28.788765 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8356551-fe05-4fdc-b14c-fe72c8e254d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:28.789066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8356551-fe05-4fdc-b14c-fe72c8e254d6 admin admin] PATH_INFO: `/v3/users/5755645fcb7b429d9ffe0de3c5486a16` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:28.790351 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8356551-fe05-4fdc-b14c-fe72c8e254d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5755645fcb7b429d9ffe0de3c5486a16)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:28.792277 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8356551-fe05-4fdc-b14c-fe72c8e254d6 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:28.837777 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-c8356551-fe05-4fdc-b14c-fe72c8e254d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5755645fcb7b429d9ffe0de3c5486a16'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:28.838416 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-c8356551-fe05-4fdc-b14c-fe72c8e254d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5755645fcb7b429d9ffe0de3c5486a16'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:28.839101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-c8356551-fe05-4fdc-b14c-fe72c8e254d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5755645fcb7b429d9ffe0de3c5486a16'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:28.851245 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-c8356551-fe05-4fdc-b14c-fe72c8e254d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5755645fcb7b429d9ffe0de3c5486a16'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:28.858181 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-c8356551-fe05-4fdc-b14c-fe72c8e254d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5755645fcb7b429d9ffe0de3c5486a16'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:28.870484 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1338/2678] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:01:28 2022] DELETE /identity/v3/users/5755645fcb7b429d9ffe0de3c5486a16 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:28.875884 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46164a0b-fd1d-4d43-a862-be91e719b0a1 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:28.876369 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46164a0b-fd1d-4d43-a862-be91e719b0a1 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:28.876486 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46164a0b-fd1d-4d43-a862-be91e719b0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:28.896213 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-46164a0b-fd1d-4d43-a862-be91e719b0a1 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:28.897433 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-46164a0b-fd1d-4d43-a862-be91e719b0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:28.958043 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1341/2679] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:01:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:28.968013 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8356551-fe05-4fdc-b14c-fe72c8e254d6 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:28.969455 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-c8356551-fe05-4fdc-b14c-fe72c8e254d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:29.027184 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8356551-fe05-4fdc-b14c-fe72c8e254d6 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:29.030863 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4cb370-6975-46ff-8f8b-fe29105a8334 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:29.031471 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4cb370-6975-46ff-8f8b-fe29105a8334 service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:29.031749 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4cb370-6975-46ff-8f8b-fe29105a8334 service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:29.032019 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4cb370-6975-46ff-8f8b-fe29105a8334 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:29.041395 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4cb370-6975-46ff-8f8b-fe29105a8334 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:29.043492 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4cb370-6975-46ff-8f8b-fe29105a8334 service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:29.054324 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1339/2680] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:01:29.321564 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46164a0b-fd1d-4d43-a862-be91e719b0a1 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:29.323019 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-46164a0b-fd1d-4d43-a862-be91e719b0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:29.343789 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46164a0b-fd1d-4d43-a862-be91e719b0a1 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:29.348531 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48addbe2-ee50-4ab2-961b-9698fe8178e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:29.349199 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48addbe2-ee50-4ab2-961b-9698fe8178e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:29.349477 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48addbe2-ee50-4ab2-961b-9698fe8178e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:29.349882 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48addbe2-ee50-4ab2-961b-9698fe8178e8 admin admin] PATH_INFO: `/v3/projects/d97f4d598a944e18a53c5cb2a210bd88` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:29.350931 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48addbe2-ee50-4ab2-961b-9698fe8178e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d97f4d598a944e18a53c5cb2a210bd88)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:29.352827 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48addbe2-ee50-4ab2-961b-9698fe8178e8 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:29.370166 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:29.404273 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-48addbe2-ee50-4ab2-961b-9698fe8178e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd97f4d598a944e18a53c5cb2a210bd88', 'request_id': 'req-48addbe2-ee50-4ab2-961b-9698fe8178e8'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:29.410629 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-48addbe2-ee50-4ab2-961b-9698fe8178e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd97f4d598a944e18a53c5cb2a210bd88', 'request_id': 'req-48addbe2-ee50-4ab2-961b-9698fe8178e8'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:29.416448 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-48addbe2-ee50-4ab2-961b-9698fe8178e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd97f4d598a944e18a53c5cb2a210bd88', 'request_id': 'req-48addbe2-ee50-4ab2-961b-9698fe8178e8'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:29.430393 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-48addbe2-ee50-4ab2-961b-9698fe8178e8 admin admin] The token cache is being invalidate because project d97f4d598a944e18a53c5cb2a210bd88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:01:29.430678 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-48addbe2-ee50-4ab2-961b-9698fe8178e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:29.431385 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-48addbe2-ee50-4ab2-961b-9698fe8178e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:29.433017 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1342/2681] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:01:29 2022] DELETE /identity/v3/projects/d97f4d598a944e18a53c5cb2a210bd88 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:29.437037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4cb370-6975-46ff-8f8b-fe29105a8334 service neutron] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:29.449728 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4cb370-6975-46ff-8f8b-fe29105a8334 service neutron] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:29.506882 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:29.514702 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578bf2e-889d-4d6c-b212-fd1815af7b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:29.515442 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578bf2e-889d-4d6c-b212-fd1815af7b26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:29.515959 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578bf2e-889d-4d6c-b212-fd1815af7b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:29.516465 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578bf2e-889d-4d6c-b212-fd1815af7b26 admin admin] PATH_INFO: `/v3/users/2dd83d9e0464480ab99f3a4c0531caef` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:29.518292 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a578bf2e-889d-4d6c-b212-fd1815af7b26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dd83d9e0464480ab99f3a4c0531caef)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:29.520324 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a578bf2e-889d-4d6c-b212-fd1815af7b26 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:29.570394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-a578bf2e-889d-4d6c-b212-fd1815af7b26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dd83d9e0464480ab99f3a4c0531caef'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:29.571001 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-a578bf2e-889d-4d6c-b212-fd1815af7b26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dd83d9e0464480ab99f3a4c0531caef'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:29.571691 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-a578bf2e-889d-4d6c-b212-fd1815af7b26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dd83d9e0464480ab99f3a4c0531caef'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:29.585800 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-a578bf2e-889d-4d6c-b212-fd1815af7b26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dd83d9e0464480ab99f3a4c0531caef'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:29.594014 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-a578bf2e-889d-4d6c-b212-fd1815af7b26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dd83d9e0464480ab99f3a4c0531caef'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:29.607844 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1340/2682] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:01:29 2022] DELETE /identity/v3/users/2dd83d9e0464480ab99f3a4c0531caef => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:30.071910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48addbe2-ee50-4ab2-961b-9698fe8178e8 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:30.074177 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-48addbe2-ee50-4ab2-961b-9698fe8178e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:30.088307 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48addbe2-ee50-4ab2-961b-9698fe8178e8 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:30.162576 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07885555-1682-4f04-adcb-6703d8a5d61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:30.163690 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07885555-1682-4f04-adcb-6703d8a5d61b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:30.164027 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07885555-1682-4f04-adcb-6703d8a5d61b admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:30.164308 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07885555-1682-4f04-adcb-6703d8a5d61b admin admin] PATH_INFO: `/v3/projects/c2e249aaf65e4ab7bbf73e053f6782fd` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:30.165681 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07885555-1682-4f04-adcb-6703d8a5d61b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2e249aaf65e4ab7bbf73e053f6782fd)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:30.167690 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07885555-1682-4f04-adcb-6703d8a5d61b admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:30.220595 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-07885555-1682-4f04-adcb-6703d8a5d61b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2e249aaf65e4ab7bbf73e053f6782fd', 'request_id': 'req-07885555-1682-4f04-adcb-6703d8a5d61b'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:30.227816 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-07885555-1682-4f04-adcb-6703d8a5d61b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2e249aaf65e4ab7bbf73e053f6782fd', 'request_id': 'req-07885555-1682-4f04-adcb-6703d8a5d61b'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:30.235341 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-07885555-1682-4f04-adcb-6703d8a5d61b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2e249aaf65e4ab7bbf73e053f6782fd', 'request_id': 'req-07885555-1682-4f04-adcb-6703d8a5d61b'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:30.249453 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-07885555-1682-4f04-adcb-6703d8a5d61b admin admin] The token cache is being invalidate because project c2e249aaf65e4ab7bbf73e053f6782fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:01:30.249774 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-07885555-1682-4f04-adcb-6703d8a5d61b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:30.250405 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-07885555-1682-4f04-adcb-6703d8a5d61b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:30.251952 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1343/2683] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:01:30 2022] DELETE /identity/v3/projects/c2e249aaf65e4ab7bbf73e053f6782fd => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:30.257038 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eee5c4-ed13-4100-b83c-bc728971aa3e None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:30.257556 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eee5c4-ed13-4100-b83c-bc728971aa3e None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:30.257668 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eee5c4-ed13-4100-b83c-bc728971aa3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:30.280479 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-57eee5c4-ed13-4100-b83c-bc728971aa3e None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:30.281742 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-57eee5c4-ed13-4100-b83c-bc728971aa3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:30.342644 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1341/2684] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:30.350278 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fac7a-fa87-42e7-9daf-3a5bfa15707b None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:30.350563 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fac7a-fa87-42e7-9daf-3a5bfa15707b None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:30.350841 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fac7a-fa87-42e7-9daf-3a5bfa15707b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:30.372128 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-d51fac7a-fa87-42e7-9daf-3a5bfa15707b None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:30.373512 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-d51fac7a-fa87-42e7-9daf-3a5bfa15707b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:30.381441 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1344/2685] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:30.386019 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eee5c4-ed13-4100-b83c-bc728971aa3e None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:30.396198 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eee5c4-ed13-4100-b83c-bc728971aa3e None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:30.400698 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449e60f-dc50-4833-bf21-7aed7d458298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:30.401296 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449e60f-dc50-4833-bf21-7aed7d458298 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:30.401608 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449e60f-dc50-4833-bf21-7aed7d458298 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:30.401875 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449e60f-dc50-4833-bf21-7aed7d458298 admin admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:30.402571 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449e60f-dc50-4833-bf21-7aed7d458298 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:01:30.402862 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449e60f-dc50-4833-bf21-7aed7d458298 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:30.405222 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449e60f-dc50-4833-bf21-7aed7d458298 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:30.416675 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1342/2686] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 13:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 03 13:01:30.421428 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51fac7a-fa87-42e7-9daf-3a5bfa15707b None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:30.430684 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51fac7a-fa87-42e7-9daf-3a5bfa15707b None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:30.435419 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89778fd4-c0be-4b69-87d2-7c51845aa9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:30.436068 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89778fd4-c0be-4b69-87d2-7c51845aa9ad admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:30.436371 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89778fd4-c0be-4b69-87d2-7c51845aa9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:30.436641 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89778fd4-c0be-4b69-87d2-7c51845aa9ad admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:30.437329 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89778fd4-c0be-4b69-87d2-7c51845aa9ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:30.439253 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89778fd4-c0be-4b69-87d2-7c51845aa9ad admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:30.464162 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:30.480656 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1345/2687] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 13:01:30 2022] POST /identity/v3/projects => generated 367 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:01:30.484885 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449e60f-dc50-4833-bf21-7aed7d458298 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:30.494940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449e60f-dc50-4833-bf21-7aed7d458298 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:30.550368 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c2708-1c63-4c83-9ac7-86145d5a0cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:30.550977 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c2708-1c63-4c83-9ac7-86145d5a0cc1 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:30.551256 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c2708-1c63-4c83-9ac7-86145d5a0cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:30.551529 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c2708-1c63-4c83-9ac7-86145d5a0cc1 admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:30.552192 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c2708-1c63-4c83-9ac7-86145d5a0cc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:30.554133 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c2708-1c63-4c83-9ac7-86145d5a0cc1 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:30.563965 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:30.577424 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1343/2688] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 13:01:30 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:01:30.581696 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89778fd4-c0be-4b69-87d2-7c51845aa9ad admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:30.592525 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89778fd4-c0be-4b69-87d2-7c51845aa9ad admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:30.597053 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24621b-4524-47f5-880b-52e978e6d0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:30.597628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24621b-4524-47f5-880b-52e978e6d0dc admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:30.597910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24621b-4524-47f5-880b-52e978e6d0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:30.598181 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24621b-4524-47f5-880b-52e978e6d0dc admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:30.598883 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24621b-4524-47f5-880b-52e978e6d0dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:30.600452 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24621b-4524-47f5-880b-52e978e6d0dc admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:30.610434 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1346/2689] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:01:30.614211 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c2708-1c63-4c83-9ac7-86145d5a0cc1 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:30.624608 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c2708-1c63-4c83-9ac7-86145d5a0cc1 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:30.629315 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c77a1-a890-48f7-9d9f-a86355cf725f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:30.629951 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c77a1-a890-48f7-9d9f-a86355cf725f admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:30.630238 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c77a1-a890-48f7-9d9f-a86355cf725f admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:30.630514 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c77a1-a890-48f7-9d9f-a86355cf725f admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:30.631210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c77a1-a890-48f7-9d9f-a86355cf725f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:30.632800 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c77a1-a890-48f7-9d9f-a86355cf725f admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:30.644224 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1344/2690] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:01:30.648368 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24621b-4524-47f5-880b-52e978e6d0dc admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:30.659574 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24621b-4524-47f5-880b-52e978e6d0dc admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:30.664248 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54504c8-b1d3-46af-a8ea-ba674d1c28e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:30.664905 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54504c8-b1d3-46af-a8ea-ba674d1c28e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:30.665187 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54504c8-b1d3-46af-a8ea-ba674d1c28e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:30.665467 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54504c8-b1d3-46af-a8ea-ba674d1c28e8 admin admin] PATH_INFO: `/v3/projects/70ee4ed5449a4fa78787ee530f527349/users/5a01712586dc4be3967b0e5e23b846ad/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:30.680150 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54504c8-b1d3-46af-a8ea-ba674d1c28e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70ee4ed5449a4fa78787ee530f527349, user_id=5a01712586dc4be3967b0e5e23b846ad, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:30.682877 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54504c8-b1d3-46af-a8ea-ba674d1c28e8 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:30.696102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1347/2691] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:01:30 2022] PUT /identity/v3/projects/70ee4ed5449a4fa78787ee530f527349/users/5a01712586dc4be3967b0e5e23b846ad/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:01:30.708297 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39b4a9-5c39-4fac-b434-0a3ac21a9e6f None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:30.708583 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39b4a9-5c39-4fac-b434-0a3ac21a9e6f None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:30.708856 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39b4a9-5c39-4fac-b434-0a3ac21a9e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:30.736522 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-df39b4a9-5c39-4fac-b434-0a3ac21a9e6f None None] MFA Rules not processed for user `5a01712586dc4be3967b0e5e23b846ad`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:30.737764 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-df39b4a9-5c39-4fac-b434-0a3ac21a9e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:30.801921 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1345/2692] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:01:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:30.813987 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54504c8-b1d3-46af-a8ea-ba674d1c28e8 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:30.815670 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-f54504c8-b1d3-46af-a8ea-ba674d1c28e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:30.872876 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54504c8-b1d3-46af-a8ea-ba674d1c28e8 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:30.876434 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ef438-1ea0-48f3-abc3-daa6439e813c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2f23f4936684b63afc095986e43ec37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:30.877045 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ef438-1ea0-48f3-abc3-daa6439e813c service glance] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:30.877327 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ef438-1ea0-48f3-abc3-daa6439e813c service glance] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:30.877646 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ef438-1ea0-48f3-abc3-daa6439e813c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:30.886174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ef438-1ea0-48f3-abc3-daa6439e813c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:30.887599 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ef438-1ea0-48f3-abc3-daa6439e813c service glance] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:30.896897 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1348/2693] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:01:40.798972 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:INSERT=1,keystone:SELECT=39 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:40.893207 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=43,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:49.788232 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39b4a9-5c39-4fac-b434-0a3ac21a9e6f None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:49.789745 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-df39b4a9-5c39-4fac-b434-0a3ac21a9e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:49.847607 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39b4a9-5c39-4fac-b434-0a3ac21a9e6f None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:49.851379 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d828cda-a464-42a2-bb6e-747bdbe8d992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:49.852128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d828cda-a464-42a2-bb6e-747bdbe8d992 service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:49.852407 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d828cda-a464-42a2-bb6e-747bdbe8d992 service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:49.852682 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d828cda-a464-42a2-bb6e-747bdbe8d992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:49.854542 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-8d828cda-a464-42a2-bb6e-747bdbe8d992 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:49.928738 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d828cda-a464-42a2-bb6e-747bdbe8d992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:49.930216 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d828cda-a464-42a2-bb6e-747bdbe8d992 service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:49.941947 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1346/2694] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:01:51.156638 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ef438-1ea0-48f3-abc3-daa6439e813c service glance] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:51.170024 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ef438-1ea0-48f3-abc3-daa6439e813c service glance] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:51.173862 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040307c-0b55-4e60-93ee-5dee77b8cc43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:51.174463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040307c-0b55-4e60-93ee-5dee77b8cc43 service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:51.174814 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040307c-0b55-4e60-93ee-5dee77b8cc43 service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:51.175159 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040307c-0b55-4e60-93ee-5dee77b8cc43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:51.177758 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-5040307c-0b55-4e60-93ee-5dee77b8cc43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:51.192265 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040307c-0b55-4e60-93ee-5dee77b8cc43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:51.194104 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040307c-0b55-4e60-93ee-5dee77b8cc43 service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:51.205856 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1349/2695] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:01:55.416311 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d828cda-a464-42a2-bb6e-747bdbe8d992 service neutron] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:55.417874 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-8d828cda-a464-42a2-bb6e-747bdbe8d992 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:55.482146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d828cda-a464-42a2-bb6e-747bdbe8d992 service neutron] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:55.486754 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d60b0-6a82-4200-888c-8b6b939bbe34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:55.487386 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d60b0-6a82-4200-888c-8b6b939bbe34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:55.487662 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d60b0-6a82-4200-888c-8b6b939bbe34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:55.487933 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d60b0-6a82-4200-888c-8b6b939bbe34 admin admin] PATH_INFO: `/v3/users/66986de289b747b582cb48cb22624591` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:55.489102 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d60b0-6a82-4200-888c-8b6b939bbe34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66986de289b747b582cb48cb22624591)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:55.491682 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d60b0-6a82-4200-888c-8b6b939bbe34 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:55.534649 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:55.538216 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-0e5d60b0-6a82-4200-888c-8b6b939bbe34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66986de289b747b582cb48cb22624591'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:55.539256 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-0e5d60b0-6a82-4200-888c-8b6b939bbe34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66986de289b747b582cb48cb22624591'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:55.540038 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-0e5d60b0-6a82-4200-888c-8b6b939bbe34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66986de289b747b582cb48cb22624591'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:55.552892 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-0e5d60b0-6a82-4200-888c-8b6b939bbe34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66986de289b747b582cb48cb22624591'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:55.559799 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-0e5d60b0-6a82-4200-888c-8b6b939bbe34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66986de289b747b582cb48cb22624591'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:55.575106 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1347/2696] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:01:55 2022] DELETE /identity/v3/users/66986de289b747b582cb48cb22624591 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:55.579748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818dcac6-6d61-4bbd-a889-a14525856e98 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:55.580244 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818dcac6-6d61-4bbd-a889-a14525856e98 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:55.580369 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818dcac6-6d61-4bbd-a889-a14525856e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:55.599468 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-818dcac6-6d61-4bbd-a889-a14525856e98 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:55.600684 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-818dcac6-6d61-4bbd-a889-a14525856e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:55.658422 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1350/2697] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:55.668987 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d60b0-6a82-4200-888c-8b6b939bbe34 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:55.670405 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-0e5d60b0-6a82-4200-888c-8b6b939bbe34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:55.727703 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d60b0-6a82-4200-888c-8b6b939bbe34 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:55.731352 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7a7b6-9856-4dc4-bc46-a99d6c8c393b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:55.731961 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7a7b6-9856-4dc4-bc46-a99d6c8c393b service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:55.732293 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7a7b6-9856-4dc4-bc46-a99d6c8c393b service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:55.732515 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7a7b6-9856-4dc4-bc46-a99d6c8c393b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:55.741413 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7a7b6-9856-4dc4-bc46-a99d6c8c393b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:55.742870 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7a7b6-9856-4dc4-bc46-a99d6c8c393b service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:55.752167 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1348/2698] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:01:56.029286 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818dcac6-6d61-4bbd-a889-a14525856e98 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:56.030908 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-818dcac6-6d61-4bbd-a889-a14525856e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:56.045721 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818dcac6-6d61-4bbd-a889-a14525856e98 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:56.052061 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e83311-5159-4821-b735-6dee208e28db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:56.052863 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e83311-5159-4821-b735-6dee208e28db admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:56.053226 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e83311-5159-4821-b735-6dee208e28db admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:56.053527 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e83311-5159-4821-b735-6dee208e28db admin admin] PATH_INFO: `/v3/projects/b029bcf8f79a493c94a891fec753ea78` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:56.054716 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e83311-5159-4821-b735-6dee208e28db admin admin] RBAC: Authorizing `identity:delete_project(project_id=b029bcf8f79a493c94a891fec753ea78)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:56.056623 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e83311-5159-4821-b735-6dee208e28db admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:56.104449 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-36e83311-5159-4821-b735-6dee208e28db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b029bcf8f79a493c94a891fec753ea78', 'request_id': 'req-36e83311-5159-4821-b735-6dee208e28db'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:56.110942 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-36e83311-5159-4821-b735-6dee208e28db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b029bcf8f79a493c94a891fec753ea78', 'request_id': 'req-36e83311-5159-4821-b735-6dee208e28db'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:56.116568 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-36e83311-5159-4821-b735-6dee208e28db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b029bcf8f79a493c94a891fec753ea78', 'request_id': 'req-36e83311-5159-4821-b735-6dee208e28db'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:56.129360 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-36e83311-5159-4821-b735-6dee208e28db admin admin] The token cache is being invalidate because project b029bcf8f79a493c94a891fec753ea78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:01:56.129681 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-36e83311-5159-4821-b735-6dee208e28db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:56.130861 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-36e83311-5159-4821-b735-6dee208e28db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:56.132552 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1351/2699] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:01:56 2022] DELETE /identity/v3/projects/b029bcf8f79a493c94a891fec753ea78 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:56.136830 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7a7b6-9856-4dc4-bc46-a99d6c8c393b service neutron] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:56.147376 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7a7b6-9856-4dc4-bc46-a99d6c8c393b service neutron] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:56.202804 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae833af9-4b11-4b46-b9e2-4b916e655cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:56.203484 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae833af9-4b11-4b46-b9e2-4b916e655cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:56.203765 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae833af9-4b11-4b46-b9e2-4b916e655cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:56.204050 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae833af9-4b11-4b46-b9e2-4b916e655cbd admin admin] PATH_INFO: `/v3/users/2eff2c0059834f0791d2fa686267aa94` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:56.205216 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae833af9-4b11-4b46-b9e2-4b916e655cbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eff2c0059834f0791d2fa686267aa94)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:56.207177 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae833af9-4b11-4b46-b9e2-4b916e655cbd admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:56.282960 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-ae833af9-4b11-4b46-b9e2-4b916e655cbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eff2c0059834f0791d2fa686267aa94'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:56.283735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-ae833af9-4b11-4b46-b9e2-4b916e655cbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eff2c0059834f0791d2fa686267aa94'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:56.284434 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-ae833af9-4b11-4b46-b9e2-4b916e655cbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eff2c0059834f0791d2fa686267aa94'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:56.296912 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-ae833af9-4b11-4b46-b9e2-4b916e655cbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eff2c0059834f0791d2fa686267aa94'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:56.298127 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:56.306054 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-ae833af9-4b11-4b46-b9e2-4b916e655cbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eff2c0059834f0791d2fa686267aa94'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:56.322440 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1349/2700] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:01:56 2022] DELETE /identity/v3/users/2eff2c0059834f0791d2fa686267aa94 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:56.612763 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e83311-5159-4821-b735-6dee208e28db admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:56.614799 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-36e83311-5159-4821-b735-6dee208e28db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:56.630006 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e83311-5159-4821-b735-6dee208e28db admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:56.687522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c8f45-2f46-4ce7-b1b1-78ce23044df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:56.688166 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c8f45-2f46-4ce7-b1b1-78ce23044df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:56.688450 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c8f45-2f46-4ce7-b1b1-78ce23044df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:56.688726 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c8f45-2f46-4ce7-b1b1-78ce23044df6 admin admin] PATH_INFO: `/v3/projects/f6c502ad8d8c4563b9ed6e096e52277e` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:56.689908 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c8f45-2f46-4ce7-b1b1-78ce23044df6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6c502ad8d8c4563b9ed6e096e52277e)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:56.691858 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c8f45-2f46-4ce7-b1b1-78ce23044df6 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:56.703477 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:56.742166 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a71c8f45-2f46-4ce7-b1b1-78ce23044df6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6c502ad8d8c4563b9ed6e096e52277e', 'request_id': 'req-a71c8f45-2f46-4ce7-b1b1-78ce23044df6'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:56.748304 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a71c8f45-2f46-4ce7-b1b1-78ce23044df6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6c502ad8d8c4563b9ed6e096e52277e', 'request_id': 'req-a71c8f45-2f46-4ce7-b1b1-78ce23044df6'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:56.753745 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a71c8f45-2f46-4ce7-b1b1-78ce23044df6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6c502ad8d8c4563b9ed6e096e52277e', 'request_id': 'req-a71c8f45-2f46-4ce7-b1b1-78ce23044df6'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:56.766587 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a71c8f45-2f46-4ce7-b1b1-78ce23044df6 admin admin] The token cache is being invalidate because project f6c502ad8d8c4563b9ed6e096e52277e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:01:56.766871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a71c8f45-2f46-4ce7-b1b1-78ce23044df6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:56.767496 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a71c8f45-2f46-4ce7-b1b1-78ce23044df6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:01:56.769002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1352/2701] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:01:56 2022] DELETE /identity/v3/projects/f6c502ad8d8c4563b9ed6e096e52277e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:56.774455 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039d961-a346-4336-ac7c-61cc3c91e42a None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:56.774940 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039d961-a346-4336-ac7c-61cc3c91e42a None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:56.775046 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039d961-a346-4336-ac7c-61cc3c91e42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:56.918791 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-d039d961-a346-4336-ac7c-61cc3c91e42a None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:56.920040 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-d039d961-a346-4336-ac7c-61cc3c91e42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:56.978939 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1350/2702] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:56.986746 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1715c0d-25aa-4108-abbc-d7c65b43cca8 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:56.987031 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1715c0d-25aa-4108-abbc-d7c65b43cca8 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:56.987306 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1715c0d-25aa-4108-abbc-d7c65b43cca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:57.007341 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-c1715c0d-25aa-4108-abbc-d7c65b43cca8 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:57.008483 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-c1715c0d-25aa-4108-abbc-d7c65b43cca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:57.016943 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1353/2703] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:57.021724 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039d961-a346-4336-ac7c-61cc3c91e42a None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:57.031427 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039d961-a346-4336-ac7c-61cc3c91e42a None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:57.036213 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827dc93-3c74-49b9-a2c2-fb3d18519ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:57.036787 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827dc93-3c74-49b9-a2c2-fb3d18519ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:57.037067 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827dc93-3c74-49b9-a2c2-fb3d18519ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:57.037342 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827dc93-3c74-49b9-a2c2-fb3d18519ca6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:57.038073 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827dc93-3c74-49b9-a2c2-fb3d18519ca6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:01:57.038402 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827dc93-3c74-49b9-a2c2-fb3d18519ca6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:57.039964 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827dc93-3c74-49b9-a2c2-fb3d18519ca6 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:57.052663 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1351/2704] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 13:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:01:57.057061 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1715c0d-25aa-4108-abbc-d7c65b43cca8 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:57.066434 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1715c0d-25aa-4108-abbc-d7c65b43cca8 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:57.071792 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a68d5-1701-4ad5-b94b-4cd7a8626068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:57.072398 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a68d5-1701-4ad5-b94b-4cd7a8626068 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:57.072676 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a68d5-1701-4ad5-b94b-4cd7a8626068 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:57.072950 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a68d5-1701-4ad5-b94b-4cd7a8626068 admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:57.073653 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a68d5-1701-4ad5-b94b-4cd7a8626068 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:57.075536 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a68d5-1701-4ad5-b94b-4cd7a8626068 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:57.106156 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1354/2705] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 13:01:57 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:01:57.110465 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827dc93-3c74-49b9-a2c2-fb3d18519ca6 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:57.120456 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827dc93-3c74-49b9-a2c2-fb3d18519ca6 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:57.179854 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95689451-9150-44e5-a11a-36cf7c1be50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:57.180481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95689451-9150-44e5-a11a-36cf7c1be50c admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:57.180761 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95689451-9150-44e5-a11a-36cf7c1be50c admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:57.181034 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95689451-9150-44e5-a11a-36cf7c1be50c admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:57.181761 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95689451-9150-44e5-a11a-36cf7c1be50c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:57.183809 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95689451-9150-44e5-a11a-36cf7c1be50c admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:57.205290 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1352/2706] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 13:01:57 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:01:57.209748 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a68d5-1701-4ad5-b94b-4cd7a8626068 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:57.220071 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a68d5-1701-4ad5-b94b-4cd7a8626068 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:57.224754 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f28d7-13d4-4dab-8f36-f19b1e56bc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:57.225359 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f28d7-13d4-4dab-8f36-f19b1e56bc91 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:57.225696 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f28d7-13d4-4dab-8f36-f19b1e56bc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:57.225974 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f28d7-13d4-4dab-8f36-f19b1e56bc91 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:57.226669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f28d7-13d4-4dab-8f36-f19b1e56bc91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:57.228256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f28d7-13d4-4dab-8f36-f19b1e56bc91 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:57.238245 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1355/2707] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:01:57.242824 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95689451-9150-44e5-a11a-36cf7c1be50c admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:57.253123 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95689451-9150-44e5-a11a-36cf7c1be50c admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:57.258570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1a6f7-2254-4e57-ae15-47c7b9be8c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:57.259122 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1a6f7-2254-4e57-ae15-47c7b9be8c1a admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:57.259653 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1a6f7-2254-4e57-ae15-47c7b9be8c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:57.259928 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1a6f7-2254-4e57-ae15-47c7b9be8c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:57.260629 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1a6f7-2254-4e57-ae15-47c7b9be8c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:57.262288 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1a6f7-2254-4e57-ae15-47c7b9be8c1a admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:57.274321 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1353/2708] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:01:57.278744 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f28d7-13d4-4dab-8f36-f19b1e56bc91 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:57.289165 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f28d7-13d4-4dab-8f36-f19b1e56bc91 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:57.293794 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062ff29-0948-4e86-b967-df5e960f7c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:57.294446 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062ff29-0948-4e86-b967-df5e960f7c79 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:57.294726 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062ff29-0948-4e86-b967-df5e960f7c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:57.295008 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062ff29-0948-4e86-b967-df5e960f7c79 admin admin] PATH_INFO: `/v3/projects/abf49bbad589412aa85715efdab0a91c/users/f4c224a6c6654a368c38415099763478/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:57.311151 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062ff29-0948-4e86-b967-df5e960f7c79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abf49bbad589412aa85715efdab0a91c, user_id=f4c224a6c6654a368c38415099763478, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:57.313872 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062ff29-0948-4e86-b967-df5e960f7c79 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:57.327793 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1356/2709] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:01:57 2022] PUT /identity/v3/projects/abf49bbad589412aa85715efdab0a91c/users/f4c224a6c6654a368c38415099763478/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:57.339448 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2ddff-6b7f-4dfe-a8d8-2c1836a38cd1 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:57.339735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2ddff-6b7f-4dfe-a8d8-2c1836a38cd1 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:57.340010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2ddff-6b7f-4dfe-a8d8-2c1836a38cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:57.368190 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-9fc2ddff-6b7f-4dfe-a8d8-2c1836a38cd1 None None] MFA Rules not processed for user `f4c224a6c6654a368c38415099763478`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:57.369407 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-9fc2ddff-6b7f-4dfe-a8d8-2c1836a38cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:57.408014 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:57.436473 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1354/2710] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:01:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:57.441113 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062ff29-0948-4e86-b967-df5e960f7c79 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:57.504425 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062ff29-0948-4e86-b967-df5e960f7c79 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:57.509075 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ded455-bd03-4d7b-bf67-c70e5835259f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:57.509907 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ded455-bd03-4d7b-bf67-c70e5835259f admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:57.510190 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ded455-bd03-4d7b-bf67-c70e5835259f admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:57.510469 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ded455-bd03-4d7b-bf67-c70e5835259f admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:57.511130 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ded455-bd03-4d7b-bf67-c70e5835259f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:57.513017 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ded455-bd03-4d7b-bf67-c70e5835259f admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:57.542048 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1357/2711] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 13:01:57 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:01:57.546194 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2ddff-6b7f-4dfe-a8d8-2c1836a38cd1 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:57.557260 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2ddff-6b7f-4dfe-a8d8-2c1836a38cd1 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:57.623390 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee7ce4-6f37-4a53-9571-9c08a56838ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:57.624118 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee7ce4-6f37-4a53-9571-9c08a56838ee admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:57.624472 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee7ce4-6f37-4a53-9571-9c08a56838ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:57.625261 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee7ce4-6f37-4a53-9571-9c08a56838ee admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:57.625685 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee7ce4-6f37-4a53-9571-9c08a56838ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:57.627702 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee7ce4-6f37-4a53-9571-9c08a56838ee admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:57.650998 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1355/2712] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 13:01:57 2022] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:01:57.654977 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ded455-bd03-4d7b-bf67-c70e5835259f admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:57.671127 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ded455-bd03-4d7b-bf67-c70e5835259f admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:57.679041 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13cd9df-4d4a-499b-b170-558db365f968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:57.679661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13cd9df-4d4a-499b-b170-558db365f968 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:57.679942 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13cd9df-4d4a-499b-b170-558db365f968 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:57.680214 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13cd9df-4d4a-499b-b170-558db365f968 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:57.680926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13cd9df-4d4a-499b-b170-558db365f968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:57.682510 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13cd9df-4d4a-499b-b170-558db365f968 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:57.694681 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1358/2713] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:01:57.704710 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee7ce4-6f37-4a53-9571-9c08a56838ee admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:57.717919 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee7ce4-6f37-4a53-9571-9c08a56838ee admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:57.722803 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde6837-33bf-4791-ae34-8b9d4f6ffff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:57.723464 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde6837-33bf-4791-ae34-8b9d4f6ffff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:57.723877 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde6837-33bf-4791-ae34-8b9d4f6ffff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:57.724134 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde6837-33bf-4791-ae34-8b9d4f6ffff4 admin admin] PATH_INFO: `/v3/projects/044b8038301447dd8d8a722edf4ee321/users/46d3e317c33343b9bc8f249530a259d9/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:57.743839 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde6837-33bf-4791-ae34-8b9d4f6ffff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=044b8038301447dd8d8a722edf4ee321, user_id=46d3e317c33343b9bc8f249530a259d9, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:57.746612 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde6837-33bf-4791-ae34-8b9d4f6ffff4 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:57.761019 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1356/2714] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:01:57 2022] PUT /identity/v3/projects/044b8038301447dd8d8a722edf4ee321/users/46d3e317c33343b9bc8f249530a259d9/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:57.765069 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13cd9df-4d4a-499b-b170-558db365f968 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:57.778288 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13cd9df-4d4a-499b-b170-558db365f968 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:57.786537 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:01:57.839868 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce725fd8-033d-41fe-a5cf-e3dad07507cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:57.840584 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce725fd8-033d-41fe-a5cf-e3dad07507cb admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:57.840864 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce725fd8-033d-41fe-a5cf-e3dad07507cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:57.841139 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce725fd8-033d-41fe-a5cf-e3dad07507cb admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:57.841994 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce725fd8-033d-41fe-a5cf-e3dad07507cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:57.843773 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce725fd8-033d-41fe-a5cf-e3dad07507cb admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:57.854436 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1359/2715] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:01:57.859180 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde6837-33bf-4791-ae34-8b9d4f6ffff4 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:57.871297 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde6837-33bf-4791-ae34-8b9d4f6ffff4 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:57.875876 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa28319-28b0-47b8-830c-647e11e25720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:57.876527 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa28319-28b0-47b8-830c-647e11e25720 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:57.876802 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa28319-28b0-47b8-830c-647e11e25720 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:57.877074 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa28319-28b0-47b8-830c-647e11e25720 admin admin] PATH_INFO: `/v3/projects/044b8038301447dd8d8a722edf4ee321/users/46d3e317c33343b9bc8f249530a259d9/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:57.879192 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa28319-28b0-47b8-830c-647e11e25720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=044b8038301447dd8d8a722edf4ee321, user_id=46d3e317c33343b9bc8f249530a259d9, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:57.882962 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa28319-28b0-47b8-830c-647e11e25720 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:57.894595 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1357/2716] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:01:57 2022] PUT /identity/v3/projects/044b8038301447dd8d8a722edf4ee321/users/46d3e317c33343b9bc8f249530a259d9/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:01:57.906031 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20daf791-326f-4e9d-9e6a-8bef6fb214fe None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:57.906318 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20daf791-326f-4e9d-9e6a-8bef6fb214fe None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:57.906594 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20daf791-326f-4e9d-9e6a-8bef6fb214fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:57.937787 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-20daf791-326f-4e9d-9e6a-8bef6fb214fe None None] MFA Rules not processed for user `46d3e317c33343b9bc8f249530a259d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:01:57.938999 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-20daf791-326f-4e9d-9e6a-8bef6fb214fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:58.010147 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1360/2717] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:01:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:01:58.021522 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa28319-28b0-47b8-830c-647e11e25720 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:58.023321 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-7aa28319-28b0-47b8-830c-647e11e25720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:01:58.080379 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa28319-28b0-47b8-830c-647e11e25720 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:58.084038 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d1301-0843-4531-99e4-4b32cd1a76b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:58.084647 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d1301-0843-4531-99e4-4b32cd1a76b9 service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:58.084927 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d1301-0843-4531-99e4-4b32cd1a76b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:58.085197 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d1301-0843-4531-99e4-4b32cd1a76b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:58.094001 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d1301-0843-4531-99e4-4b32cd1a76b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:58.095424 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d1301-0843-4531-99e4-4b32cd1a76b9 service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:58.104811 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1358/2718] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:01:58.180278 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20daf791-326f-4e9d-9e6a-8bef6fb214fe None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:01:58.190241 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20daf791-326f-4e9d-9e6a-8bef6fb214fe None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:01:58.194482 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759cdbe-2d0e-41d8-9a89-3f374438ccd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:01:58.195088 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759cdbe-2d0e-41d8-9a89-3f374438ccd3 service cinder] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:01:58.195366 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759cdbe-2d0e-41d8-9a89-3f374438ccd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:01:58.195640 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759cdbe-2d0e-41d8-9a89-3f374438ccd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:01:58.254205 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759cdbe-2d0e-41d8-9a89-3f374438ccd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:01:58.255901 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759cdbe-2d0e-41d8-9a89-3f374438ccd3 service cinder] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:01:58.269256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1361/2719] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:01:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:02.210226 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d1301-0843-4531-99e4-4b32cd1a76b9 service cinder] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:02.211638 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-dc1d1301-0843-4531-99e4-4b32cd1a76b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:02.256496 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:02.301062 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d1301-0843-4531-99e4-4b32cd1a76b9 service cinder] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:02.309919 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84306c46-5022-4733-ae39-23d7fac2cedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:02.313487 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84306c46-5022-4733-ae39-23d7fac2cedb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:02.313487 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84306c46-5022-4733-ae39-23d7fac2cedb admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:02.313487 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84306c46-5022-4733-ae39-23d7fac2cedb admin admin] PATH_INFO: `/v3/users/5a01712586dc4be3967b0e5e23b846ad` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:02.314521 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84306c46-5022-4733-ae39-23d7fac2cedb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a01712586dc4be3967b0e5e23b846ad)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:02.318286 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84306c46-5022-4733-ae39-23d7fac2cedb admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:02.376535 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-84306c46-5022-4733-ae39-23d7fac2cedb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a01712586dc4be3967b0e5e23b846ad'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:02.377181 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-84306c46-5022-4733-ae39-23d7fac2cedb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a01712586dc4be3967b0e5e23b846ad'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:02.377796 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-84306c46-5022-4733-ae39-23d7fac2cedb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a01712586dc4be3967b0e5e23b846ad'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:02.394594 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-84306c46-5022-4733-ae39-23d7fac2cedb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a01712586dc4be3967b0e5e23b846ad'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:02.401874 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-84306c46-5022-4733-ae39-23d7fac2cedb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a01712586dc4be3967b0e5e23b846ad'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:02.418928 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1359/2720] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:02:02 2022] DELETE /identity/v3/users/5a01712586dc4be3967b0e5e23b846ad => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:02.423392 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc6bb1-92c8-4ad4-abbb-1c37fea9d703 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:02.423872 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc6bb1-92c8-4ad4-abbb-1c37fea9d703 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:02.423999 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc6bb1-92c8-4ad4-abbb-1c37fea9d703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:02.443681 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-0dcc6bb1-92c8-4ad4-abbb-1c37fea9d703 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:02.444918 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-0dcc6bb1-92c8-4ad4-abbb-1c37fea9d703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:02.476240 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:02.517338 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1362/2721] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:02:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:02.529234 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84306c46-5022-4733-ae39-23d7fac2cedb admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:02.530769 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-84306c46-5022-4733-ae39-23d7fac2cedb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:02.590763 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84306c46-5022-4733-ae39-23d7fac2cedb admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:02.594672 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96742cb8-a7af-482c-9ec7-62b08226aefc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:02.595652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96742cb8-a7af-482c-9ec7-62b08226aefc service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:02.595959 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96742cb8-a7af-482c-9ec7-62b08226aefc service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:02.596489 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96742cb8-a7af-482c-9ec7-62b08226aefc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:02.607141 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96742cb8-a7af-482c-9ec7-62b08226aefc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:02.608577 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96742cb8-a7af-482c-9ec7-62b08226aefc service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:02.618614 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1360/2722] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:02.884859 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc6bb1-92c8-4ad4-abbb-1c37fea9d703 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:02.886352 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-0dcc6bb1-92c8-4ad4-abbb-1c37fea9d703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:02.898995 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc6bb1-92c8-4ad4-abbb-1c37fea9d703 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:02.904204 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b06a6c-53b4-46d1-83ab-b140b110281f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:02.904852 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b06a6c-53b4-46d1-83ab-b140b110281f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:02.905143 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b06a6c-53b4-46d1-83ab-b140b110281f admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:02.905421 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b06a6c-53b4-46d1-83ab-b140b110281f admin admin] PATH_INFO: `/v3/projects/70ee4ed5449a4fa78787ee530f527349` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:02.906676 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b06a6c-53b4-46d1-83ab-b140b110281f admin admin] RBAC: Authorizing `identity:delete_project(project_id=70ee4ed5449a4fa78787ee530f527349)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:02.908570 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b06a6c-53b4-46d1-83ab-b140b110281f admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:02.956772 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-95b06a6c-53b4-46d1-83ab-b140b110281f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70ee4ed5449a4fa78787ee530f527349', 'request_id': 'req-95b06a6c-53b4-46d1-83ab-b140b110281f'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:02.963089 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-95b06a6c-53b4-46d1-83ab-b140b110281f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70ee4ed5449a4fa78787ee530f527349', 'request_id': 'req-95b06a6c-53b4-46d1-83ab-b140b110281f'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:02.968715 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-95b06a6c-53b4-46d1-83ab-b140b110281f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70ee4ed5449a4fa78787ee530f527349', 'request_id': 'req-95b06a6c-53b4-46d1-83ab-b140b110281f'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:02.982594 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-95b06a6c-53b4-46d1-83ab-b140b110281f admin admin] The token cache is being invalidate because project 70ee4ed5449a4fa78787ee530f527349 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:02:02.982883 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-95b06a6c-53b4-46d1-83ab-b140b110281f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:02.983513 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-95b06a6c-53b4-46d1-83ab-b140b110281f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:02.985035 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1363/2723] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:02:02 2022] DELETE /identity/v3/projects/70ee4ed5449a4fa78787ee530f527349 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:02.990458 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e361a0-9ac5-4abf-94a8-97fab19b3c71 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:02.990760 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e361a0-9ac5-4abf-94a8-97fab19b3c71 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:02.991020 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e361a0-9ac5-4abf-94a8-97fab19b3c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:03.011281 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-71e361a0-9ac5-4abf-94a8-97fab19b3c71 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:03.012560 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-71e361a0-9ac5-4abf-94a8-97fab19b3c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:03.063506 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:03.077638 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1361/2724] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:02:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:03.085477 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56040cd8-b004-470f-97b1-ee453b3c72b2 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:03.085735 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56040cd8-b004-470f-97b1-ee453b3c72b2 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:03.086018 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56040cd8-b004-470f-97b1-ee453b3c72b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:03.106273 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-56040cd8-b004-470f-97b1-ee453b3c72b2 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:03.107490 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-56040cd8-b004-470f-97b1-ee453b3c72b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:03.116104 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1364/2725] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:03.120583 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e361a0-9ac5-4abf-94a8-97fab19b3c71 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:03.130287 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e361a0-9ac5-4abf-94a8-97fab19b3c71 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:03.135742 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87668466-8be8-4191-92a0-a9a5e19614e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:03.136362 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87668466-8be8-4191-92a0-a9a5e19614e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:03.136668 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87668466-8be8-4191-92a0-a9a5e19614e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:03.136911 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87668466-8be8-4191-92a0-a9a5e19614e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:03.137652 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87668466-8be8-4191-92a0-a9a5e19614e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:02:03.137954 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87668466-8be8-4191-92a0-a9a5e19614e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:03.139602 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87668466-8be8-4191-92a0-a9a5e19614e5 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:03.152862 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1362/2726] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 13:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:02:03.157258 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56040cd8-b004-470f-97b1-ee453b3c72b2 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:03.167921 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56040cd8-b004-470f-97b1-ee453b3c72b2 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:03.172555 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a73639-dc24-492b-8016-12b006adcbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:03.173161 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a73639-dc24-492b-8016-12b006adcbdf admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:03.173444 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a73639-dc24-492b-8016-12b006adcbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:03.173751 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a73639-dc24-492b-8016-12b006adcbdf admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:03.174423 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a73639-dc24-492b-8016-12b006adcbdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:03.176322 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a73639-dc24-492b-8016-12b006adcbdf admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:03.206155 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1365/2727] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 13:02:03 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:02:03.211054 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87668466-8be8-4191-92a0-a9a5e19614e5 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:03.221318 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87668466-8be8-4191-92a0-a9a5e19614e5 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:03.285082 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e67e3-5c06-407d-aa21-2b1d73577dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:03.285810 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e67e3-5c06-407d-aa21-2b1d73577dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:03.286668 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e67e3-5c06-407d-aa21-2b1d73577dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:03.286931 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e67e3-5c06-407d-aa21-2b1d73577dc3 admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:03.287579 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e67e3-5c06-407d-aa21-2b1d73577dc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:03.289532 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e67e3-5c06-407d-aa21-2b1d73577dc3 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:03.311112 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1363/2728] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 13:02:03 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:02:03.315364 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a73639-dc24-492b-8016-12b006adcbdf admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:03.325715 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a73639-dc24-492b-8016-12b006adcbdf admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:03.330356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc9406-369f-420d-9107-98887e4a4bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:03.330952 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc9406-369f-420d-9107-98887e4a4bea admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:03.331255 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc9406-369f-420d-9107-98887e4a4bea admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:03.331513 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc9406-369f-420d-9107-98887e4a4bea admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:03.332211 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc9406-369f-420d-9107-98887e4a4bea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:03.334658 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc9406-369f-420d-9107-98887e4a4bea admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:03.344589 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1366/2729] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:02:03.348547 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e67e3-5c06-407d-aa21-2b1d73577dc3 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:03.359336 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e67e3-5c06-407d-aa21-2b1d73577dc3 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:03.363885 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50a0ac-7fd4-4acc-b690-cdfae55283a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:03.364796 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50a0ac-7fd4-4acc-b690-cdfae55283a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:03.365131 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50a0ac-7fd4-4acc-b690-cdfae55283a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:03.365404 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50a0ac-7fd4-4acc-b690-cdfae55283a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:03.366122 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50a0ac-7fd4-4acc-b690-cdfae55283a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:03.367690 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50a0ac-7fd4-4acc-b690-cdfae55283a1 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:03.377969 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1364/2730] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:02:03.381947 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc9406-369f-420d-9107-98887e4a4bea admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:03.392150 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc9406-369f-420d-9107-98887e4a4bea admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:03.397339 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ddecfa-1733-49da-a29a-6e91b5590d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:03.398020 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddecfa-1733-49da-a29a-6e91b5590d0a admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:03.398306 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddecfa-1733-49da-a29a-6e91b5590d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:03.398584 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddecfa-1733-49da-a29a-6e91b5590d0a admin admin] PATH_INFO: `/v3/projects/8cfd4209326f4853b07d19ad87c711c6/users/5c0517330b7648faac9b15b72cbce9a1/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:03.413668 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ddecfa-1733-49da-a29a-6e91b5590d0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cfd4209326f4853b07d19ad87c711c6, user_id=5c0517330b7648faac9b15b72cbce9a1, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:03.416280 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ddecfa-1733-49da-a29a-6e91b5590d0a admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:03.429047 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1367/2731] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:02:03 2022] PUT /identity/v3/projects/8cfd4209326f4853b07d19ad87c711c6/users/5c0517330b7648faac9b15b72cbce9a1/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:03.434007 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb128f21-02bd-4227-8b57-fdf0f92f3362 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:03.434298 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb128f21-02bd-4227-8b57-fdf0f92f3362 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:03.434574 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb128f21-02bd-4227-8b57-fdf0f92f3362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:03.453052 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-cb128f21-02bd-4227-8b57-fdf0f92f3362 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:03.454294 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-cb128f21-02bd-4227-8b57-fdf0f92f3362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:03.512130 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1365/2732] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:03.522435 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ddecfa-1733-49da-a29a-6e91b5590d0a admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:03.524167 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-07ddecfa-1733-49da-a29a-6e91b5590d0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:03.582443 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ddecfa-1733-49da-a29a-6e91b5590d0a admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:03.586686 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8a184-c10b-45c5-a787-3dc34e4422ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:03.587289 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8a184-c10b-45c5-a787-3dc34e4422ab service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:03.587598 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8a184-c10b-45c5-a787-3dc34e4422ab service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:03.587878 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8a184-c10b-45c5-a787-3dc34e4422ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:03.593644 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:03.598463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e8a184-c10b-45c5-a787-3dc34e4422ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:03.600756 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e8a184-c10b-45c5-a787-3dc34e4422ab service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:03.611002 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1368/2733] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:04.251238 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575a6d3-f5a7-4ac6-87ac-21231cf7af78 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:04.251716 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575a6d3-f5a7-4ac6-87ac-21231cf7af78 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:04.251839 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575a6d3-f5a7-4ac6-87ac-21231cf7af78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:04.292599 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-7575a6d3-f5a7-4ac6-87ac-21231cf7af78 None None] MFA Rules not processed for user `5c0517330b7648faac9b15b72cbce9a1`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:04.293866 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-7575a6d3-f5a7-4ac6-87ac-21231cf7af78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:04.344334 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:04.363481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1366/2734] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:02:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:04.374372 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8a184-c10b-45c5-a787-3dc34e4422ab service neutron] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:04.375881 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-83e8a184-c10b-45c5-a787-3dc34e4422ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:04.437758 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8a184-c10b-45c5-a787-3dc34e4422ab service neutron] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:04.441518 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221d28d-398f-4812-abea-79ad6a3887f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:04.442900 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221d28d-398f-4812-abea-79ad6a3887f8 service cinder] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:04.443180 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221d28d-398f-4812-abea-79ad6a3887f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:04.443613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221d28d-398f-4812-abea-79ad6a3887f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:04.452415 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221d28d-398f-4812-abea-79ad6a3887f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:04.453931 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221d28d-398f-4812-abea-79ad6a3887f8 service cinder] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:04.463759 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1369/2735] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:05.114999 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7575a6d3-f5a7-4ac6-87ac-21231cf7af78 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:05.116508 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-7575a6d3-f5a7-4ac6-87ac-21231cf7af78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:05.129990 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7575a6d3-f5a7-4ac6-87ac-21231cf7af78 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:05.135851 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a848a-35b8-4f28-9e19-928009686c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:05.136583 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a848a-35b8-4f28-9e19-928009686c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:05.136869 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a848a-35b8-4f28-9e19-928009686c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:05.137169 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a848a-35b8-4f28-9e19-928009686c14 admin admin] PATH_INFO: `/v3/users/f4c224a6c6654a368c38415099763478` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:05.138395 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a848a-35b8-4f28-9e19-928009686c14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4c224a6c6654a368c38415099763478)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:05.140348 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a848a-35b8-4f28-9e19-928009686c14 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:05.189434 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-2f9a848a-35b8-4f28-9e19-928009686c14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4c224a6c6654a368c38415099763478'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:05.190106 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-2f9a848a-35b8-4f28-9e19-928009686c14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4c224a6c6654a368c38415099763478'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:05.190729 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-2f9a848a-35b8-4f28-9e19-928009686c14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4c224a6c6654a368c38415099763478'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:05.203386 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-2f9a848a-35b8-4f28-9e19-928009686c14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4c224a6c6654a368c38415099763478'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:05.210399 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-2f9a848a-35b8-4f28-9e19-928009686c14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4c224a6c6654a368c38415099763478'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:05.224915 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1367/2736] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:02:05 2022] DELETE /identity/v3/users/f4c224a6c6654a368c38415099763478 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:05.229596 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f28b0f-b558-457b-a6db-bc32a6190858 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:05.229881 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f28b0f-b558-457b-a6db-bc32a6190858 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:05.230151 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f28b0f-b558-457b-a6db-bc32a6190858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:05.250313 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-75f28b0f-b558-457b-a6db-bc32a6190858 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:05.251522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-75f28b0f-b558-457b-a6db-bc32a6190858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:05.319876 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1370/2737] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:05.329435 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a848a-35b8-4f28-9e19-928009686c14 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:05.331132 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-2f9a848a-35b8-4f28-9e19-928009686c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:05.393985 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a848a-35b8-4f28-9e19-928009686c14 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:05.398395 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf65f86-292d-4894-ad0f-b6f481edb16f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:05.399035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf65f86-292d-4894-ad0f-b6f481edb16f service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:05.399318 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf65f86-292d-4894-ad0f-b6f481edb16f service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:05.399589 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf65f86-292d-4894-ad0f-b6f481edb16f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:05.409234 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf65f86-292d-4894-ad0f-b6f481edb16f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:05.410680 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf65f86-292d-4894-ad0f-b6f481edb16f service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:05.421363 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1368/2738] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:05.733784 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f28b0f-b558-457b-a6db-bc32a6190858 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:05.735265 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-75f28b0f-b558-457b-a6db-bc32a6190858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:05.747971 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f28b0f-b558-457b-a6db-bc32a6190858 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:05.753273 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc5c81-d8b2-4bd4-8c94-e68f99795965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:05.753955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc5c81-d8b2-4bd4-8c94-e68f99795965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:05.754244 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc5c81-d8b2-4bd4-8c94-e68f99795965 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:05.754628 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc5c81-d8b2-4bd4-8c94-e68f99795965 admin admin] PATH_INFO: `/v3/projects/abf49bbad589412aa85715efdab0a91c` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:05.756056 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc5c81-d8b2-4bd4-8c94-e68f99795965 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abf49bbad589412aa85715efdab0a91c)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:05.758006 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc5c81-d8b2-4bd4-8c94-e68f99795965 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:05.809268 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-20cc5c81-d8b2-4bd4-8c94-e68f99795965 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abf49bbad589412aa85715efdab0a91c', 'request_id': 'req-20cc5c81-d8b2-4bd4-8c94-e68f99795965'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:05.824833 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-20cc5c81-d8b2-4bd4-8c94-e68f99795965 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abf49bbad589412aa85715efdab0a91c', 'request_id': 'req-20cc5c81-d8b2-4bd4-8c94-e68f99795965'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:05.830850 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-20cc5c81-d8b2-4bd4-8c94-e68f99795965 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abf49bbad589412aa85715efdab0a91c', 'request_id': 'req-20cc5c81-d8b2-4bd4-8c94-e68f99795965'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:05.831817 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165c58e-2bd3-4c39-8a82-cc6a5c2d6be7 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:05.832096 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165c58e-2bd3-4c39-8a82-cc6a5c2d6be7 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:05.832364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165c58e-2bd3-4c39-8a82-cc6a5c2d6be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:05.845098 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-20cc5c81-d8b2-4bd4-8c94-e68f99795965 admin admin] The token cache is being invalidate because project abf49bbad589412aa85715efdab0a91c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:02:05.845541 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-20cc5c81-d8b2-4bd4-8c94-e68f99795965 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:05.846314 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-20cc5c81-d8b2-4bd4-8c94-e68f99795965 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:05.847927 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1371/2739] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:02:05 2022] DELETE /identity/v3/projects/abf49bbad589412aa85715efdab0a91c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:05.851726 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc5c81-d8b2-4bd4-8c94-e68f99795965 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:05.853078 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-20cc5c81-d8b2-4bd4-8c94-e68f99795965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:05.856653 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-c165c58e-2bd3-4c39-8a82-cc6a5c2d6be7 None None] MFA Rules not processed for user `5c0517330b7648faac9b15b72cbce9a1`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:05.857900 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-c165c58e-2bd3-4c39-8a82-cc6a5c2d6be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:05.875337 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:05.917070 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1369/2740] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:02:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:02:05.920706 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc5c81-d8b2-4bd4-8c94-e68f99795965 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:05.925348 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6d080-387f-4584-90b1-445700a3fd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:05.926025 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6d080-387f-4584-90b1-445700a3fd70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:05.926669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6d080-387f-4584-90b1-445700a3fd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:05.926669 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6d080-387f-4584-90b1-445700a3fd70 admin admin] PATH_INFO: `/v3/users/46d3e317c33343b9bc8f249530a259d9` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:05.928919 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6d080-387f-4584-90b1-445700a3fd70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46d3e317c33343b9bc8f249530a259d9)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:05.930919 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6d080-387f-4584-90b1-445700a3fd70 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:05.980324 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-5eb6d080-387f-4584-90b1-445700a3fd70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46d3e317c33343b9bc8f249530a259d9'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:05.987855 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-5eb6d080-387f-4584-90b1-445700a3fd70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46d3e317c33343b9bc8f249530a259d9'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:05.988570 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-5eb6d080-387f-4584-90b1-445700a3fd70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46d3e317c33343b9bc8f249530a259d9'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:05.989300 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-5eb6d080-387f-4584-90b1-445700a3fd70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46d3e317c33343b9bc8f249530a259d9'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:06.001914 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-5eb6d080-387f-4584-90b1-445700a3fd70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46d3e317c33343b9bc8f249530a259d9'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:06.015201 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1372/2741] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:02:05 2022] DELETE /identity/v3/users/46d3e317c33343b9bc8f249530a259d9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:06.162509 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165c58e-2bd3-4c39-8a82-cc6a5c2d6be7 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:06.164006 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-c165c58e-2bd3-4c39-8a82-cc6a5c2d6be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:06.179660 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:06.227069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165c58e-2bd3-4c39-8a82-cc6a5c2d6be7 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:06.283539 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3a1e4-b700-419c-a54d-184e427f0a6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:06.284304 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3a1e4-b700-419c-a54d-184e427f0a6b service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:06.284625 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3a1e4-b700-419c-a54d-184e427f0a6b service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:06.284962 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3a1e4-b700-419c-a54d-184e427f0a6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:06.287260 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-32c3a1e4-b700-419c-a54d-184e427f0a6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:06.295849 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6d080-387f-4584-90b1-445700a3fd70 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:06.297020 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-5eb6d080-387f-4584-90b1-445700a3fd70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:06.298560 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3a1e4-b700-419c-a54d-184e427f0a6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:06.300066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3a1e4-b700-419c-a54d-184e427f0a6b service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:06.316467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1370/2742] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:06.366259 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6d080-387f-4584-90b1-445700a3fd70 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:06.370934 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7060a-14d4-49a6-8247-f3f4867d3b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:06.371579 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7060a-14d4-49a6-8247-f3f4867d3b92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:06.371861 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7060a-14d4-49a6-8247-f3f4867d3b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:06.372135 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7060a-14d4-49a6-8247-f3f4867d3b92 admin admin] PATH_INFO: `/v3/projects/044b8038301447dd8d8a722edf4ee321` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:06.373288 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7060a-14d4-49a6-8247-f3f4867d3b92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=044b8038301447dd8d8a722edf4ee321)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:06.375257 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7060a-14d4-49a6-8247-f3f4867d3b92 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:06.420220 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:06.429855 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-43d7060a-14d4-49a6-8247-f3f4867d3b92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '044b8038301447dd8d8a722edf4ee321', 'request_id': 'req-43d7060a-14d4-49a6-8247-f3f4867d3b92'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:06.436631 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-43d7060a-14d4-49a6-8247-f3f4867d3b92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '044b8038301447dd8d8a722edf4ee321', 'request_id': 'req-43d7060a-14d4-49a6-8247-f3f4867d3b92'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:06.442683 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-43d7060a-14d4-49a6-8247-f3f4867d3b92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '044b8038301447dd8d8a722edf4ee321', 'request_id': 'req-43d7060a-14d4-49a6-8247-f3f4867d3b92'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:06.455528 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-43d7060a-14d4-49a6-8247-f3f4867d3b92 admin admin] The token cache is being invalidate because project 044b8038301447dd8d8a722edf4ee321 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:02:06.455817 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-43d7060a-14d4-49a6-8247-f3f4867d3b92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:06.456435 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-43d7060a-14d4-49a6-8247-f3f4867d3b92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:06.458842 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1373/2743] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:02:06 2022] DELETE /identity/v3/projects/044b8038301447dd8d8a722edf4ee321 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:06.463653 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef062c2c-5327-4e81-82d5-6c337729d5c1 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:06.464129 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef062c2c-5327-4e81-82d5-6c337729d5c1 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:06.464246 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef062c2c-5327-4e81-82d5-6c337729d5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:06.484617 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-ef062c2c-5327-4e81-82d5-6c337729d5c1 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:06.485795 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-ef062c2c-5327-4e81-82d5-6c337729d5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:06.549995 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1371/2744] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:06.558988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2fd1a-726d-4e51-b622-43c6752bb3b3 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:06.559308 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2fd1a-726d-4e51-b622-43c6752bb3b3 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:06.559595 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2fd1a-726d-4e51-b622-43c6752bb3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:06.587554 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-f0b2fd1a-726d-4e51-b622-43c6752bb3b3 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:06.589100 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-f0b2fd1a-726d-4e51-b622-43c6752bb3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:06.598915 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1374/2745] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:06.603200 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef062c2c-5327-4e81-82d5-6c337729d5c1 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:06.613335 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef062c2c-5327-4e81-82d5-6c337729d5c1 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:06.618627 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b209ebe-d2cc-4e92-93ef-8c41a0ea03e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:06.619349 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b209ebe-d2cc-4e92-93ef-8c41a0ea03e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:06.619734 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b209ebe-d2cc-4e92-93ef-8c41a0ea03e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:06.620112 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b209ebe-d2cc-4e92-93ef-8c41a0ea03e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:06.620964 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b209ebe-d2cc-4e92-93ef-8c41a0ea03e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:02:06.621337 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b209ebe-d2cc-4e92-93ef-8c41a0ea03e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:06.623062 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b209ebe-d2cc-4e92-93ef-8c41a0ea03e9 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:06.637820 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1372/2746] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 13:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:02:06.641705 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2fd1a-726d-4e51-b622-43c6752bb3b3 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:06.656886 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2fd1a-726d-4e51-b622-43c6752bb3b3 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:06.662369 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37772663-2f44-48f3-b461-092493e5da5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:06.664635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37772663-2f44-48f3-b461-092493e5da5d admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:06.664994 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37772663-2f44-48f3-b461-092493e5da5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:06.665342 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37772663-2f44-48f3-b461-092493e5da5d admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:06.666131 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37772663-2f44-48f3-b461-092493e5da5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:06.668271 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37772663-2f44-48f3-b461-092493e5da5d admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:06.706102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1375/2747] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 13:02:06 2022] POST /identity/v3/projects => generated 363 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:02:06.708332 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b209ebe-d2cc-4e92-93ef-8c41a0ea03e9 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:06.722618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b209ebe-d2cc-4e92-93ef-8c41a0ea03e9 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:06.786076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=100 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:06.797610 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5063f-0fe3-426d-ac1e-c3fda1b6bd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:06.798271 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5063f-0fe3-426d-ac1e-c3fda1b6bd15 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:06.798551 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5063f-0fe3-426d-ac1e-c3fda1b6bd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:06.798830 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5063f-0fe3-426d-ac1e-c3fda1b6bd15 admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:06.799525 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc5063f-0fe3-426d-ac1e-c3fda1b6bd15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:06.801579 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc5063f-0fe3-426d-ac1e-c3fda1b6bd15 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:06.828214 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1373/2748] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 13:02:06 2022] POST /identity/v3/users => generated 282 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:02:06.829373 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37772663-2f44-48f3-b461-092493e5da5d admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:06.840689 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37772663-2f44-48f3-b461-092493e5da5d admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:06.845958 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6ed59-c8c1-41c6-958a-efbe6f675efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:06.846579 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6ed59-c8c1-41c6-958a-efbe6f675efb admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:06.846861 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6ed59-c8c1-41c6-958a-efbe6f675efb admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:06.847371 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6ed59-c8c1-41c6-958a-efbe6f675efb admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:06.848033 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb6ed59-c8c1-41c6-958a-efbe6f675efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:06.849796 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb6ed59-c8c1-41c6-958a-efbe6f675efb admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:06.863350 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1376/2749] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:02:06.864682 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5063f-0fe3-426d-ac1e-c3fda1b6bd15 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:06.875136 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5063f-0fe3-426d-ac1e-c3fda1b6bd15 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:06.880315 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518856c-5407-4079-aa20-5b7f78b85ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:06.881010 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518856c-5407-4079-aa20-5b7f78b85ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:06.881293 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518856c-5407-4079-aa20-5b7f78b85ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:06.881613 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518856c-5407-4079-aa20-5b7f78b85ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:06.882315 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518856c-5407-4079-aa20-5b7f78b85ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:06.883911 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518856c-5407-4079-aa20-5b7f78b85ce7 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:06.899148 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1374/2750] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:02:06.900388 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6ed59-c8c1-41c6-958a-efbe6f675efb admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:06.911060 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6ed59-c8c1-41c6-958a-efbe6f675efb admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:06.915880 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1a872-2967-4a73-8071-40d103bb742c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:06.916559 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1a872-2967-4a73-8071-40d103bb742c admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:06.916846 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1a872-2967-4a73-8071-40d103bb742c admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:06.917128 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1a872-2967-4a73-8071-40d103bb742c admin admin] PATH_INFO: `/v3/projects/42df2af53bd040f390268b5507804344/users/0e4c508116ea4b2b8645f8af1519b462/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:06.933110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c1a872-2967-4a73-8071-40d103bb742c admin admin] RBAC: Authorizing `identity:create_grant(project_id=42df2af53bd040f390268b5507804344, user_id=0e4c508116ea4b2b8645f8af1519b462, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:06.935816 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c1a872-2967-4a73-8071-40d103bb742c admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:06.949397 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1377/2751] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:02:06 2022] PUT /identity/v3/projects/42df2af53bd040f390268b5507804344/users/0e4c508116ea4b2b8645f8af1519b462/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:06.960041 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947ac0c-a253-4d41-ab6c-997e5ff77c72 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:06.960328 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947ac0c-a253-4d41-ab6c-997e5ff77c72 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:06.960653 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947ac0c-a253-4d41-ab6c-997e5ff77c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:06.990467 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-b947ac0c-a253-4d41-ab6c-997e5ff77c72 None None] MFA Rules not processed for user `0e4c508116ea4b2b8645f8af1519b462`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:06.991642 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-b947ac0c-a253-4d41-ab6c-997e5ff77c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:07.060355 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1375/2752] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:02:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:07.064730 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1a872-2967-4a73-8071-40d103bb742c admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:07.131964 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1a872-2967-4a73-8071-40d103bb742c admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:07.138047 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ccde0-fabe-416c-863a-ee03b5c3f310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:07.138678 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ccde0-fabe-416c-863a-ee03b5c3f310 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:07.138961 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ccde0-fabe-416c-863a-ee03b5c3f310 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:07.139240 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ccde0-fabe-416c-863a-ee03b5c3f310 admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:07.139926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ccde0-fabe-416c-863a-ee03b5c3f310 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:07.141871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ccde0-fabe-416c-863a-ee03b5c3f310 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:07.175079 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1378/2753] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 13:02:07 2022] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:02:07.176209 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947ac0c-a253-4d41-ab6c-997e5ff77c72 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:07.187677 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947ac0c-a253-4d41-ab6c-997e5ff77c72 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:07.250306 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751eeaf-027c-4f3b-bcb9-b6ac8caca4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:07.250931 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751eeaf-027c-4f3b-bcb9-b6ac8caca4fa admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:07.251215 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751eeaf-027c-4f3b-bcb9-b6ac8caca4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:07.251494 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751eeaf-027c-4f3b-bcb9-b6ac8caca4fa admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:07.252173 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a751eeaf-027c-4f3b-bcb9-b6ac8caca4fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:07.255931 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a751eeaf-027c-4f3b-bcb9-b6ac8caca4fa admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:07.285697 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1376/2754] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 13:02:07 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:02:07.287560 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ccde0-fabe-416c-863a-ee03b5c3f310 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:07.300081 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ccde0-fabe-416c-863a-ee03b5c3f310 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:07.306404 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4125d5-c030-4dbe-bf71-c21c15ec9834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:07.307215 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4125d5-c030-4dbe-bf71-c21c15ec9834 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:07.308749 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4125d5-c030-4dbe-bf71-c21c15ec9834 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:07.309239 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4125d5-c030-4dbe-bf71-c21c15ec9834 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:07.310137 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4125d5-c030-4dbe-bf71-c21c15ec9834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:07.312990 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4125d5-c030-4dbe-bf71-c21c15ec9834 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:07.326979 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1379/2755] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:02:07.330923 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751eeaf-027c-4f3b-bcb9-b6ac8caca4fa admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:07.341337 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751eeaf-027c-4f3b-bcb9-b6ac8caca4fa admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:07.346663 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ad5e1-c8ab-44a8-9b0d-ebaf597dfea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:07.347330 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ad5e1-c8ab-44a8-9b0d-ebaf597dfea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:07.347665 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ad5e1-c8ab-44a8-9b0d-ebaf597dfea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:07.347955 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ad5e1-c8ab-44a8-9b0d-ebaf597dfea9 admin admin] PATH_INFO: `/v3/projects/e1cf3f46a96440b5992ca45cd3037101/users/311b1b9ab2984acba3f06da2da9b8f7b/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:07.366313 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ad5e1-c8ab-44a8-9b0d-ebaf597dfea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1cf3f46a96440b5992ca45cd3037101, user_id=311b1b9ab2984acba3f06da2da9b8f7b, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:07.369064 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ad5e1-c8ab-44a8-9b0d-ebaf597dfea9 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:07.384062 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1377/2756] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:02:07 2022] PUT /identity/v3/projects/e1cf3f46a96440b5992ca45cd3037101/users/311b1b9ab2984acba3f06da2da9b8f7b/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:07.388231 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4125d5-c030-4dbe-bf71-c21c15ec9834 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:07.398665 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4125d5-c030-4dbe-bf71-c21c15ec9834 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:07.440275 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:07.460852 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f34d4-422b-467c-923f-a08c5599006b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:07.461477 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f34d4-422b-467c-923f-a08c5599006b admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:07.461804 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f34d4-422b-467c-923f-a08c5599006b admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:07.462085 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f34d4-422b-467c-923f-a08c5599006b admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:07.462802 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f34d4-422b-467c-923f-a08c5599006b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:07.464429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f34d4-422b-467c-923f-a08c5599006b admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:07.475538 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1380/2757] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:02:07.479712 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ad5e1-c8ab-44a8-9b0d-ebaf597dfea9 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:07.490644 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ad5e1-c8ab-44a8-9b0d-ebaf597dfea9 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:07.495345 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5114a8-74c4-43e7-9605-9083955ed43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:07.496003 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5114a8-74c4-43e7-9605-9083955ed43d admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:07.496288 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5114a8-74c4-43e7-9605-9083955ed43d admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:07.496564 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5114a8-74c4-43e7-9605-9083955ed43d admin admin] PATH_INFO: `/v3/projects/e1cf3f46a96440b5992ca45cd3037101/users/311b1b9ab2984acba3f06da2da9b8f7b/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:07.498576 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5114a8-74c4-43e7-9605-9083955ed43d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1cf3f46a96440b5992ca45cd3037101, user_id=311b1b9ab2984acba3f06da2da9b8f7b, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:07.501234 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5114a8-74c4-43e7-9605-9083955ed43d admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:07.511760 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1378/2758] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:02:07 2022] PUT /identity/v3/projects/e1cf3f46a96440b5992ca45cd3037101/users/311b1b9ab2984acba3f06da2da9b8f7b/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:07.521925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c4fcf-5edd-4642-b2d5-c188664d9ce7 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:07.522239 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c4fcf-5edd-4642-b2d5-c188664d9ce7 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:07.522517 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c4fcf-5edd-4642-b2d5-c188664d9ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:07.551040 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-d16c4fcf-5edd-4642-b2d5-c188664d9ce7 None None] MFA Rules not processed for user `311b1b9ab2984acba3f06da2da9b8f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:07.552882 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-d16c4fcf-5edd-4642-b2d5-c188664d9ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:07.623902 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1381/2759] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:02:07 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:07.635931 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5114a8-74c4-43e7-9605-9083955ed43d admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:07.639229 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-7a5114a8-74c4-43e7-9605-9083955ed43d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:07.662783 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:07.709993 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5114a8-74c4-43e7-9605-9083955ed43d admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:07.714541 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31939289-a44a-4f48-b306-90f54ffa7355 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:07.715380 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31939289-a44a-4f48-b306-90f54ffa7355 service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:07.715731 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31939289-a44a-4f48-b306-90f54ffa7355 service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:07.716081 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31939289-a44a-4f48-b306-90f54ffa7355 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:07.728241 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31939289-a44a-4f48-b306-90f54ffa7355 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:07.730512 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31939289-a44a-4f48-b306-90f54ffa7355 service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:07.740801 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1379/2760] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:07.835526 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c4fcf-5edd-4642-b2d5-c188664d9ce7 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:07.847000 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c4fcf-5edd-4642-b2d5-c188664d9ce7 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:07.853686 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f403f9-a811-42b0-ab92-d43b8b77c990 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:07.853889 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f403f9-a811-42b0-ab92-d43b8b77c990 service cinder] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:07.854148 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f403f9-a811-42b0-ab92-d43b8b77c990 service cinder] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:07.854421 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f403f9-a811-42b0-ab92-d43b8b77c990 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:07.925795 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f403f9-a811-42b0-ab92-d43b8b77c990 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:07.927432 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f403f9-a811-42b0-ab92-d43b8b77c990 service cinder] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:07.938055 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1382/2761] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:08.330315 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31939289-a44a-4f48-b306-90f54ffa7355 service cinder] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:08.332269 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-31939289-a44a-4f48-b306-90f54ffa7355 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:08.393722 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31939289-a44a-4f48-b306-90f54ffa7355 service cinder] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:08.398358 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e306e-2878-4482-8678-b5c6fc787f67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:08.398970 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e306e-2878-4482-8678-b5c6fc787f67 service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:08.399250 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e306e-2878-4482-8678-b5c6fc787f67 service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:08.399521 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e306e-2878-4482-8678-b5c6fc787f67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:08.401436 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-459e306e-2878-4482-8678-b5c6fc787f67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:08.411070 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e306e-2878-4482-8678-b5c6fc787f67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:08.412643 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e306e-2878-4482-8678-b5c6fc787f67 service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:08.420720 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1380/2762] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:08.497052 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f403f9-a811-42b0-ab92-d43b8b77c990 service cinder] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:08.506953 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f403f9-a811-42b0-ab92-d43b8b77c990 service cinder] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:08.510791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf173a8b-2de3-4ff5-9c2d-1292ef07f2f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:08.511397 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf173a8b-2de3-4ff5-9c2d-1292ef07f2f0 service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:08.511684 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf173a8b-2de3-4ff5-9c2d-1292ef07f2f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:08.511949 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf173a8b-2de3-4ff5-9c2d-1292ef07f2f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:08.513685 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-bf173a8b-2de3-4ff5-9c2d-1292ef07f2f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:08.575149 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=100 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:08.594787 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf173a8b-2de3-4ff5-9c2d-1292ef07f2f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:08.597015 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf173a8b-2de3-4ff5-9c2d-1292ef07f2f0 service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:08.610334 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1383/2763] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:10.107458 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e306e-2878-4482-8678-b5c6fc787f67 service neutron] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:10.108956 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-459e306e-2878-4482-8678-b5c6fc787f67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:10.110442 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf173a8b-2de3-4ff5-9c2d-1292ef07f2f0 service neutron] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:10.111865 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-bf173a8b-2de3-4ff5-9c2d-1292ef07f2f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:10.120005 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e306e-2878-4482-8678-b5c6fc787f67 service neutron] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:10.123526 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf173a8b-2de3-4ff5-9c2d-1292ef07f2f0 service neutron] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:10.123681 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be605f71-f3c8-4d14-9972-bc6a99cec919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:10.124242 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be605f71-f3c8-4d14-9972-bc6a99cec919 service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:10.124515 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be605f71-f3c8-4d14-9972-bc6a99cec919 service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:10.124780 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be605f71-f3c8-4d14-9972-bc6a99cec919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:10.126535 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-be605f71-f3c8-4d14-9972-bc6a99cec919 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:10.127251 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389aa048-5168-4423-a32c-cef0731ed3f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:10.127856 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389aa048-5168-4423-a32c-cef0731ed3f3 service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:10.128134 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389aa048-5168-4423-a32c-cef0731ed3f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:10.128406 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389aa048-5168-4423-a32c-cef0731ed3f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:10.130739 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-389aa048-5168-4423-a32c-cef0731ed3f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:10.138160 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be605f71-f3c8-4d14-9972-bc6a99cec919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:10.141037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be605f71-f3c8-4d14-9972-bc6a99cec919 service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:10.141402 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389aa048-5168-4423-a32c-cef0731ed3f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:10.142843 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389aa048-5168-4423-a32c-cef0731ed3f3 service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:10.151632 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1384/2764] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:02:10.153712 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1381/2765] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:15.159642 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389aa048-5168-4423-a32c-cef0731ed3f3 service neutron] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:15.222657 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389aa048-5168-4423-a32c-cef0731ed3f3 service neutron] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:15.227503 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3144b-156e-43bc-959c-3373458302a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:15.228124 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3144b-156e-43bc-959c-3373458302a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:15.228407 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3144b-156e-43bc-959c-3373458302a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:15.228685 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3144b-156e-43bc-959c-3373458302a3 admin admin] PATH_INFO: `/v3/users/0e4c508116ea4b2b8645f8af1519b462` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:15.229898 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d3144b-156e-43bc-959c-3373458302a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e4c508116ea4b2b8645f8af1519b462)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:15.231889 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d3144b-156e-43bc-959c-3373458302a3 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:15.291399 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-30d3144b-156e-43bc-959c-3373458302a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e4c508116ea4b2b8645f8af1519b462'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:15.301014 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-30d3144b-156e-43bc-959c-3373458302a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e4c508116ea4b2b8645f8af1519b462'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:15.302389 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-30d3144b-156e-43bc-959c-3373458302a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e4c508116ea4b2b8645f8af1519b462'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:15.302993 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-30d3144b-156e-43bc-959c-3373458302a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e4c508116ea4b2b8645f8af1519b462'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:15.316390 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-30d3144b-156e-43bc-959c-3373458302a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e4c508116ea4b2b8645f8af1519b462'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:15.334057 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1385/2766] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:02:15 2022] DELETE /identity/v3/users/0e4c508116ea4b2b8645f8af1519b462 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:15.338570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba6df5-f874-4575-b9ce-59065886b924 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:15.339080 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba6df5-f874-4575-b9ce-59065886b924 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:15.339195 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba6df5-f874-4575-b9ce-59065886b924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:15.358968 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-0eba6df5-f874-4575-b9ce-59065886b924 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:15.360185 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-0eba6df5-f874-4575-b9ce-59065886b924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:15.429723 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1382/2767] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:02:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:02:15.439472 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3144b-156e-43bc-959c-3373458302a3 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:15.440951 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-30d3144b-156e-43bc-959c-3373458302a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:15.498780 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3144b-156e-43bc-959c-3373458302a3 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:15.502463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9070e-092f-4582-b5fc-473e97090967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:15.503081 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9070e-092f-4582-b5fc-473e97090967 service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:15.503360 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9070e-092f-4582-b5fc-473e97090967 service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:15.503634 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9070e-092f-4582-b5fc-473e97090967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:15.509995 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:15.514378 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9070e-092f-4582-b5fc-473e97090967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:15.515863 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9070e-092f-4582-b5fc-473e97090967 service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:15.527509 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1386/2768] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:15.802982 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba6df5-f874-4575-b9ce-59065886b924 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:15.804448 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-0eba6df5-f874-4575-b9ce-59065886b924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:15.816191 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba6df5-f874-4575-b9ce-59065886b924 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:15.822308 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ad209-125f-4d79-9fb8-6e3f48b93657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:15.822952 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ad209-125f-4d79-9fb8-6e3f48b93657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:15.823233 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ad209-125f-4d79-9fb8-6e3f48b93657 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:15.823512 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ad209-125f-4d79-9fb8-6e3f48b93657 admin admin] PATH_INFO: `/v3/projects/42df2af53bd040f390268b5507804344` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:15.825000 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ad209-125f-4d79-9fb8-6e3f48b93657 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42df2af53bd040f390268b5507804344)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:15.827145 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ad209-125f-4d79-9fb8-6e3f48b93657 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:15.879829 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:15.882999 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-c15ad209-125f-4d79-9fb8-6e3f48b93657 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42df2af53bd040f390268b5507804344', 'request_id': 'req-c15ad209-125f-4d79-9fb8-6e3f48b93657'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:15.889578 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-c15ad209-125f-4d79-9fb8-6e3f48b93657 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42df2af53bd040f390268b5507804344', 'request_id': 'req-c15ad209-125f-4d79-9fb8-6e3f48b93657'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:15.897521 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-c15ad209-125f-4d79-9fb8-6e3f48b93657 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42df2af53bd040f390268b5507804344', 'request_id': 'req-c15ad209-125f-4d79-9fb8-6e3f48b93657'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:15.907854 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-c15ad209-125f-4d79-9fb8-6e3f48b93657 admin admin] The token cache is being invalidate because project 42df2af53bd040f390268b5507804344 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:02:15.908139 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-c15ad209-125f-4d79-9fb8-6e3f48b93657 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:15.908754 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-c15ad209-125f-4d79-9fb8-6e3f48b93657 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:15.910290 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1383/2769] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:02:15 2022] DELETE /identity/v3/projects/42df2af53bd040f390268b5507804344 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:15.914383 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9070e-092f-4582-b5fc-473e97090967 service neutron] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:15.923915 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9070e-092f-4582-b5fc-473e97090967 service neutron] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:15.979495 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e7c75-4407-4862-9180-94a84d4b3a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:15.980127 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e7c75-4407-4862-9180-94a84d4b3a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:15.980410 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e7c75-4407-4862-9180-94a84d4b3a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:15.980691 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e7c75-4407-4862-9180-94a84d4b3a66 admin admin] PATH_INFO: `/v3/users/311b1b9ab2984acba3f06da2da9b8f7b` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:15.981869 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e7c75-4407-4862-9180-94a84d4b3a66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=311b1b9ab2984acba3f06da2da9b8f7b)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:15.983780 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e7c75-4407-4862-9180-94a84d4b3a66 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:16.030396 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-dc9e7c75-4407-4862-9180-94a84d4b3a66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '311b1b9ab2984acba3f06da2da9b8f7b'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:16.037481 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-dc9e7c75-4407-4862-9180-94a84d4b3a66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '311b1b9ab2984acba3f06da2da9b8f7b'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:16.038162 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-dc9e7c75-4407-4862-9180-94a84d4b3a66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '311b1b9ab2984acba3f06da2da9b8f7b'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:16.038791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-dc9e7c75-4407-4862-9180-94a84d4b3a66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '311b1b9ab2984acba3f06da2da9b8f7b'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:16.052468 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-dc9e7c75-4407-4862-9180-94a84d4b3a66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '311b1b9ab2984acba3f06da2da9b8f7b'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:16.069862 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1387/2770] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:02:15 2022] DELETE /identity/v3/users/311b1b9ab2984acba3f06da2da9b8f7b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:16.346819 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ad209-125f-4d79-9fb8-6e3f48b93657 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:16.348990 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-c15ad209-125f-4d79-9fb8-6e3f48b93657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:16.364316 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ad209-125f-4d79-9fb8-6e3f48b93657 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:16.422927 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5f2a1-cdd1-4c90-a6b9-fe0f506f5b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:16.423776 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5f2a1-cdd1-4c90-a6b9-fe0f506f5b36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:16.424127 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5f2a1-cdd1-4c90-a6b9-fe0f506f5b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:16.424475 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5f2a1-cdd1-4c90-a6b9-fe0f506f5b36 admin admin] PATH_INFO: `/v3/projects/e1cf3f46a96440b5992ca45cd3037101` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:16.425811 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5f2a1-cdd1-4c90-a6b9-fe0f506f5b36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1cf3f46a96440b5992ca45cd3037101)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:16.428764 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5f2a1-cdd1-4c90-a6b9-fe0f506f5b36 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:16.485400 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-2fe5f2a1-cdd1-4c90-a6b9-fe0f506f5b36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1cf3f46a96440b5992ca45cd3037101', 'request_id': 'req-2fe5f2a1-cdd1-4c90-a6b9-fe0f506f5b36'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:16.492517 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-2fe5f2a1-cdd1-4c90-a6b9-fe0f506f5b36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1cf3f46a96440b5992ca45cd3037101', 'request_id': 'req-2fe5f2a1-cdd1-4c90-a6b9-fe0f506f5b36'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:16.503745 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-2fe5f2a1-cdd1-4c90-a6b9-fe0f506f5b36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1cf3f46a96440b5992ca45cd3037101', 'request_id': 'req-2fe5f2a1-cdd1-4c90-a6b9-fe0f506f5b36'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:16.515406 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-2fe5f2a1-cdd1-4c90-a6b9-fe0f506f5b36 admin admin] The token cache is being invalidate because project e1cf3f46a96440b5992ca45cd3037101 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:02:16.515696 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-2fe5f2a1-cdd1-4c90-a6b9-fe0f506f5b36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:16.516373 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-2fe5f2a1-cdd1-4c90-a6b9-fe0f506f5b36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:16.518030 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1384/2771] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:02:16 2022] DELETE /identity/v3/projects/e1cf3f46a96440b5992ca45cd3037101 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:16.522904 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14cc0e-32f5-4aaf-ae75-f5b932869265 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:16.523374 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14cc0e-32f5-4aaf-ae75-f5b932869265 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:16.523489 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14cc0e-32f5-4aaf-ae75-f5b932869265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:16.546346 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-dd14cc0e-32f5-4aaf-ae75-f5b932869265 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:16.547604 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-dd14cc0e-32f5-4aaf-ae75-f5b932869265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:16.612655 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1388/2772] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:02:16.621120 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1bb4c-6bfb-4a27-93a8-9af751285a76 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:16.621415 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1bb4c-6bfb-4a27-93a8-9af751285a76 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:16.621725 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1bb4c-6bfb-4a27-93a8-9af751285a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:16.642429 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-e1e1bb4c-6bfb-4a27-93a8-9af751285a76 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:16.643650 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-e1e1bb4c-6bfb-4a27-93a8-9af751285a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:16.652520 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1385/2773] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:16.656909 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14cc0e-32f5-4aaf-ae75-f5b932869265 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:16.667349 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14cc0e-32f5-4aaf-ae75-f5b932869265 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:16.672062 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63669f4-cfe0-4942-a4c9-5b1d4ef07611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:16.672834 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63669f4-cfe0-4942-a4c9-5b1d4ef07611 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:16.673242 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63669f4-cfe0-4942-a4c9-5b1d4ef07611 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:16.673624 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63669f4-cfe0-4942-a4c9-5b1d4ef07611 admin admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:16.674532 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63669f4-cfe0-4942-a4c9-5b1d4ef07611 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:02:16.674908 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63669f4-cfe0-4942-a4c9-5b1d4ef07611 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:16.677212 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63669f4-cfe0-4942-a4c9-5b1d4ef07611 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:16.686303 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:16.690612 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1389/2774] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 13:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:02:16.695537 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1bb4c-6bfb-4a27-93a8-9af751285a76 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:16.705444 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1bb4c-6bfb-4a27-93a8-9af751285a76 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:16.710565 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2965b-66df-4eae-84fe-6f180587a09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:16.711184 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2965b-66df-4eae-84fe-6f180587a09a admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:16.711461 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2965b-66df-4eae-84fe-6f180587a09a admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:16.711732 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2965b-66df-4eae-84fe-6f180587a09a admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:16.712406 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2965b-66df-4eae-84fe-6f180587a09a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:16.714394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2965b-66df-4eae-84fe-6f180587a09a admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:16.747538 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1386/2775] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 13:02:16 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:02:16.751254 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63669f4-cfe0-4942-a4c9-5b1d4ef07611 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:16.765551 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63669f4-cfe0-4942-a4c9-5b1d4ef07611 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:16.829846 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224aff10-41d8-470b-bab8-193a91d8281f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:16.830593 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224aff10-41d8-470b-bab8-193a91d8281f admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:16.830933 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224aff10-41d8-470b-bab8-193a91d8281f admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:16.831297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224aff10-41d8-470b-bab8-193a91d8281f admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:16.831970 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224aff10-41d8-470b-bab8-193a91d8281f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:16.834457 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224aff10-41d8-470b-bab8-193a91d8281f admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:16.859598 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1390/2776] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 13:02:16 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:02:16.863748 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2965b-66df-4eae-84fe-6f180587a09a admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:16.874230 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2965b-66df-4eae-84fe-6f180587a09a admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:16.879507 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d487226-7f98-4e90-8347-1132fbf663b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:16.880112 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d487226-7f98-4e90-8347-1132fbf663b6 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:16.880392 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d487226-7f98-4e90-8347-1132fbf663b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:16.880672 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d487226-7f98-4e90-8347-1132fbf663b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:16.881377 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d487226-7f98-4e90-8347-1132fbf663b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:16.883140 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d487226-7f98-4e90-8347-1132fbf663b6 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:16.895864 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1387/2777] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:02:16.901801 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224aff10-41d8-470b-bab8-193a91d8281f admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:16.914437 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224aff10-41d8-470b-bab8-193a91d8281f admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:16.919178 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8b484-0b5b-4071-8b09-3d9cb55b4cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:16.919817 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8b484-0b5b-4071-8b09-3d9cb55b4cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:16.920095 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8b484-0b5b-4071-8b09-3d9cb55b4cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:16.920365 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8b484-0b5b-4071-8b09-3d9cb55b4cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:16.921124 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c8b484-0b5b-4071-8b09-3d9cb55b4cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:16.923305 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c8b484-0b5b-4071-8b09-3d9cb55b4cd0 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:16.941710 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1391/2778] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:02:16.943107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d487226-7f98-4e90-8347-1132fbf663b6 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:16.953939 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d487226-7f98-4e90-8347-1132fbf663b6 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:16.959953 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ff4f2-ba14-4fc9-ade1-78accd465b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:16.960623 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ff4f2-ba14-4fc9-ade1-78accd465b91 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:16.960908 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ff4f2-ba14-4fc9-ade1-78accd465b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:16.961186 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ff4f2-ba14-4fc9-ade1-78accd465b91 admin admin] PATH_INFO: `/v3/projects/a1a0afd2289e4750b2826207c5de4e60/users/a6029cebe2a94f579ec552f87776e746/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:16.976707 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5ff4f2-ba14-4fc9-ade1-78accd465b91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1a0afd2289e4750b2826207c5de4e60, user_id=a6029cebe2a94f579ec552f87776e746, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:16.979380 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5ff4f2-ba14-4fc9-ade1-78accd465b91 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:16.987729 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:16.993183 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1388/2779] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:02:16 2022] PUT /identity/v3/projects/a1a0afd2289e4750b2826207c5de4e60/users/a6029cebe2a94f579ec552f87776e746/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:17.003364 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8401e24-6460-495e-beaa-a34b091d82ac None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:17.003726 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8401e24-6460-495e-beaa-a34b091d82ac None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:17.004007 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8401e24-6460-495e-beaa-a34b091d82ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:17.033292 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-b8401e24-6460-495e-beaa-a34b091d82ac None None] MFA Rules not processed for user `a6029cebe2a94f579ec552f87776e746`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:17.034546 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-b8401e24-6460-495e-beaa-a34b091d82ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:17.106915 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1392/2780] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:02:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:17.111307 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ff4f2-ba14-4fc9-ade1-78accd465b91 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:17.171942 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ff4f2-ba14-4fc9-ade1-78accd465b91 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:17.176618 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d51da2-fc9e-4c24-8635-dc075d007a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:17.177218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d51da2-fc9e-4c24-8635-dc075d007a9c admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:17.177517 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d51da2-fc9e-4c24-8635-dc075d007a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:17.177802 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d51da2-fc9e-4c24-8635-dc075d007a9c admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:17.178452 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d51da2-fc9e-4c24-8635-dc075d007a9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:17.180472 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d51da2-fc9e-4c24-8635-dc075d007a9c admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:17.207926 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1389/2781] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 13:02:17 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:02:17.211989 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8401e24-6460-495e-beaa-a34b091d82ac None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:17.222566 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8401e24-6460-495e-beaa-a34b091d82ac None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:17.278829 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28e859-36e4-434f-92d4-5f6441e42ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:17.279487 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28e859-36e4-434f-92d4-5f6441e42ab3 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:17.279797 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28e859-36e4-434f-92d4-5f6441e42ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:17.280073 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28e859-36e4-434f-92d4-5f6441e42ab3 admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:17.280785 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28e859-36e4-434f-92d4-5f6441e42ab3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:17.282840 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28e859-36e4-434f-92d4-5f6441e42ab3 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:17.298337 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:17.305530 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1393/2782] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 13:02:17 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:02:17.309331 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d51da2-fc9e-4c24-8635-dc075d007a9c admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:17.320493 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d51da2-fc9e-4c24-8635-dc075d007a9c admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:17.325132 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1d31f-6880-4532-abd1-6e38cb0939d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:17.325772 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1d31f-6880-4532-abd1-6e38cb0939d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:17.326054 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1d31f-6880-4532-abd1-6e38cb0939d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:17.326360 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1d31f-6880-4532-abd1-6e38cb0939d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:17.327052 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1d31f-6880-4532-abd1-6e38cb0939d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:17.328635 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1d31f-6880-4532-abd1-6e38cb0939d1 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:17.340550 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1390/2783] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:02:17.344707 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28e859-36e4-434f-92d4-5f6441e42ab3 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:17.355402 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28e859-36e4-434f-92d4-5f6441e42ab3 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:17.360274 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e6d81-172c-48a1-986d-9bae52d4476a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:17.360873 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e6d81-172c-48a1-986d-9bae52d4476a admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:17.361156 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e6d81-172c-48a1-986d-9bae52d4476a admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:17.361436 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e6d81-172c-48a1-986d-9bae52d4476a admin admin] PATH_INFO: `/v3/projects/4cb030cb455645dc982e75196c562abf/users/2302f02be17e4715968f0ad7e47f255b/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:17.376558 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e6d81-172c-48a1-986d-9bae52d4476a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cb030cb455645dc982e75196c562abf, user_id=2302f02be17e4715968f0ad7e47f255b, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:17.379842 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e6d81-172c-48a1-986d-9bae52d4476a admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:17.392956 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1394/2784] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:02:17 2022] PUT /identity/v3/projects/4cb030cb455645dc982e75196c562abf/users/2302f02be17e4715968f0ad7e47f255b/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:17.397777 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1d31f-6880-4532-abd1-6e38cb0939d1 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:17.407615 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1d31f-6880-4532-abd1-6e38cb0939d1 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:17.463794 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84646c-e00a-433b-a0c9-5b21fa4b351d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:17.464404 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84646c-e00a-433b-a0c9-5b21fa4b351d admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:17.464688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84646c-e00a-433b-a0c9-5b21fa4b351d admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:17.464963 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84646c-e00a-433b-a0c9-5b21fa4b351d admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:17.465684 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84646c-e00a-433b-a0c9-5b21fa4b351d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:17.467274 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84646c-e00a-433b-a0c9-5b21fa4b351d admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:17.477049 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1391/2785] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:02:17.481308 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e6d81-172c-48a1-986d-9bae52d4476a admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:17.492488 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e6d81-172c-48a1-986d-9bae52d4476a admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:17.497078 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5d144-50d0-447d-94bf-7914e1b94ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:17.497767 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5d144-50d0-447d-94bf-7914e1b94ff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:17.498046 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5d144-50d0-447d-94bf-7914e1b94ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:17.498316 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5d144-50d0-447d-94bf-7914e1b94ff1 admin admin] PATH_INFO: `/v3/projects/4cb030cb455645dc982e75196c562abf/users/2302f02be17e4715968f0ad7e47f255b/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:17.500256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c5d144-50d0-447d-94bf-7914e1b94ff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cb030cb455645dc982e75196c562abf, user_id=2302f02be17e4715968f0ad7e47f255b, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:17.502939 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c5d144-50d0-447d-94bf-7914e1b94ff1 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:17.514042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1395/2786] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:02:17 2022] PUT /identity/v3/projects/4cb030cb455645dc982e75196c562abf/users/2302f02be17e4715968f0ad7e47f255b/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:02:17.587387 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c401e83-aac3-4ff1-9e54-d660df671747 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:17.587800 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c401e83-aac3-4ff1-9e54-d660df671747 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:17.588347 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c401e83-aac3-4ff1-9e54-d660df671747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:17.616914 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-5c401e83-aac3-4ff1-9e54-d660df671747 None None] MFA Rules not processed for user `2302f02be17e4715968f0ad7e47f255b`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:17.618117 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-5c401e83-aac3-4ff1-9e54-d660df671747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:17.682965 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:17.696319 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1392/2787] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:02:17 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:17.707514 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5d144-50d0-447d-94bf-7914e1b94ff1 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:17.709142 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-15c5d144-50d0-447d-94bf-7914e1b94ff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:17.770719 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5d144-50d0-447d-94bf-7914e1b94ff1 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:17.774803 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf16807-ddb5-4a27-9d48-8783e285372c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:17.775483 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf16807-ddb5-4a27-9d48-8783e285372c service cinder] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:17.775765 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf16807-ddb5-4a27-9d48-8783e285372c service cinder] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:17.776040 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf16807-ddb5-4a27-9d48-8783e285372c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:17.785187 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf16807-ddb5-4a27-9d48-8783e285372c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:17.787462 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf16807-ddb5-4a27-9d48-8783e285372c service cinder] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:17.797140 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1396/2788] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:17 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:18.174972 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c401e83-aac3-4ff1-9e54-d660df671747 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:18.236195 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c401e83-aac3-4ff1-9e54-d660df671747 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:18.241142 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3677d1-1229-4711-a17a-cf3f722b83ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:18.241809 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3677d1-1229-4711-a17a-cf3f722b83ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:18.242093 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3677d1-1229-4711-a17a-cf3f722b83ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:18.242367 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3677d1-1229-4711-a17a-cf3f722b83ad admin admin] PATH_INFO: `/v3/users/a6029cebe2a94f579ec552f87776e746` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:18.244206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3677d1-1229-4711-a17a-cf3f722b83ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6029cebe2a94f579ec552f87776e746)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:18.246508 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3677d1-1229-4711-a17a-cf3f722b83ad admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:18.297001 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-cd3677d1-1229-4711-a17a-cf3f722b83ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6029cebe2a94f579ec552f87776e746'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:18.297685 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-cd3677d1-1229-4711-a17a-cf3f722b83ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6029cebe2a94f579ec552f87776e746'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:18.298291 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-cd3677d1-1229-4711-a17a-cf3f722b83ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6029cebe2a94f579ec552f87776e746'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:18.310831 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-cd3677d1-1229-4711-a17a-cf3f722b83ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6029cebe2a94f579ec552f87776e746'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:18.317450 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-cd3677d1-1229-4711-a17a-cf3f722b83ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6029cebe2a94f579ec552f87776e746'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:18.330234 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1393/2789] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:02:18 2022] DELETE /identity/v3/users/a6029cebe2a94f579ec552f87776e746 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:18.335250 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d692a-b521-4e92-be25-08dc8ede39bb None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:18.335538 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d692a-b521-4e92-be25-08dc8ede39bb None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:18.335830 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d692a-b521-4e92-be25-08dc8ede39bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:18.354691 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-229d692a-b521-4e92-be25-08dc8ede39bb None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:18.355886 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-229d692a-b521-4e92-be25-08dc8ede39bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:18.413561 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1397/2790] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:18.422964 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3677d1-1229-4711-a17a-cf3f722b83ad admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:18.424400 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-cd3677d1-1229-4711-a17a-cf3f722b83ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:18.481250 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3677d1-1229-4711-a17a-cf3f722b83ad admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:18.484876 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbd175-dc6e-49df-98da-a96d8f9338af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:18.485484 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbd175-dc6e-49df-98da-a96d8f9338af service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:18.485792 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbd175-dc6e-49df-98da-a96d8f9338af service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:18.486066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbd175-dc6e-49df-98da-a96d8f9338af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:18.495593 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedbd175-dc6e-49df-98da-a96d8f9338af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:18.497249 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedbd175-dc6e-49df-98da-a96d8f9338af service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:18.507287 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1394/2791] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:18.781086 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d692a-b521-4e92-be25-08dc8ede39bb None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:18.782674 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-229d692a-b521-4e92-be25-08dc8ede39bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:18.795682 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d692a-b521-4e92-be25-08dc8ede39bb None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:18.800369 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43aec0f-21fd-4723-a590-b6f552159f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:18.801199 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43aec0f-21fd-4723-a590-b6f552159f97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:18.801664 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43aec0f-21fd-4723-a590-b6f552159f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:18.802032 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43aec0f-21fd-4723-a590-b6f552159f97 admin admin] PATH_INFO: `/v3/projects/a1a0afd2289e4750b2826207c5de4e60` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:18.803256 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43aec0f-21fd-4723-a590-b6f552159f97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1a0afd2289e4750b2826207c5de4e60)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:18.805285 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43aec0f-21fd-4723-a590-b6f552159f97 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:18.875411 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a43aec0f-21fd-4723-a590-b6f552159f97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1a0afd2289e4750b2826207c5de4e60', 'request_id': 'req-a43aec0f-21fd-4723-a590-b6f552159f97'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:18.882936 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a43aec0f-21fd-4723-a590-b6f552159f97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1a0afd2289e4750b2826207c5de4e60', 'request_id': 'req-a43aec0f-21fd-4723-a590-b6f552159f97'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:18.887820 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:18.893854 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a43aec0f-21fd-4723-a590-b6f552159f97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1a0afd2289e4750b2826207c5de4e60', 'request_id': 'req-a43aec0f-21fd-4723-a590-b6f552159f97'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:18.909272 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a43aec0f-21fd-4723-a590-b6f552159f97 admin admin] The token cache is being invalidate because project a1a0afd2289e4750b2826207c5de4e60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:02:18.909673 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a43aec0f-21fd-4723-a590-b6f552159f97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:18.911631 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-a43aec0f-21fd-4723-a590-b6f552159f97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:18.915534 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1398/2792] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:02:18 2022] DELETE /identity/v3/projects/a1a0afd2289e4750b2826207c5de4e60 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:18.920233 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbd175-dc6e-49df-98da-a96d8f9338af service neutron] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:18.933007 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbd175-dc6e-49df-98da-a96d8f9338af service neutron] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:18.948821 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:19.002183 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594fde36-6135-4653-a450-9f1acf0f7949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:19.002965 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fde36-6135-4653-a450-9f1acf0f7949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:19.003266 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fde36-6135-4653-a450-9f1acf0f7949 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:19.003769 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fde36-6135-4653-a450-9f1acf0f7949 admin admin] PATH_INFO: `/v3/users/2302f02be17e4715968f0ad7e47f255b` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:19.005664 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594fde36-6135-4653-a450-9f1acf0f7949 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2302f02be17e4715968f0ad7e47f255b)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:19.007526 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594fde36-6135-4653-a450-9f1acf0f7949 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:19.060487 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-594fde36-6135-4653-a450-9f1acf0f7949 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2302f02be17e4715968f0ad7e47f255b'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:19.061132 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-594fde36-6135-4653-a450-9f1acf0f7949 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2302f02be17e4715968f0ad7e47f255b'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:19.061752 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-594fde36-6135-4653-a450-9f1acf0f7949 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2302f02be17e4715968f0ad7e47f255b'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:19.074909 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-594fde36-6135-4653-a450-9f1acf0f7949 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2302f02be17e4715968f0ad7e47f255b'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:19.082305 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-594fde36-6135-4653-a450-9f1acf0f7949 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2302f02be17e4715968f0ad7e47f255b'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:19.096514 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1395/2793] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:02:18 2022] DELETE /identity/v3/users/2302f02be17e4715968f0ad7e47f255b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:19.393957 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43aec0f-21fd-4723-a590-b6f552159f97 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:19.395710 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-a43aec0f-21fd-4723-a590-b6f552159f97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:19.410237 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43aec0f-21fd-4723-a590-b6f552159f97 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:19.478483 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be44db3-bacb-41ee-9066-a3375f794641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:19.479077 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be44db3-bacb-41ee-9066-a3375f794641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:19.479398 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be44db3-bacb-41ee-9066-a3375f794641 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:19.479676 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be44db3-bacb-41ee-9066-a3375f794641 admin admin] PATH_INFO: `/v3/projects/4cb030cb455645dc982e75196c562abf` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:19.480852 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be44db3-bacb-41ee-9066-a3375f794641 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cb030cb455645dc982e75196c562abf)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:19.482858 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be44db3-bacb-41ee-9066-a3375f794641 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:19.537898 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-5be44db3-bacb-41ee-9066-a3375f794641 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cb030cb455645dc982e75196c562abf', 'request_id': 'req-5be44db3-bacb-41ee-9066-a3375f794641'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:19.544542 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-5be44db3-bacb-41ee-9066-a3375f794641 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cb030cb455645dc982e75196c562abf', 'request_id': 'req-5be44db3-bacb-41ee-9066-a3375f794641'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:19.550305 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-5be44db3-bacb-41ee-9066-a3375f794641 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cb030cb455645dc982e75196c562abf', 'request_id': 'req-5be44db3-bacb-41ee-9066-a3375f794641'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:19.564104 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-5be44db3-bacb-41ee-9066-a3375f794641 admin admin] The token cache is being invalidate because project 4cb030cb455645dc982e75196c562abf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:02:19.564392 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-5be44db3-bacb-41ee-9066-a3375f794641 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:19.565123 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-5be44db3-bacb-41ee-9066-a3375f794641 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:19.566743 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1399/2794] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:02:19 2022] DELETE /identity/v3/projects/4cb030cb455645dc982e75196c562abf => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:19.571821 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bd09e-b2ed-4526-bd5e-d4fec71a523b None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:19.572331 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bd09e-b2ed-4526-bd5e-d4fec71a523b None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:19.572604 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bd09e-b2ed-4526-bd5e-d4fec71a523b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:19.592642 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-b26bd09e-b2ed-4526-bd5e-d4fec71a523b None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:19.593904 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-b26bd09e-b2ed-4526-bd5e-d4fec71a523b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:19.654177 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1396/2795] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:19.662654 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fcd79-e7a9-4f72-b39c-d15a2980f6b9 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:19.662939 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fcd79-e7a9-4f72-b39c-d15a2980f6b9 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:19.663213 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fcd79-e7a9-4f72-b39c-d15a2980f6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:19.683661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-bb6fcd79-e7a9-4f72-b39c-d15a2980f6b9 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:19.684859 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-bb6fcd79-e7a9-4f72-b39c-d15a2980f6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:19.692910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1400/2796] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:02:19.697095 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26bd09e-b2ed-4526-bd5e-d4fec71a523b None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:19.706808 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26bd09e-b2ed-4526-bd5e-d4fec71a523b None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:19.712128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a9901-bbfd-4a45-89d0-d807743c1b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:19.712741 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a9901-bbfd-4a45-89d0-d807743c1b69 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:19.713025 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a9901-bbfd-4a45-89d0-d807743c1b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:19.713299 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a9901-bbfd-4a45-89d0-d807743c1b69 admin admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:19.714079 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a9901-bbfd-4a45-89d0-d807743c1b69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:02:19.714329 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a9901-bbfd-4a45-89d0-d807743c1b69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:19.715920 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a9901-bbfd-4a45-89d0-d807743c1b69 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:19.728260 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1397/2797] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 13:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:02:19.732577 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6fcd79-e7a9-4f72-b39c-d15a2980f6b9 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:19.742221 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6fcd79-e7a9-4f72-b39c-d15a2980f6b9 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:19.746942 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cdb1fa-b132-407c-ad7b-b50076fb1119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:19.747546 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cdb1fa-b132-407c-ad7b-b50076fb1119 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:19.747826 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cdb1fa-b132-407c-ad7b-b50076fb1119 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:19.748102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cdb1fa-b132-407c-ad7b-b50076fb1119 admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:19.748769 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cdb1fa-b132-407c-ad7b-b50076fb1119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:19.750715 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cdb1fa-b132-407c-ad7b-b50076fb1119 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:19.778484 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1401/2798] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 13:02:19 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:02:19.782521 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a9901-bbfd-4a45-89d0-d807743c1b69 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:19.793515 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a9901-bbfd-4a45-89d0-d807743c1b69 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:19.815666 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:19.852659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a17d14-5443-4c2f-811b-af3e93e32ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:19.853268 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a17d14-5443-4c2f-811b-af3e93e32ffd admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:19.853579 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a17d14-5443-4c2f-811b-af3e93e32ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:19.853855 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a17d14-5443-4c2f-811b-af3e93e32ffd admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:19.854515 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a17d14-5443-4c2f-811b-af3e93e32ffd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:19.856431 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a17d14-5443-4c2f-811b-af3e93e32ffd admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:19.876195 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1398/2799] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 13:02:19 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:02:19.880355 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cdb1fa-b132-407c-ad7b-b50076fb1119 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:19.891272 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cdb1fa-b132-407c-ad7b-b50076fb1119 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:19.896778 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b964ea3-953a-4b72-9d26-2d820427ff14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:19.897389 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b964ea3-953a-4b72-9d26-2d820427ff14 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:19.897742 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b964ea3-953a-4b72-9d26-2d820427ff14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:19.898007 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b964ea3-953a-4b72-9d26-2d820427ff14 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:19.898704 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b964ea3-953a-4b72-9d26-2d820427ff14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:19.900297 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b964ea3-953a-4b72-9d26-2d820427ff14 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:19.910496 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1402/2800] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:02:19.915097 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a17d14-5443-4c2f-811b-af3e93e32ffd admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:19.924909 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a17d14-5443-4c2f-811b-af3e93e32ffd admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:19.930334 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661c660-23cd-438e-bc4e-8eb880f21845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:19.930949 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661c660-23cd-438e-bc4e-8eb880f21845 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:19.931232 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661c660-23cd-438e-bc4e-8eb880f21845 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:19.931508 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661c660-23cd-438e-bc4e-8eb880f21845 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:19.932268 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6661c660-23cd-438e-bc4e-8eb880f21845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:19.933905 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6661c660-23cd-438e-bc4e-8eb880f21845 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:19.947816 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1399/2801] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:02:19.952052 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b964ea3-953a-4b72-9d26-2d820427ff14 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:19.963455 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b964ea3-953a-4b72-9d26-2d820427ff14 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:19.968050 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970c418-76ff-4545-a91f-953272cdfbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:19.968709 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970c418-76ff-4545-a91f-953272cdfbb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:19.968988 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970c418-76ff-4545-a91f-953272cdfbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:19.969259 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970c418-76ff-4545-a91f-953272cdfbb2 admin admin] PATH_INFO: `/v3/projects/d5612f450e954a2dac5bc777eb21638a/users/57c3c82f7e454fd68f2f6531ea80add6/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:19.984582 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970c418-76ff-4545-a91f-953272cdfbb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5612f450e954a2dac5bc777eb21638a, user_id=57c3c82f7e454fd68f2f6531ea80add6, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:19.987176 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970c418-76ff-4545-a91f-953272cdfbb2 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:20.000220 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1403/2802] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:02:19 2022] PUT /identity/v3/projects/d5612f450e954a2dac5bc777eb21638a/users/57c3c82f7e454fd68f2f6531ea80add6/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:02:20.011282 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650944b-2876-453c-8f0c-1ce1891c3386 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:20.011564 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650944b-2876-453c-8f0c-1ce1891c3386 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:20.011831 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650944b-2876-453c-8f0c-1ce1891c3386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:20.041829 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-7650944b-2876-453c-8f0c-1ce1891c3386 None None] MFA Rules not processed for user `57c3c82f7e454fd68f2f6531ea80add6`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:20.043035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-7650944b-2876-453c-8f0c-1ce1891c3386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:20.108122 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1400/2803] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:02:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:20.112575 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970c418-76ff-4545-a91f-953272cdfbb2 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:20.125910 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:20.179924 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970c418-76ff-4545-a91f-953272cdfbb2 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:20.184873 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba73c7-336d-4663-90c0-0c76fd62aebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:20.185509 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba73c7-336d-4663-90c0-0c76fd62aebc admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:20.185825 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba73c7-336d-4663-90c0-0c76fd62aebc admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:20.186150 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba73c7-336d-4663-90c0-0c76fd62aebc admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:20.186823 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba73c7-336d-4663-90c0-0c76fd62aebc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:20.188719 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba73c7-336d-4663-90c0-0c76fd62aebc admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:20.218031 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1404/2804] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 13:02:20 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:02:20.221883 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650944b-2876-453c-8f0c-1ce1891c3386 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:20.232441 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650944b-2876-453c-8f0c-1ce1891c3386 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:20.294402 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea602911-9657-4a91-b3fe-f9def719eb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:20.294911 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea602911-9657-4a91-b3fe-f9def719eb3a admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:20.295196 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea602911-9657-4a91-b3fe-f9def719eb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:20.295471 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea602911-9657-4a91-b3fe-f9def719eb3a admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:20.296147 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea602911-9657-4a91-b3fe-f9def719eb3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:20.298091 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea602911-9657-4a91-b3fe-f9def719eb3a admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:20.321846 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1401/2805] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 13:02:20 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:02:20.325876 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba73c7-336d-4663-90c0-0c76fd62aebc admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:20.337611 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba73c7-336d-4663-90c0-0c76fd62aebc admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:20.342463 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caba1d3-f57b-45f8-95b7-bdd3d006c476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:20.343098 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caba1d3-f57b-45f8-95b7-bdd3d006c476 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:20.343376 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caba1d3-f57b-45f8-95b7-bdd3d006c476 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:20.343650 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caba1d3-f57b-45f8-95b7-bdd3d006c476 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:20.344344 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caba1d3-f57b-45f8-95b7-bdd3d006c476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:20.346000 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caba1d3-f57b-45f8-95b7-bdd3d006c476 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:20.361352 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1405/2806] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:02:20.362432 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea602911-9657-4a91-b3fe-f9def719eb3a admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:20.373232 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea602911-9657-4a91-b3fe-f9def719eb3a admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:20.378245 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee675bb-cc62-4601-ab43-aad41b50c85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:20.378902 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee675bb-cc62-4601-ab43-aad41b50c85f admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:20.379270 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee675bb-cc62-4601-ab43-aad41b50c85f admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:20.379807 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee675bb-cc62-4601-ab43-aad41b50c85f admin admin] PATH_INFO: `/v3/projects/d456499d358246fbb4c5c262df0c2167/users/2866c68f50b64dd18cdc6a682cdc6eb8/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:20.395582 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee675bb-cc62-4601-ab43-aad41b50c85f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d456499d358246fbb4c5c262df0c2167, user_id=2866c68f50b64dd18cdc6a682cdc6eb8, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:20.398251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee675bb-cc62-4601-ab43-aad41b50c85f admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:20.406962 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:20.413765 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1402/2807] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:02:20 2022] PUT /identity/v3/projects/d456499d358246fbb4c5c262df0c2167/users/2866c68f50b64dd18cdc6a682cdc6eb8/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:02:20.417868 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caba1d3-f57b-45f8-95b7-bdd3d006c476 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:20.430142 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caba1d3-f57b-45f8-95b7-bdd3d006c476 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:20.490501 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4e107-2c3f-4002-acbc-d2a9f962fe0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:20.491138 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4e107-2c3f-4002-acbc-d2a9f962fe0b admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:20.491427 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4e107-2c3f-4002-acbc-d2a9f962fe0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:20.491833 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4e107-2c3f-4002-acbc-d2a9f962fe0b admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:20.492435 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4e107-2c3f-4002-acbc-d2a9f962fe0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:20.494298 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4e107-2c3f-4002-acbc-d2a9f962fe0b admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:20.509464 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1406/2808] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:02:20.510802 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee675bb-cc62-4601-ab43-aad41b50c85f admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:20.521711 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee675bb-cc62-4601-ab43-aad41b50c85f admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:20.526343 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe2bdd-c1ad-42d9-ad7c-a802cc89eb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:20.526993 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe2bdd-c1ad-42d9-ad7c-a802cc89eb3a admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:20.527267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe2bdd-c1ad-42d9-ad7c-a802cc89eb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:20.527538 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe2bdd-c1ad-42d9-ad7c-a802cc89eb3a admin admin] PATH_INFO: `/v3/projects/d456499d358246fbb4c5c262df0c2167/users/2866c68f50b64dd18cdc6a682cdc6eb8/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:20.529451 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe2bdd-c1ad-42d9-ad7c-a802cc89eb3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d456499d358246fbb4c5c262df0c2167, user_id=2866c68f50b64dd18cdc6a682cdc6eb8, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:20.532347 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe2bdd-c1ad-42d9-ad7c-a802cc89eb3a admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:20.545190 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1403/2809] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:02:20 2022] PUT /identity/v3/projects/d456499d358246fbb4c5c262df0c2167/users/2866c68f50b64dd18cdc6a682cdc6eb8/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:20.557480 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5fc0d-7367-4323-a00e-71f31b9d57d4 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:20.557842 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5fc0d-7367-4323-a00e-71f31b9d57d4 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:20.558163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5fc0d-7367-4323-a00e-71f31b9d57d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:20.590196 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-f2e5fc0d-7367-4323-a00e-71f31b9d57d4 None None] MFA Rules not processed for user `2866c68f50b64dd18cdc6a682cdc6eb8`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:20.591444 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-f2e5fc0d-7367-4323-a00e-71f31b9d57d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:20.672207 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1407/2810] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:02:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:20.684057 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe2bdd-c1ad-42d9-ad7c-a802cc89eb3a admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:20.685952 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-b2fe2bdd-c1ad-42d9-ad7c-a802cc89eb3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:20.749544 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe2bdd-c1ad-42d9-ad7c-a802cc89eb3a admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:20.753431 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c6791-f039-40ce-8d39-d0176c76c02c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:20.754715 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c6791-f039-40ce-8d39-d0176c76c02c service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:20.755001 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c6791-f039-40ce-8d39-d0176c76c02c service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:20.755306 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c6791-f039-40ce-8d39-d0176c76c02c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:20.815861 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c6791-f039-40ce-8d39-d0176c76c02c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:20.817980 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c6791-f039-40ce-8d39-d0176c76c02c service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:20.828129 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1404/2811] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:23.405638 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e5fc0d-7367-4323-a00e-71f31b9d57d4 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:23.415576 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:23.471364 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e5fc0d-7367-4323-a00e-71f31b9d57d4 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:23.476022 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee61715-08cf-4e89-ba64-5704b0739d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:23.476656 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee61715-08cf-4e89-ba64-5704b0739d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:23.476933 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee61715-08cf-4e89-ba64-5704b0739d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:23.477203 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee61715-08cf-4e89-ba64-5704b0739d5e admin admin] PATH_INFO: `/v3/users/57c3c82f7e454fd68f2f6531ea80add6` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:23.478479 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee61715-08cf-4e89-ba64-5704b0739d5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=57c3c82f7e454fd68f2f6531ea80add6)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:23.480380 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee61715-08cf-4e89-ba64-5704b0739d5e admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:23.527237 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-aee61715-08cf-4e89-ba64-5704b0739d5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57c3c82f7e454fd68f2f6531ea80add6'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:23.534971 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-aee61715-08cf-4e89-ba64-5704b0739d5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57c3c82f7e454fd68f2f6531ea80add6'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:23.536133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-aee61715-08cf-4e89-ba64-5704b0739d5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57c3c82f7e454fd68f2f6531ea80add6'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:23.536755 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-aee61715-08cf-4e89-ba64-5704b0739d5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57c3c82f7e454fd68f2f6531ea80add6'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:23.549906 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-aee61715-08cf-4e89-ba64-5704b0739d5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57c3c82f7e454fd68f2f6531ea80add6'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:23.562708 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1408/2812] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:02:23 2022] DELETE /identity/v3/users/57c3c82f7e454fd68f2f6531ea80add6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:23.567839 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e8019-2366-4e95-8311-b1f47e38729f None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:23.568344 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e8019-2366-4e95-8311-b1f47e38729f None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:23.568482 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e8019-2366-4e95-8311-b1f47e38729f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:23.587253 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-202e8019-2366-4e95-8311-b1f47e38729f None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:23.588455 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-202e8019-2366-4e95-8311-b1f47e38729f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:23.650267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1405/2813] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:02:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:23.659947 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee61715-08cf-4e89-ba64-5704b0739d5e admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:23.661574 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-aee61715-08cf-4e89-ba64-5704b0739d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:23.722928 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee61715-08cf-4e89-ba64-5704b0739d5e admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:23.726694 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70821c-2e9f-4a9a-92bc-545e62abcbef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:23.727316 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70821c-2e9f-4a9a-92bc-545e62abcbef service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:23.727599 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70821c-2e9f-4a9a-92bc-545e62abcbef service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:23.727875 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70821c-2e9f-4a9a-92bc-545e62abcbef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:23.736979 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b70821c-2e9f-4a9a-92bc-545e62abcbef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:23.739029 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b70821c-2e9f-4a9a-92bc-545e62abcbef service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:23.749089 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1409/2814] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:24.030761 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e8019-2366-4e95-8311-b1f47e38729f None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:24.032230 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-202e8019-2366-4e95-8311-b1f47e38729f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:24.045222 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e8019-2366-4e95-8311-b1f47e38729f None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:24.050433 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec9030-ed06-4e72-bb58-c419393ef930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:24.051903 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec9030-ed06-4e72-bb58-c419393ef930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:24.052097 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec9030-ed06-4e72-bb58-c419393ef930 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:24.052249 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec9030-ed06-4e72-bb58-c419393ef930 admin admin] PATH_INFO: `/v3/projects/d5612f450e954a2dac5bc777eb21638a` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:24.053449 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec9030-ed06-4e72-bb58-c419393ef930 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5612f450e954a2dac5bc777eb21638a)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:24.055401 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec9030-ed06-4e72-bb58-c419393ef930 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:24.095080 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:24.108055 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-fcec9030-ed06-4e72-bb58-c419393ef930 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5612f450e954a2dac5bc777eb21638a', 'request_id': 'req-fcec9030-ed06-4e72-bb58-c419393ef930'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:24.115584 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-fcec9030-ed06-4e72-bb58-c419393ef930 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5612f450e954a2dac5bc777eb21638a', 'request_id': 'req-fcec9030-ed06-4e72-bb58-c419393ef930'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:24.124533 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-fcec9030-ed06-4e72-bb58-c419393ef930 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5612f450e954a2dac5bc777eb21638a', 'request_id': 'req-fcec9030-ed06-4e72-bb58-c419393ef930'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:24.137453 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-fcec9030-ed06-4e72-bb58-c419393ef930 admin admin] The token cache is being invalidate because project d5612f450e954a2dac5bc777eb21638a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:02:24.137796 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-fcec9030-ed06-4e72-bb58-c419393ef930 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:24.138464 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-fcec9030-ed06-4e72-bb58-c419393ef930 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:24.140104 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1406/2815] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:02:24 2022] DELETE /identity/v3/projects/d5612f450e954a2dac5bc777eb21638a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:24.144350 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70821c-2e9f-4a9a-92bc-545e62abcbef service neutron] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:24.156202 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70821c-2e9f-4a9a-92bc-545e62abcbef service neutron] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:24.193576 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:24.225879 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eea9be-c1d1-4a25-968c-27944b9e12ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:24.226541 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eea9be-c1d1-4a25-968c-27944b9e12ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:24.226827 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eea9be-c1d1-4a25-968c-27944b9e12ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:24.227102 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eea9be-c1d1-4a25-968c-27944b9e12ab admin admin] PATH_INFO: `/v3/users/2866c68f50b64dd18cdc6a682cdc6eb8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:24.228294 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eea9be-c1d1-4a25-968c-27944b9e12ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=2866c68f50b64dd18cdc6a682cdc6eb8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:24.230342 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eea9be-c1d1-4a25-968c-27944b9e12ab admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:24.277437 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-f5eea9be-c1d1-4a25-968c-27944b9e12ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2866c68f50b64dd18cdc6a682cdc6eb8'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:24.286000 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-f5eea9be-c1d1-4a25-968c-27944b9e12ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2866c68f50b64dd18cdc6a682cdc6eb8'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:24.286806 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-f5eea9be-c1d1-4a25-968c-27944b9e12ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2866c68f50b64dd18cdc6a682cdc6eb8'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:24.287523 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-f5eea9be-c1d1-4a25-968c-27944b9e12ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2866c68f50b64dd18cdc6a682cdc6eb8'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:24.300490 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-f5eea9be-c1d1-4a25-968c-27944b9e12ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2866c68f50b64dd18cdc6a682cdc6eb8'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:24.313058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1410/2816] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:02:24 2022] DELETE /identity/v3/users/2866c68f50b64dd18cdc6a682cdc6eb8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:24.588816 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec9030-ed06-4e72-bb58-c419393ef930 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:24.590444 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-fcec9030-ed06-4e72-bb58-c419393ef930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:24.607349 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec9030-ed06-4e72-bb58-c419393ef930 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:24.666827 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f68b73-793b-42ed-a9e9-9abde3064b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:24.667479 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f68b73-793b-42ed-a9e9-9abde3064b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:24.667761 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f68b73-793b-42ed-a9e9-9abde3064b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:24.668031 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f68b73-793b-42ed-a9e9-9abde3064b8f admin admin] PATH_INFO: `/v3/projects/d456499d358246fbb4c5c262df0c2167` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:24.669233 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f68b73-793b-42ed-a9e9-9abde3064b8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d456499d358246fbb4c5c262df0c2167)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:24.671375 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f68b73-793b-42ed-a9e9-9abde3064b8f admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:24.722634 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-29f68b73-793b-42ed-a9e9-9abde3064b8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd456499d358246fbb4c5c262df0c2167', 'request_id': 'req-29f68b73-793b-42ed-a9e9-9abde3064b8f'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:24.728834 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-29f68b73-793b-42ed-a9e9-9abde3064b8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd456499d358246fbb4c5c262df0c2167', 'request_id': 'req-29f68b73-793b-42ed-a9e9-9abde3064b8f'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:24.736245 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-29f68b73-793b-42ed-a9e9-9abde3064b8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd456499d358246fbb4c5c262df0c2167', 'request_id': 'req-29f68b73-793b-42ed-a9e9-9abde3064b8f'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:24.749590 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-29f68b73-793b-42ed-a9e9-9abde3064b8f admin admin] The token cache is being invalidate because project d456499d358246fbb4c5c262df0c2167 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:02:24.749880 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-29f68b73-793b-42ed-a9e9-9abde3064b8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:24.750560 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-29f68b73-793b-42ed-a9e9-9abde3064b8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:24.752418 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1407/2817] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:02:24 2022] DELETE /identity/v3/projects/d456499d358246fbb4c5c262df0c2167 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:24.758156 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a25a23-83f5-4ccf-8213-0ea8cb9d84a3 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:24.758695 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a25a23-83f5-4ccf-8213-0ea8cb9d84a3 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:24.758842 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a25a23-83f5-4ccf-8213-0ea8cb9d84a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:24.779344 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-36a25a23-83f5-4ccf-8213-0ea8cb9d84a3 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:24.780563 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-36a25a23-83f5-4ccf-8213-0ea8cb9d84a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:24.847093 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1411/2818] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:24.855517 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43758de8-68b0-4c8b-a7eb-209ef8ff47d9 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:24.855837 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43758de8-68b0-4c8b-a7eb-209ef8ff47d9 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:24.856102 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43758de8-68b0-4c8b-a7eb-209ef8ff47d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:24.875637 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-43758de8-68b0-4c8b-a7eb-209ef8ff47d9 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:24.876819 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-43758de8-68b0-4c8b-a7eb-209ef8ff47d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:24.885386 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1408/2819] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:02:24.889670 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a25a23-83f5-4ccf-8213-0ea8cb9d84a3 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:24.900603 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a25a23-83f5-4ccf-8213-0ea8cb9d84a3 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:24.905443 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e4bcb-eb22-4913-a9da-08bb4cbb4136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:24.906114 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e4bcb-eb22-4913-a9da-08bb4cbb4136 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:24.906398 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e4bcb-eb22-4913-a9da-08bb4cbb4136 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:24.906677 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e4bcb-eb22-4913-a9da-08bb4cbb4136 admin admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:24.907417 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e4bcb-eb22-4913-a9da-08bb4cbb4136 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:02:24.907723 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e4bcb-eb22-4913-a9da-08bb4cbb4136 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:24.909369 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e4bcb-eb22-4913-a9da-08bb4cbb4136 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:24.922200 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1412/2820] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 13:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:02:24.927479 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43758de8-68b0-4c8b-a7eb-209ef8ff47d9 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:24.936654 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43758de8-68b0-4c8b-a7eb-209ef8ff47d9 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:24.941956 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0c918-fdf2-476a-9997-837b32c7992b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:24.942583 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0c918-fdf2-476a-9997-837b32c7992b admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:24.942863 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0c918-fdf2-476a-9997-837b32c7992b admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:24.943136 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0c918-fdf2-476a-9997-837b32c7992b admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:24.943794 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b0c918-fdf2-476a-9997-837b32c7992b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:24.945717 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b0c918-fdf2-476a-9997-837b32c7992b admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:24.974988 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1409/2821] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 13:02:24 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:02:24.979331 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e4bcb-eb22-4913-a9da-08bb4cbb4136 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:24.990040 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e4bcb-eb22-4913-a9da-08bb4cbb4136 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:25.023975 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:25.050403 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e797f15-78e8-4f3c-9f18-ca20d23da986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:25.051735 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e797f15-78e8-4f3c-9f18-ca20d23da986 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:25.052021 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e797f15-78e8-4f3c-9f18-ca20d23da986 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:25.052320 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e797f15-78e8-4f3c-9f18-ca20d23da986 admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:25.053019 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e797f15-78e8-4f3c-9f18-ca20d23da986 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:25.054973 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e797f15-78e8-4f3c-9f18-ca20d23da986 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:25.075702 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1413/2822] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 13:02:24 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:02:25.079878 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0c918-fdf2-476a-9997-837b32c7992b admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:25.090145 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0c918-fdf2-476a-9997-837b32c7992b admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:25.094630 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941844a8-8503-4de0-b807-a934f1c3f56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:25.095233 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941844a8-8503-4de0-b807-a934f1c3f56c admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:25.095511 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941844a8-8503-4de0-b807-a934f1c3f56c admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:25.095782 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941844a8-8503-4de0-b807-a934f1c3f56c admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:25.096471 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941844a8-8503-4de0-b807-a934f1c3f56c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:25.098172 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941844a8-8503-4de0-b807-a934f1c3f56c admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:25.108776 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1410/2823] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:02:25.113904 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e797f15-78e8-4f3c-9f18-ca20d23da986 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:25.124125 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e797f15-78e8-4f3c-9f18-ca20d23da986 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:25.128741 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b440f-0839-4032-a861-b93e511eccfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:25.130028 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b440f-0839-4032-a861-b93e511eccfd admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:25.130309 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b440f-0839-4032-a861-b93e511eccfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:25.130588 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b440f-0839-4032-a861-b93e511eccfd admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:25.131288 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b440f-0839-4032-a861-b93e511eccfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:25.132885 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b440f-0839-4032-a861-b93e511eccfd admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:25.143129 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1414/2824] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:02:25.147387 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941844a8-8503-4de0-b807-a934f1c3f56c admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:25.157843 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941844a8-8503-4de0-b807-a934f1c3f56c admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:25.163556 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33a837-aa97-4908-998d-2d6528c993d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:25.164445 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33a837-aa97-4908-998d-2d6528c993d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:25.164777 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33a837-aa97-4908-998d-2d6528c993d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:25.165112 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33a837-aa97-4908-998d-2d6528c993d4 admin admin] PATH_INFO: `/v3/projects/21341b89f52b4715aee4b3e4485d0aa1/users/61d281740c464c4eb54df0324ebfbd30/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:25.177783 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:25.182098 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c33a837-aa97-4908-998d-2d6528c993d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21341b89f52b4715aee4b3e4485d0aa1, user_id=61d281740c464c4eb54df0324ebfbd30, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:25.185214 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c33a837-aa97-4908-998d-2d6528c993d4 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:25.198515 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1411/2825] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:02:25 2022] PUT /identity/v3/projects/21341b89f52b4715aee4b3e4485d0aa1/users/61d281740c464c4eb54df0324ebfbd30/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:02:25.210540 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97157d-15dd-4bba-afd2-0394e4e34b2f None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:25.210833 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97157d-15dd-4bba-afd2-0394e4e34b2f None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:25.211113 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97157d-15dd-4bba-afd2-0394e4e34b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:25.238687 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-af97157d-15dd-4bba-afd2-0394e4e34b2f None None] MFA Rules not processed for user `61d281740c464c4eb54df0324ebfbd30`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:25.239929 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-af97157d-15dd-4bba-afd2-0394e4e34b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:25.314403 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1415/2826] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:02:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:25.322934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33a837-aa97-4908-998d-2d6528c993d4 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:25.324661 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-1c33a837-aa97-4908-998d-2d6528c993d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:25.382776 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33a837-aa97-4908-998d-2d6528c993d4 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:25.386688 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473581f0-f5c9-430f-a1c1-435c7522fad7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:25.387310 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473581f0-f5c9-430f-a1c1-435c7522fad7 service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:25.387591 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473581f0-f5c9-430f-a1c1-435c7522fad7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:25.387867 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473581f0-f5c9-430f-a1c1-435c7522fad7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:25.396865 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473581f0-f5c9-430f-a1c1-435c7522fad7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:25.398330 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473581f0-f5c9-430f-a1c1-435c7522fad7 service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:25.407212 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1412/2827] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:28.432984 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97157d-15dd-4bba-afd2-0394e4e34b2f None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:28.497551 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97157d-15dd-4bba-afd2-0394e4e34b2f None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:28.502138 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88516f88-3c37-4d11-a063-a65e39f57285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:28.502781 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88516f88-3c37-4d11-a063-a65e39f57285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:28.503064 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88516f88-3c37-4d11-a063-a65e39f57285 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:28.503343 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88516f88-3c37-4d11-a063-a65e39f57285 admin admin] PATH_INFO: `/v3/users/61d281740c464c4eb54df0324ebfbd30` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:28.505277 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88516f88-3c37-4d11-a063-a65e39f57285 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61d281740c464c4eb54df0324ebfbd30)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:28.507236 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88516f88-3c37-4d11-a063-a65e39f57285 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:28.555631 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-88516f88-3c37-4d11-a063-a65e39f57285 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61d281740c464c4eb54df0324ebfbd30'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:28.557693 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:28.563892 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-88516f88-3c37-4d11-a063-a65e39f57285 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61d281740c464c4eb54df0324ebfbd30'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:28.565197 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-88516f88-3c37-4d11-a063-a65e39f57285 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61d281740c464c4eb54df0324ebfbd30'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:28.565858 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-88516f88-3c37-4d11-a063-a65e39f57285 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61d281740c464c4eb54df0324ebfbd30'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:28.578861 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-88516f88-3c37-4d11-a063-a65e39f57285 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61d281740c464c4eb54df0324ebfbd30'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:28.591350 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1416/2828] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:02:28 2022] DELETE /identity/v3/users/61d281740c464c4eb54df0324ebfbd30 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:28.595830 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91778bd6-a5d7-4bf7-863c-47eac592f96d None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:28.596287 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91778bd6-a5d7-4bf7-863c-47eac592f96d None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:28.596406 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91778bd6-a5d7-4bf7-863c-47eac592f96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:28.615248 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-91778bd6-a5d7-4bf7-863c-47eac592f96d None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:28.616442 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-91778bd6-a5d7-4bf7-863c-47eac592f96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:28.678635 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1413/2829] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:02:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:28.689428 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88516f88-3c37-4d11-a063-a65e39f57285 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:28.691308 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-88516f88-3c37-4d11-a063-a65e39f57285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:28.751897 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88516f88-3c37-4d11-a063-a65e39f57285 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:28.756244 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c00d29-fe24-4828-9b09-aca2cf27645c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:28.756853 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c00d29-fe24-4828-9b09-aca2cf27645c service neutron] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:28.757129 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c00d29-fe24-4828-9b09-aca2cf27645c service neutron] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:28.757406 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c00d29-fe24-4828-9b09-aca2cf27645c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:28.767611 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c00d29-fe24-4828-9b09-aca2cf27645c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:28.769073 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c00d29-fe24-4828-9b09-aca2cf27645c service neutron] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:28.779032 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1417/2830] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:29.062517 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91778bd6-a5d7-4bf7-863c-47eac592f96d None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:29.064071 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-91778bd6-a5d7-4bf7-863c-47eac592f96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:29.078395 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91778bd6-a5d7-4bf7-863c-47eac592f96d None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:29.083680 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67595c2d-e387-4275-b644-a229c7a35196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:29.084415 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67595c2d-e387-4275-b644-a229c7a35196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:29.084769 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67595c2d-e387-4275-b644-a229c7a35196 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:29.085117 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67595c2d-e387-4275-b644-a229c7a35196 admin admin] PATH_INFO: `/v3/projects/21341b89f52b4715aee4b3e4485d0aa1` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:29.086495 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67595c2d-e387-4275-b644-a229c7a35196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21341b89f52b4715aee4b3e4485d0aa1)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:29.088489 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67595c2d-e387-4275-b644-a229c7a35196 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:29.143031 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-67595c2d-e387-4275-b644-a229c7a35196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21341b89f52b4715aee4b3e4485d0aa1', 'request_id': 'req-67595c2d-e387-4275-b644-a229c7a35196'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:29.149297 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-67595c2d-e387-4275-b644-a229c7a35196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21341b89f52b4715aee4b3e4485d0aa1', 'request_id': 'req-67595c2d-e387-4275-b644-a229c7a35196'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:29.156052 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-67595c2d-e387-4275-b644-a229c7a35196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21341b89f52b4715aee4b3e4485d0aa1', 'request_id': 'req-67595c2d-e387-4275-b644-a229c7a35196'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:29.166954 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-67595c2d-e387-4275-b644-a229c7a35196 admin admin] The token cache is being invalidate because project 21341b89f52b4715aee4b3e4485d0aa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:02:29.167241 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-67595c2d-e387-4275-b644-a229c7a35196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:29.167850 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-67595c2d-e387-4275-b644-a229c7a35196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:29.169346 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1414/2831] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:02:29 2022] DELETE /identity/v3/projects/21341b89f52b4715aee4b3e4485d0aa1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:29.174586 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a416d7-10c0-4e84-b237-cf54b9d63d46 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:29.174904 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a416d7-10c0-4e84-b237-cf54b9d63d46 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:29.175185 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a416d7-10c0-4e84-b237-cf54b9d63d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:29.196758 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-27a416d7-10c0-4e84-b237-cf54b9d63d46 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:29.198012 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-27a416d7-10c0-4e84-b237-cf54b9d63d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:29.262867 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1418/2832] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:29.270742 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3e74d-c74d-4bb6-a23f-990124e2929c None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:29.270887 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3e74d-c74d-4bb6-a23f-990124e2929c None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:29.271162 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3e74d-c74d-4bb6-a23f-990124e2929c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:29.291481 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-abc3e74d-c74d-4bb6-a23f-990124e2929c None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:29.292671 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-abc3e74d-c74d-4bb6-a23f-990124e2929c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:29.305573 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1415/2833] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:29.306944 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a416d7-10c0-4e84-b237-cf54b9d63d46 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:29.317058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a416d7-10c0-4e84-b237-cf54b9d63d46 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:29.321688 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e44dd-83e0-4564-8721-d40815e39490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:29.322282 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e44dd-83e0-4564-8721-d40815e39490 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:29.322563 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e44dd-83e0-4564-8721-d40815e39490 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:29.322837 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e44dd-83e0-4564-8721-d40815e39490 admin admin] PATH_INFO: `/v3/domains` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:29.323531 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e44dd-83e0-4564-8721-d40815e39490 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:02:29.323834 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e44dd-83e0-4564-8721-d40815e39490 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:29.325462 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e44dd-83e0-4564-8721-d40815e39490 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:29.336955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1419/2834] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 13:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:02:29.341366 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3e74d-c74d-4bb6-a23f-990124e2929c None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:29.352130 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3e74d-c74d-4bb6-a23f-990124e2929c None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:29.356788 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035cf75f-3068-45fd-9bf6-be8918d2c452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:29.357397 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cf75f-3068-45fd-9bf6-be8918d2c452 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:29.357712 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cf75f-3068-45fd-9bf6-be8918d2c452 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:29.357982 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cf75f-3068-45fd-9bf6-be8918d2c452 admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:29.358649 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035cf75f-3068-45fd-9bf6-be8918d2c452 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:29.360543 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035cf75f-3068-45fd-9bf6-be8918d2c452 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:29.367107 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:29.390827 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1416/2835] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 13:02:29 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:02:29.396058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e44dd-83e0-4564-8721-d40815e39490 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:29.407437 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e44dd-83e0-4564-8721-d40815e39490 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:29.458394 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:29.466728 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28423e61-0b87-43ae-9b22-8d21a6b06408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:29.467362 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28423e61-0b87-43ae-9b22-8d21a6b06408 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:29.467889 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28423e61-0b87-43ae-9b22-8d21a6b06408 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:29.468548 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28423e61-0b87-43ae-9b22-8d21a6b06408 admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:29.469230 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28423e61-0b87-43ae-9b22-8d21a6b06408 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:29.471647 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28423e61-0b87-43ae-9b22-8d21a6b06408 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:29.494020 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1420/2836] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 13:02:29 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:02:29.498178 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035cf75f-3068-45fd-9bf6-be8918d2c452 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:29.508412 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035cf75f-3068-45fd-9bf6-be8918d2c452 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:29.513226 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7eca6-e32e-4856-9ba2-7af2b1489409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:29.513863 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7eca6-e32e-4856-9ba2-7af2b1489409 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:29.514140 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7eca6-e32e-4856-9ba2-7af2b1489409 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:29.514413 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7eca6-e32e-4856-9ba2-7af2b1489409 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:29.515100 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e7eca6-e32e-4856-9ba2-7af2b1489409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:29.516674 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e7eca6-e32e-4856-9ba2-7af2b1489409 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:29.527390 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1417/2837] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:02:29.531530 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28423e61-0b87-43ae-9b22-8d21a6b06408 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:29.542880 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28423e61-0b87-43ae-9b22-8d21a6b06408 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:29.547555 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e8854-6a86-45fe-a452-ce14338b6d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:29.548199 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e8854-6a86-45fe-a452-ce14338b6d54 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:29.548574 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e8854-6a86-45fe-a452-ce14338b6d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:29.548684 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e8854-6a86-45fe-a452-ce14338b6d54 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:29.549410 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e8854-6a86-45fe-a452-ce14338b6d54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:29.551028 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e8854-6a86-45fe-a452-ce14338b6d54 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:29.561832 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1421/2838] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:02:29.566069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7eca6-e32e-4856-9ba2-7af2b1489409 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:29.576445 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7eca6-e32e-4856-9ba2-7af2b1489409 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:29.582371 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c8a47-e135-4e2f-a469-fdba7a521b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:29.583228 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c8a47-e135-4e2f-a469-fdba7a521b47 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:29.583516 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c8a47-e135-4e2f-a469-fdba7a521b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:29.583807 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c8a47-e135-4e2f-a469-fdba7a521b47 admin admin] PATH_INFO: `/v3/projects/dd5c81ef6ebb43b3b1bbe012a591cee6/users/1e2761e4949d47e8871ea16ead5b9264/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:29.599801 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c8a47-e135-4e2f-a469-fdba7a521b47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd5c81ef6ebb43b3b1bbe012a591cee6, user_id=1e2761e4949d47e8871ea16ead5b9264, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:29.603035 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c8a47-e135-4e2f-a469-fdba7a521b47 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:29.617946 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1418/2839] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:02:29 2022] PUT /identity/v3/projects/dd5c81ef6ebb43b3b1bbe012a591cee6/users/1e2761e4949d47e8871ea16ead5b9264/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:29.628282 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc92ae-c2dd-41d6-8dcf-13cffb9df6bc None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:29.628572 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc92ae-c2dd-41d6-8dcf-13cffb9df6bc None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:29.628887 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc92ae-c2dd-41d6-8dcf-13cffb9df6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:29.657772 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-ffcc92ae-c2dd-41d6-8dcf-13cffb9df6bc None None] MFA Rules not processed for user `1e2761e4949d47e8871ea16ead5b9264`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:29.658941 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-ffcc92ae-c2dd-41d6-8dcf-13cffb9df6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:29.733561 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1422/2840] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:02:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:29.738497 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c8a47-e135-4e2f-a469-fdba7a521b47 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:29.803916 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c8a47-e135-4e2f-a469-fdba7a521b47 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:29.808603 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032c0ca-36f7-41e9-aded-43068c9a0dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:29.809210 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032c0ca-36f7-41e9-aded-43068c9a0dfb admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:29.809502 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032c0ca-36f7-41e9-aded-43068c9a0dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:29.809795 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032c0ca-36f7-41e9-aded-43068c9a0dfb admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:29.810464 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032c0ca-36f7-41e9-aded-43068c9a0dfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:29.812369 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032c0ca-36f7-41e9-aded-43068c9a0dfb admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:29.841883 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1419/2841] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 13:02:29 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:02:29.845933 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc92ae-c2dd-41d6-8dcf-13cffb9df6bc None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:29.857112 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc92ae-c2dd-41d6-8dcf-13cffb9df6bc None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:29.915522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01784292-1c64-4c9c-b765-3be8024a006b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:29.916052 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01784292-1c64-4c9c-b765-3be8024a006b admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:29.916329 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01784292-1c64-4c9c-b765-3be8024a006b admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:29.916599 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01784292-1c64-4c9c-b765-3be8024a006b admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:29.917244 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01784292-1c64-4c9c-b765-3be8024a006b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:29.919179 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01784292-1c64-4c9c-b765-3be8024a006b admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:29.940567 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1423/2842] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 13:02:29 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:02:29.945049 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032c0ca-36f7-41e9-aded-43068c9a0dfb admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:29.956144 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032c0ca-36f7-41e9-aded-43068c9a0dfb admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:29.961869 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa6e95-c0cb-4596-abb6-33cd297b0641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:29.962646 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa6e95-c0cb-4596-abb6-33cd297b0641 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:29.962933 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa6e95-c0cb-4596-abb6-33cd297b0641 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:29.963212 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa6e95-c0cb-4596-abb6-33cd297b0641 admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:29.963924 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa6e95-c0cb-4596-abb6-33cd297b0641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:29.965568 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa6e95-c0cb-4596-abb6-33cd297b0641 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:29.977555 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1420/2843] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 03 13:02:29.981595 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01784292-1c64-4c9c-b765-3be8024a006b admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:29.992563 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01784292-1c64-4c9c-b765-3be8024a006b admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:29.997345 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c24c12-e3df-4d06-940f-766c6b34f5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:29.998012 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c24c12-e3df-4d06-940f-766c6b34f5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:29.998279 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c24c12-e3df-4d06-940f-766c6b34f5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:29.998556 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c24c12-e3df-4d06-940f-766c6b34f5a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:29.999253 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c24c12-e3df-4d06-940f-766c6b34f5a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:30.000885 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c24c12-e3df-4d06-940f-766c6b34f5a1 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:30.012208 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1424/2844] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:02:30.016294 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa6e95-c0cb-4596-abb6-33cd297b0641 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:30.027977 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa6e95-c0cb-4596-abb6-33cd297b0641 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:30.034076 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041c7a2-c859-4784-b781-9d693aa5a918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:30.034805 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041c7a2-c859-4784-b781-9d693aa5a918 admin admin] REQUEST_METHOD: `PUT` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:30.035232 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041c7a2-c859-4784-b781-9d693aa5a918 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:30.035727 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041c7a2-c859-4784-b781-9d693aa5a918 admin admin] PATH_INFO: `/v3/projects/2cb8d57845a941188fa82ad1178d9de4/users/fbc618150d7f4effb42ce16c9fbce811/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:30.052463 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041c7a2-c859-4784-b781-9d693aa5a918 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cb8d57845a941188fa82ad1178d9de4, user_id=fbc618150d7f4effb42ce16c9fbce811, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:30.055435 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041c7a2-c859-4784-b781-9d693aa5a918 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:30.068578 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1421/2845] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:02:30 2022] PUT /identity/v3/projects/2cb8d57845a941188fa82ad1178d9de4/users/fbc618150d7f4effb42ce16c9fbce811/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:30.080012 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7b3d7-fc4b-4394-8b84-fbba46a81894 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:30.080303 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7b3d7-fc4b-4394-8b84-fbba46a81894 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:30.080587 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7b3d7-fc4b-4394-8b84-fbba46a81894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:30.115507 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-bdc7b3d7-fc4b-4394-8b84-fbba46a81894 None None] MFA Rules not processed for user `fbc618150d7f4effb42ce16c9fbce811`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:30.116751 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-bdc7b3d7-fc4b-4394-8b84-fbba46a81894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:30.150884 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:30.187791 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1425/2846] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:02:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:30.192827 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041c7a2-c859-4784-b781-9d693aa5a918 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:30.257532 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041c7a2-c859-4784-b781-9d693aa5a918 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:30.262459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f54a1-1e00-4ade-9b84-97c96bb0a0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:30.263072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f54a1-1e00-4ade-9b84-97c96bb0a0e2 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:30.263355 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f54a1-1e00-4ade-9b84-97c96bb0a0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:30.263626 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f54a1-1e00-4ade-9b84-97c96bb0a0e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:30.264305 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f54a1-1e00-4ade-9b84-97c96bb0a0e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:30.266235 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f54a1-1e00-4ade-9b84-97c96bb0a0e2 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:30.271782 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:30.295449 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1422/2847] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 13:02:30 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:02:30.299450 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7b3d7-fc4b-4394-8b84-fbba46a81894 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:30.310968 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7b3d7-fc4b-4394-8b84-fbba46a81894 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:30.368522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e272024-23be-4d84-bd32-5150739a9ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:30.369139 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e272024-23be-4d84-bd32-5150739a9ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:30.369422 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e272024-23be-4d84-bd32-5150739a9ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:30.369728 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e272024-23be-4d84-bd32-5150739a9ae2 admin admin] PATH_INFO: `/v3/users` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:30.370386 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e272024-23be-4d84-bd32-5150739a9ae2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:30.372305 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e272024-23be-4d84-bd32-5150739a9ae2 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:30.397683 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1426/2848] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 13:02:30 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 03 13:02:30.398911 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f54a1-1e00-4ade-9b84-97c96bb0a0e2 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:30.409190 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f54a1-1e00-4ade-9b84-97c96bb0a0e2 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:30.413997 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14942b-89bd-4075-9927-f837a2f2694b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:30.414606 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14942b-89bd-4075-9927-f837a2f2694b admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:30.414888 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14942b-89bd-4075-9927-f837a2f2694b admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:30.415163 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14942b-89bd-4075-9927-f837a2f2694b admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:30.415862 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14942b-89bd-4075-9927-f837a2f2694b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:30.417462 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14942b-89bd-4075-9927-f837a2f2694b admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:30.429552 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1423/2849] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:02:30.432614 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e272024-23be-4d84-bd32-5150739a9ae2 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:30.443741 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e272024-23be-4d84-bd32-5150739a9ae2 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:30.448474 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6b8f0-fe32-425d-b6da-6123cd091443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:30.449195 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6b8f0-fe32-425d-b6da-6123cd091443 admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:30.449572 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6b8f0-fe32-425d-b6da-6123cd091443 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:30.449855 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6b8f0-fe32-425d-b6da-6123cd091443 admin admin] PATH_INFO: `/v3/projects/1425ee16e4604c9b8a8a8926de598c8e/users/1695994d018b4d2c99207940ef5eb721/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:30.465894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6b8f0-fe32-425d-b6da-6123cd091443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1425ee16e4604c9b8a8a8926de598c8e, user_id=1695994d018b4d2c99207940ef5eb721, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:30.468925 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6b8f0-fe32-425d-b6da-6123cd091443 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:30.485461 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1427/2850] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:02:30 2022] PUT /identity/v3/projects/1425ee16e4604c9b8a8a8926de598c8e/users/1695994d018b4d2c99207940ef5eb721/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:30.489745 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14942b-89bd-4075-9927-f837a2f2694b admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:30.499615 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14942b-89bd-4075-9927-f837a2f2694b admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:30.561236 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0352a-08c8-4c49-b6e7-3995415fdffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:30.561901 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0352a-08c8-4c49-b6e7-3995415fdffe admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:30.562186 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0352a-08c8-4c49-b6e7-3995415fdffe admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:30.562462 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0352a-08c8-4c49-b6e7-3995415fdffe admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:30.563160 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0352a-08c8-4c49-b6e7-3995415fdffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:30.564765 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0352a-08c8-4c49-b6e7-3995415fdffe admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:30.575166 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1424/2851] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:02:30.579259 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6b8f0-fe32-425d-b6da-6123cd091443 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:30.590680 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6b8f0-fe32-425d-b6da-6123cd091443 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:30.596068 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e3cb7-ec93-4bff-b5cf-aa8c49870ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:30.597313 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e3cb7-ec93-4bff-b5cf-aa8c49870ecd admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:30.598846 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e3cb7-ec93-4bff-b5cf-aa8c49870ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:30.599091 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e3cb7-ec93-4bff-b5cf-aa8c49870ecd admin admin] PATH_INFO: `/v3/projects/1425ee16e4604c9b8a8a8926de598c8e/users/1695994d018b4d2c99207940ef5eb721/roles/0e57d142f86c471883fc07a89fe66ec8` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:30.601434 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e3cb7-ec93-4bff-b5cf-aa8c49870ecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1425ee16e4604c9b8a8a8926de598c8e, user_id=1695994d018b4d2c99207940ef5eb721, role_id=0e57d142f86c471883fc07a89fe66ec8)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:30.604322 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e3cb7-ec93-4bff-b5cf-aa8c49870ecd admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:30.617742 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1428/2852] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:02:30 2022] PUT /identity/v3/projects/1425ee16e4604c9b8a8a8926de598c8e/users/1695994d018b4d2c99207940ef5eb721/roles/0e57d142f86c471883fc07a89fe66ec8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:30.628610 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cc15d-0ee6-4213-b0a2-7d945115b9e5 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:30.629189 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cc15d-0ee6-4213-b0a2-7d945115b9e5 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:30.629296 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cc15d-0ee6-4213-b0a2-7d945115b9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:30.661835 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-1f0cc15d-0ee6-4213-b0a2-7d945115b9e5 None None] MFA Rules not processed for user `1695994d018b4d2c99207940ef5eb721`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:30.663321 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-1f0cc15d-0ee6-4213-b0a2-7d945115b9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:30.734561 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1425/2853] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:02:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:30.748451 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e3cb7-ec93-4bff-b5cf-aa8c49870ecd admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:30.750406 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-387e3cb7-ec93-4bff-b5cf-aa8c49870ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:30.816661 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e3cb7-ec93-4bff-b5cf-aa8c49870ecd admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:30.821088 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30292cc-aac5-4897-8a32-2014676412a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:30.821779 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30292cc-aac5-4897-8a32-2014676412a0 service cinder] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:30.822058 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30292cc-aac5-4897-8a32-2014676412a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:30.822456 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30292cc-aac5-4897-8a32-2014676412a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:30.862839 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:30.883211 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30292cc-aac5-4897-8a32-2014676412a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:30.884931 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30292cc-aac5-4897-8a32-2014676412a0 service cinder] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:30.894429 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1429/2854] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:32.408980 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0cc15d-0ee6-4213-b0a2-7d945115b9e5 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:32.418640 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0cc15d-0ee6-4213-b0a2-7d945115b9e5 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:32.422160 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2325023-cf9c-4b76-8b0d-bffb547efa5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:32.422758 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2325023-cf9c-4b76-8b0d-bffb547efa5f service cinder] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:32.423038 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2325023-cf9c-4b76-8b0d-bffb547efa5f service cinder] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:32.423314 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2325023-cf9c-4b76-8b0d-bffb547efa5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:32.477480 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:32.480029 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2325023-cf9c-4b76-8b0d-bffb547efa5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:32.482443 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2325023-cf9c-4b76-8b0d-bffb547efa5f service cinder] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:32.492544 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1426/2855] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:33.027218 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30292cc-aac5-4897-8a32-2014676412a0 service cinder] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:33.036399 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30292cc-aac5-4897-8a32-2014676412a0 service cinder] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:33.039976 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b9667-c168-4576-91bd-0c7763979552 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:33.040578 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b9667-c168-4576-91bd-0c7763979552 service cinder] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:33.040858 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b9667-c168-4576-91bd-0c7763979552 service cinder] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:33.041134 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b9667-c168-4576-91bd-0c7763979552 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:33.051785 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b9667-c168-4576-91bd-0c7763979552 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:33.053733 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b9667-c168-4576-91bd-0c7763979552 service cinder] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:33.063576 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1430/2856] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:36.918197 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2325023-cf9c-4b76-8b0d-bffb547efa5f service cinder] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:36.980000 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2325023-cf9c-4b76-8b0d-bffb547efa5f service cinder] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:36.984519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e01774-cef0-473d-b07a-dcb14061f271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:36.985146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e01774-cef0-473d-b07a-dcb14061f271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:36.985426 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e01774-cef0-473d-b07a-dcb14061f271 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:36.985734 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e01774-cef0-473d-b07a-dcb14061f271 admin admin] PATH_INFO: `/v3/users/1e2761e4949d47e8871ea16ead5b9264` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:36.986883 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e01774-cef0-473d-b07a-dcb14061f271 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e2761e4949d47e8871ea16ead5b9264)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:36.989038 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e01774-cef0-473d-b07a-dcb14061f271 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:37.035927 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-c4e01774-cef0-473d-b07a-dcb14061f271 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e2761e4949d47e8871ea16ead5b9264'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:37.036570 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-c4e01774-cef0-473d-b07a-dcb14061f271 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e2761e4949d47e8871ea16ead5b9264'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:37.037218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-c4e01774-cef0-473d-b07a-dcb14061f271 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e2761e4949d47e8871ea16ead5b9264'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:37.049342 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-c4e01774-cef0-473d-b07a-dcb14061f271 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e2761e4949d47e8871ea16ead5b9264'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:37.056156 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-c4e01774-cef0-473d-b07a-dcb14061f271 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e2761e4949d47e8871ea16ead5b9264'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:37.068056 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1427/2857] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:02:36 2022] DELETE /identity/v3/users/1e2761e4949d47e8871ea16ead5b9264 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:37.072655 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27aded-8a40-44c6-8009-c5a27f15d31f None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:37.073174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27aded-8a40-44c6-8009-c5a27f15d31f None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:37.073174 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27aded-8a40-44c6-8009-c5a27f15d31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:37.092258 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-6f27aded-8a40-44c6-8009-c5a27f15d31f None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:37.093475 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-6f27aded-8a40-44c6-8009-c5a27f15d31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:37.155903 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1431/2858] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:02:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:37.165756 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e01774-cef0-473d-b07a-dcb14061f271 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:37.167142 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-c4e01774-cef0-473d-b07a-dcb14061f271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:37.224059 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e01774-cef0-473d-b07a-dcb14061f271 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:37.227735 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff0329-f750-42e0-848e-e8e217dc87d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:37.228342 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff0329-f750-42e0-848e-e8e217dc87d2 service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:37.228625 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff0329-f750-42e0-848e-e8e217dc87d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:37.228901 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff0329-f750-42e0-848e-e8e217dc87d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:37.238397 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff0329-f750-42e0-848e-e8e217dc87d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:37.239822 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff0329-f750-42e0-848e-e8e217dc87d2 service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:37.249303 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1428/2859] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:37.515857 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f27aded-8a40-44c6-8009-c5a27f15d31f None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:37.517156 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-6f27aded-8a40-44c6-8009-c5a27f15d31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:37.535090 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f27aded-8a40-44c6-8009-c5a27f15d31f None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:37.540142 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412fc9fc-f358-46f4-8b6a-268bba0cacf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:37.540792 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fc9fc-f358-46f4-8b6a-268bba0cacf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:37.541110 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fc9fc-f358-46f4-8b6a-268bba0cacf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:37.541387 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fc9fc-f358-46f4-8b6a-268bba0cacf3 admin admin] PATH_INFO: `/v3/projects/dd5c81ef6ebb43b3b1bbe012a591cee6` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:37.542597 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412fc9fc-f358-46f4-8b6a-268bba0cacf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd5c81ef6ebb43b3b1bbe012a591cee6)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:37.544536 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412fc9fc-f358-46f4-8b6a-268bba0cacf3 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:37.598788 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-412fc9fc-f358-46f4-8b6a-268bba0cacf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd5c81ef6ebb43b3b1bbe012a591cee6', 'request_id': 'req-412fc9fc-f358-46f4-8b6a-268bba0cacf3'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:37.605199 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-412fc9fc-f358-46f4-8b6a-268bba0cacf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd5c81ef6ebb43b3b1bbe012a591cee6', 'request_id': 'req-412fc9fc-f358-46f4-8b6a-268bba0cacf3'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:37.610832 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-412fc9fc-f358-46f4-8b6a-268bba0cacf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd5c81ef6ebb43b3b1bbe012a591cee6', 'request_id': 'req-412fc9fc-f358-46f4-8b6a-268bba0cacf3'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:37.623605 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-412fc9fc-f358-46f4-8b6a-268bba0cacf3 admin admin] The token cache is being invalidate because project dd5c81ef6ebb43b3b1bbe012a591cee6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:02:37.623894 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-412fc9fc-f358-46f4-8b6a-268bba0cacf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:37.624519 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-412fc9fc-f358-46f4-8b6a-268bba0cacf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:37.626087 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1432/2860] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:02:37 2022] DELETE /identity/v3/projects/dd5c81ef6ebb43b3b1bbe012a591cee6 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:37.630211 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff0329-f750-42e0-848e-e8e217dc87d2 service neutron] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:37.640350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff0329-f750-42e0-848e-e8e217dc87d2 service neutron] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:37.652714 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:37.698352 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624a1fb-5680-4af3-8293-435f2bdf1d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:37.698941 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624a1fb-5680-4af3-8293-435f2bdf1d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:37.699222 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624a1fb-5680-4af3-8293-435f2bdf1d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:37.699498 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624a1fb-5680-4af3-8293-435f2bdf1d8e admin admin] PATH_INFO: `/v3/users/fbc618150d7f4effb42ce16c9fbce811` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:37.700643 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5624a1fb-5680-4af3-8293-435f2bdf1d8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbc618150d7f4effb42ce16c9fbce811)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:37.702604 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5624a1fb-5680-4af3-8293-435f2bdf1d8e admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:37.750101 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-5624a1fb-5680-4af3-8293-435f2bdf1d8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbc618150d7f4effb42ce16c9fbce811'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:37.750812 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-5624a1fb-5680-4af3-8293-435f2bdf1d8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbc618150d7f4effb42ce16c9fbce811'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:37.751412 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-5624a1fb-5680-4af3-8293-435f2bdf1d8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbc618150d7f4effb42ce16c9fbce811'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:37.763861 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-5624a1fb-5680-4af3-8293-435f2bdf1d8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbc618150d7f4effb42ce16c9fbce811'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:37.771236 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-5624a1fb-5680-4af3-8293-435f2bdf1d8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbc618150d7f4effb42ce16c9fbce811'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:37.783919 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1429/2861] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:02:37 2022] DELETE /identity/v3/users/fbc618150d7f4effb42ce16c9fbce811 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:38.055403 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412fc9fc-f358-46f4-8b6a-268bba0cacf3 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:38.057019 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-412fc9fc-f358-46f4-8b6a-268bba0cacf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:38.071377 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412fc9fc-f358-46f4-8b6a-268bba0cacf3 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:38.124068 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:38.138042 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6cffd-b8ad-4b1c-a203-3bbf03a8b3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:38.138695 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6cffd-b8ad-4b1c-a203-3bbf03a8b3c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:38.139007 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6cffd-b8ad-4b1c-a203-3bbf03a8b3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:38.139284 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6cffd-b8ad-4b1c-a203-3bbf03a8b3c6 admin admin] PATH_INFO: `/v3/projects/2cb8d57845a941188fa82ad1178d9de4` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:38.140454 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae6cffd-b8ad-4b1c-a203-3bbf03a8b3c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cb8d57845a941188fa82ad1178d9de4)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:38.142408 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae6cffd-b8ad-4b1c-a203-3bbf03a8b3c6 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:38.187983 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-1ae6cffd-b8ad-4b1c-a203-3bbf03a8b3c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cb8d57845a941188fa82ad1178d9de4', 'request_id': 'req-1ae6cffd-b8ad-4b1c-a203-3bbf03a8b3c6'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:38.194762 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-1ae6cffd-b8ad-4b1c-a203-3bbf03a8b3c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cb8d57845a941188fa82ad1178d9de4', 'request_id': 'req-1ae6cffd-b8ad-4b1c-a203-3bbf03a8b3c6'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:38.200255 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-1ae6cffd-b8ad-4b1c-a203-3bbf03a8b3c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cb8d57845a941188fa82ad1178d9de4', 'request_id': 'req-1ae6cffd-b8ad-4b1c-a203-3bbf03a8b3c6'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:38.213096 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-1ae6cffd-b8ad-4b1c-a203-3bbf03a8b3c6 admin admin] The token cache is being invalidate because project 2cb8d57845a941188fa82ad1178d9de4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:02:38.213384 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-1ae6cffd-b8ad-4b1c-a203-3bbf03a8b3c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:38.214035 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-1ae6cffd-b8ad-4b1c-a203-3bbf03a8b3c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:38.215544 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1433/2862] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:02:38 2022] DELETE /identity/v3/projects/2cb8d57845a941188fa82ad1178d9de4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:38.219742 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624a1fb-5680-4af3-8293-435f2bdf1d8e admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:38.221141 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-5624a1fb-5680-4af3-8293-435f2bdf1d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:38.233804 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624a1fb-5680-4af3-8293-435f2bdf1d8e admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:38.295090 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e11ffd-4cd8-42fe-b466-1fa4f0120d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:38.295738 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e11ffd-4cd8-42fe-b466-1fa4f0120d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:38.296020 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e11ffd-4cd8-42fe-b466-1fa4f0120d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:38.296296 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e11ffd-4cd8-42fe-b466-1fa4f0120d46 admin admin] PATH_INFO: `/v3/users/1695994d018b4d2c99207940ef5eb721` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:38.297459 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e11ffd-4cd8-42fe-b466-1fa4f0120d46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1695994d018b4d2c99207940ef5eb721)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:38.299411 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e11ffd-4cd8-42fe-b466-1fa4f0120d46 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:38.339800 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:38.346816 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-65e11ffd-4cd8-42fe-b466-1fa4f0120d46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1695994d018b4d2c99207940ef5eb721'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:38.348045 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-65e11ffd-4cd8-42fe-b466-1fa4f0120d46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1695994d018b4d2c99207940ef5eb721'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:38.348659 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-65e11ffd-4cd8-42fe-b466-1fa4f0120d46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1695994d018b4d2c99207940ef5eb721'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:38.360449 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-65e11ffd-4cd8-42fe-b466-1fa4f0120d46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1695994d018b4d2c99207940ef5eb721'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:38.367320 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-65e11ffd-4cd8-42fe-b466-1fa4f0120d46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1695994d018b4d2c99207940ef5eb721'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:38.379713 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1430/2863] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:02:38 2022] DELETE /identity/v3/users/1695994d018b4d2c99207940ef5eb721 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:38.651178 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6cffd-b8ad-4b1c-a203-3bbf03a8b3c6 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:38.652701 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-1ae6cffd-b8ad-4b1c-a203-3bbf03a8b3c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:38.670930 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6cffd-b8ad-4b1c-a203-3bbf03a8b3c6 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:38.730398 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7f3c5-e13c-43ed-bce2-b58c62d1fb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:38.731127 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7f3c5-e13c-43ed-bce2-b58c62d1fb5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:38.731410 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7f3c5-e13c-43ed-bce2-b58c62d1fb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:38.731679 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7f3c5-e13c-43ed-bce2-b58c62d1fb5f admin admin] PATH_INFO: `/v3/projects/1425ee16e4604c9b8a8a8926de598c8e` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:38.732840 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7f3c5-e13c-43ed-bce2-b58c62d1fb5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1425ee16e4604c9b8a8a8926de598c8e)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:38.734767 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7f3c5-e13c-43ed-bce2-b58c62d1fb5f admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:38.781417 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-63c7f3c5-e13c-43ed-bce2-b58c62d1fb5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1425ee16e4604c9b8a8a8926de598c8e', 'request_id': 'req-63c7f3c5-e13c-43ed-bce2-b58c62d1fb5f'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:38.787907 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-63c7f3c5-e13c-43ed-bce2-b58c62d1fb5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1425ee16e4604c9b8a8a8926de598c8e', 'request_id': 'req-63c7f3c5-e13c-43ed-bce2-b58c62d1fb5f'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:38.793299 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-63c7f3c5-e13c-43ed-bce2-b58c62d1fb5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1425ee16e4604c9b8a8a8926de598c8e', 'request_id': 'req-63c7f3c5-e13c-43ed-bce2-b58c62d1fb5f'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:38.805728 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-63c7f3c5-e13c-43ed-bce2-b58c62d1fb5f admin admin] The token cache is being invalidate because project 1425ee16e4604c9b8a8a8926de598c8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:02:38.806019 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-63c7f3c5-e13c-43ed-bce2-b58c62d1fb5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:38.806644 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-63c7f3c5-e13c-43ed-bce2-b58c62d1fb5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:38.808156 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1434/2864] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:02:38 2022] DELETE /identity/v3/projects/1425ee16e4604c9b8a8a8926de598c8e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:38.813128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e5006-28b9-444e-8146-70d61fde01aa None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:38.813416 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e5006-28b9-444e-8146-70d61fde01aa None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:38.813734 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e5006-28b9-444e-8146-70d61fde01aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:38.833207 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-cd2e5006-28b9-444e-8146-70d61fde01aa None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:38.834442 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-cd2e5006-28b9-444e-8146-70d61fde01aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:38.892608 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1431/2865] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:02:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:38.901302 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e766a5-028d-4732-a652-46eb91511de5 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:38.901626 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e766a5-028d-4732-a652-46eb91511de5 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:38.901909 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e766a5-028d-4732-a652-46eb91511de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:38.922506 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-06e766a5-028d-4732-a652-46eb91511de5 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:38.923814 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-06e766a5-028d-4732-a652-46eb91511de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:38.932837 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1435/2866] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:02:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:38.937124 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e5006-28b9-444e-8146-70d61fde01aa None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:38.946943 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e5006-28b9-444e-8146-70d61fde01aa None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:38.951547 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510377b-036b-42ca-8e12-944fa904d164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:38.952154 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510377b-036b-42ca-8e12-944fa904d164 admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:38.952437 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510377b-036b-42ca-8e12-944fa904d164 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:38.952711 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510377b-036b-42ca-8e12-944fa904d164 admin admin] PATH_INFO: `/v3/domains` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:38.953408 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510377b-036b-42ca-8e12-944fa904d164 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 03 13:02:38.953749 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510377b-036b-42ca-8e12-944fa904d164 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:38.955343 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510377b-036b-42ca-8e12-944fa904d164 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:38.967083 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1432/2867] 10.222.0.46 () {58 vars in 1153 bytes} [Wed Aug 3 13:02:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 03 13:02:38.971407 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e766a5-028d-4732-a652-46eb91511de5 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:38.976620 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:38.983301 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e766a5-028d-4732-a652-46eb91511de5 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:38.989336 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97785532-e6aa-4eab-a838-7178707f8bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:38.989968 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97785532-e6aa-4eab-a838-7178707f8bdc admin admin] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:38.990249 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97785532-e6aa-4eab-a838-7178707f8bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:38.990522 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97785532-e6aa-4eab-a838-7178707f8bdc admin admin] PATH_INFO: `/v3/projects` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:38.991196 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97785532-e6aa-4eab-a838-7178707f8bdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:38.993085 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97785532-e6aa-4eab-a838-7178707f8bdc admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:39.019723 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1436/2868] 10.222.0.46 () {60 vars in 1153 bytes} [Wed Aug 3 13:02:38 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:02:39.023917 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510377b-036b-42ca-8e12-944fa904d164 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:39.034350 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510377b-036b-42ca-8e12-944fa904d164 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:39.091185 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa2b8c-9938-4c82-87c7-33f9c727d448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:39.091780 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa2b8c-9938-4c82-87c7-33f9c727d448 admin admin] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:39.092062 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa2b8c-9938-4c82-87c7-33f9c727d448 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:39.092335 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa2b8c-9938-4c82-87c7-33f9c727d448 admin admin] PATH_INFO: `/v3/users` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:39.092992 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa2b8c-9938-4c82-87c7-33f9c727d448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:39.094934 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa2b8c-9938-4c82-87c7-33f9c727d448 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:39.116867 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1433/2869] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Aug 3 13:02:39 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 03 13:02:39.121024 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97785532-e6aa-4eab-a838-7178707f8bdc admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:39.131461 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97785532-e6aa-4eab-a838-7178707f8bdc admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:39.136417 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a9b30-4e47-4db2-9fee-60fce4bc81d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:39.137025 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a9b30-4e47-4db2-9fee-60fce4bc81d6 admin admin] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:39.137308 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a9b30-4e47-4db2-9fee-60fce4bc81d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:39.137613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a9b30-4e47-4db2-9fee-60fce4bc81d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:39.138348 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a9b30-4e47-4db2-9fee-60fce4bc81d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:39.139931 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a9b30-4e47-4db2-9fee-60fce4bc81d6 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:39.150008 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1437/2870] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:02:39.153705 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa2b8c-9938-4c82-87c7-33f9c727d448 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:39.164466 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa2b8c-9938-4c82-87c7-33f9c727d448 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:39.169293 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a01bf9-2207-48a7-acf0-e5a344ac3ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:39.169933 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a01bf9-2207-48a7-acf0-e5a344ac3ddd admin admin] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:39.170218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a01bf9-2207-48a7-acf0-e5a344ac3ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:39.170499 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a01bf9-2207-48a7-acf0-e5a344ac3ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:39.171195 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a01bf9-2207-48a7-acf0-e5a344ac3ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:39.172791 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a01bf9-2207-48a7-acf0-e5a344ac3ddd admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:39.184022 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1434/2871] 10.222.0.46 () {58 vars in 1122 bytes} [Wed Aug 3 13:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 03 13:02:39.188243 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a9b30-4e47-4db2-9fee-60fce4bc81d6 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:39.198868 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a9b30-4e47-4db2-9fee-60fce4bc81d6 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:39.203430 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88789f69-9e20-415b-911b-1973e966323c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:39.204080 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88789f69-9e20-415b-911b-1973e966323c admin admin] REQUEST_METHOD: `PUT` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:39.204363 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88789f69-9e20-415b-911b-1973e966323c admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:39.204638 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88789f69-9e20-415b-911b-1973e966323c admin admin] PATH_INFO: `/v3/projects/51bb1790f12e493e9602940dbb28b91b/users/b2f422088ea24e62854343e18da8eff6/roles/e1c6e31e9e944b23bc9ba6b0099d3376` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:39.220548 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88789f69-9e20-415b-911b-1973e966323c admin admin] RBAC: Authorizing `identity:create_grant(project_id=51bb1790f12e493e9602940dbb28b91b, user_id=b2f422088ea24e62854343e18da8eff6, role_id=e1c6e31e9e944b23bc9ba6b0099d3376)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:39.223838 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88789f69-9e20-415b-911b-1973e966323c admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:39.236168 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1438/2872] 10.222.0.46 () {60 vars in 1483 bytes} [Wed Aug 3 13:02:39 2022] PUT /identity/v3/projects/51bb1790f12e493e9602940dbb28b91b/users/b2f422088ea24e62854343e18da8eff6/roles/e1c6e31e9e944b23bc9ba6b0099d3376 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:39.246402 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6961fc-5996-4aeb-8b1b-87ed8f30d08b None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:39.246889 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6961fc-5996-4aeb-8b1b-87ed8f30d08b None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:39.247000 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6961fc-5996-4aeb-8b1b-87ed8f30d08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:39.277786 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-0b6961fc-5996-4aeb-8b1b-87ed8f30d08b None None] MFA Rules not processed for user `b2f422088ea24e62854343e18da8eff6`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:39.279075 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-0b6961fc-5996-4aeb-8b1b-87ed8f30d08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:39.289066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:39.344336 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1435/2873] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:02:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:39.355871 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88789f69-9e20-415b-911b-1973e966323c admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:39.357605 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-88789f69-9e20-415b-911b-1973e966323c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:39.415392 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88789f69-9e20-415b-911b-1973e966323c admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:39.418995 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d7ebc-a869-449c-937c-214982853083 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '603adceaefb94e218cc1e683529a60b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:39.419604 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d7ebc-a869-449c-937c-214982853083 service cinder] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:39.419880 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d7ebc-a869-449c-937c-214982853083 service cinder] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:39.420152 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d7ebc-a869-449c-937c-214982853083 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:39.428495 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d7ebc-a869-449c-937c-214982853083 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:39.429945 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d7ebc-a869-449c-937c-214982853083 service cinder] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:39.438615 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1439/2874] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:39 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:43.771504 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d177537-12b2-42a8-a962-054be32d752b None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:43.771968 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d177537-12b2-42a8-a962-054be32d752b None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:43.772134 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d177537-12b2-42a8-a962-054be32d752b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:43.791664 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-3d177537-12b2-42a8-a962-054be32d752b None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:43.792888 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-3d177537-12b2-42a8-a962-054be32d752b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:43.852362 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1436/2875] 10.222.0.48 () {58 vars in 1016 bytes} [Wed Aug 3 13:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:43.874613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d7ebc-a869-449c-937c-214982853083 service cinder] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:43.875995 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-995d7ebc-a869-449c-937c-214982853083 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:43.949620 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d7ebc-a869-449c-937c-214982853083 service cinder] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:43.955014 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb35e5-dd0a-4c76-95c9-dbb9592d3980 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:43.955614 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb35e5-dd0a-4c76-95c9-dbb9592d3980 service nova] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:43.955891 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb35e5-dd0a-4c76-95c9-dbb9592d3980 service nova] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:43.956163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb35e5-dd0a-4c76-95c9-dbb9592d3980 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:43.964275 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb35e5-dd0a-4c76-95c9-dbb9592d3980 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:43.965885 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb35e5-dd0a-4c76-95c9-dbb9592d3980 service nova] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:43.975190 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1440/2876] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:47.804023 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a85e0-60af-4aef-8c92-1eed9caa4d72 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:47.804566 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a85e0-60af-4aef-8c92-1eed9caa4d72 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:47.804566 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a85e0-60af-4aef-8c92-1eed9caa4d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:47.824053 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-5d1a85e0-60af-4aef-8c92-1eed9caa4d72 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:47.825257 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-5d1a85e0-60af-4aef-8c92-1eed9caa4d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:47.833295 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1437/2877] 10.222.0.48 () {58 vars in 1016 bytes} [Wed Aug 3 13:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:47.858371 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb35e5-dd0a-4c76-95c9-dbb9592d3980 service nova] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:47.859826 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-accb35e5-dd0a-4c76-95c9-dbb9592d3980 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:47.875163 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb35e5-dd0a-4c76-95c9-dbb9592d3980 service nova] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:47.881409 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d429569-78d6-4ea7-bf13-719c1bff56fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:47.882047 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d429569-78d6-4ea7-bf13-719c1bff56fb service nova] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:47.882329 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d429569-78d6-4ea7-bf13-719c1bff56fb service nova] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:47.882607 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d429569-78d6-4ea7-bf13-719c1bff56fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:47.891239 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d429569-78d6-4ea7-bf13-719c1bff56fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:47.892810 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d429569-78d6-4ea7-bf13-719c1bff56fb service nova] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:47.902593 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1441/2878] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:49.514571 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a85e0-60af-4aef-8c92-1eed9caa4d72 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:49.524586 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a85e0-60af-4aef-8c92-1eed9caa4d72 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:49.529096 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0da6a-c8c5-4f33-84af-61076c6c44eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:49.529761 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0da6a-c8c5-4f33-84af-61076c6c44eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:49.530045 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0da6a-c8c5-4f33-84af-61076c6c44eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:49.530321 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0da6a-c8c5-4f33-84af-61076c6c44eb admin admin] PATH_INFO: `/v3/users/b2f422088ea24e62854343e18da8eff6` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:49.531505 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0da6a-c8c5-4f33-84af-61076c6c44eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2f422088ea24e62854343e18da8eff6)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:49.533425 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0da6a-c8c5-4f33-84af-61076c6c44eb admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:49.581251 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-45b0da6a-c8c5-4f33-84af-61076c6c44eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2f422088ea24e62854343e18da8eff6'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:49.581947 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-45b0da6a-c8c5-4f33-84af-61076c6c44eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2f422088ea24e62854343e18da8eff6'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:49.582614 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-45b0da6a-c8c5-4f33-84af-61076c6c44eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2f422088ea24e62854343e18da8eff6'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:49.594271 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-45b0da6a-c8c5-4f33-84af-61076c6c44eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2f422088ea24e62854343e18da8eff6'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:49.601881 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-45b0da6a-c8c5-4f33-84af-61076c6c44eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2f422088ea24e62854343e18da8eff6'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:49.616472 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1438/2879] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:02:49 2022] DELETE /identity/v3/users/b2f422088ea24e62854343e18da8eff6 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:49.620942 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05613881-3807-4f0a-9cef-a094c448b05c None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:49.621405 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05613881-3807-4f0a-9cef-a094c448b05c None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:49.621550 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05613881-3807-4f0a-9cef-a094c448b05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:49.640976 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-05613881-3807-4f0a-9cef-a094c448b05c None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:49.642231 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-05613881-3807-4f0a-9cef-a094c448b05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:49.656385 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:49.711001 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1442/2880] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:02:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:49.720760 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0da6a-c8c5-4f33-84af-61076c6c44eb admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:49.722767 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-45b0da6a-c8c5-4f33-84af-61076c6c44eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:49.748175 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:02:49.787027 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0da6a-c8c5-4f33-84af-61076c6c44eb admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:49.790573 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e4da0-0ac5-4f12-b28f-e2df4504f61d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:49.791179 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e4da0-0ac5-4f12-b28f-e2df4504f61d service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:49.791453 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e4da0-0ac5-4f12-b28f-e2df4504f61d service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:49.791718 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e4da0-0ac5-4f12-b28f-e2df4504f61d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:49.800411 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e4da0-0ac5-4f12-b28f-e2df4504f61d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:49.801866 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e4da0-0ac5-4f12-b28f-e2df4504f61d service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:49.810994 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1439/2881] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:50.074807 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05613881-3807-4f0a-9cef-a094c448b05c None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:50.076242 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-05613881-3807-4f0a-9cef-a094c448b05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:50.091738 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05613881-3807-4f0a-9cef-a094c448b05c None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:50.097392 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b6bc2-ab39-4f0f-b75c-9bc9f185d5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:50.098139 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b6bc2-ab39-4f0f-b75c-9bc9f185d5e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:50.098421 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b6bc2-ab39-4f0f-b75c-9bc9f185d5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:50.098760 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b6bc2-ab39-4f0f-b75c-9bc9f185d5e7 admin admin] PATH_INFO: `/v3/projects/51bb1790f12e493e9602940dbb28b91b` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:50.099881 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b6bc2-ab39-4f0f-b75c-9bc9f185d5e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51bb1790f12e493e9602940dbb28b91b)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:50.101911 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b6bc2-ab39-4f0f-b75c-9bc9f185d5e7 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:50.155392 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-fa5b6bc2-ab39-4f0f-b75c-9bc9f185d5e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51bb1790f12e493e9602940dbb28b91b', 'request_id': 'req-fa5b6bc2-ab39-4f0f-b75c-9bc9f185d5e7'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:50.161733 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-fa5b6bc2-ab39-4f0f-b75c-9bc9f185d5e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51bb1790f12e493e9602940dbb28b91b', 'request_id': 'req-fa5b6bc2-ab39-4f0f-b75c-9bc9f185d5e7'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:50.167393 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-fa5b6bc2-ab39-4f0f-b75c-9bc9f185d5e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51bb1790f12e493e9602940dbb28b91b', 'request_id': 'req-fa5b6bc2-ab39-4f0f-b75c-9bc9f185d5e7'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:50.179593 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-fa5b6bc2-ab39-4f0f-b75c-9bc9f185d5e7 admin admin] The token cache is being invalidate because project 51bb1790f12e493e9602940dbb28b91b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:02:50.179882 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-fa5b6bc2-ab39-4f0f-b75c-9bc9f185d5e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:50.180499 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-fa5b6bc2-ab39-4f0f-b75c-9bc9f185d5e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:02:50.182039 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1443/2882] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:02:50 2022] DELETE /identity/v3/projects/51bb1790f12e493e9602940dbb28b91b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:02:52.076517 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee449bf-4ead-4e25-bbd3-1abea5342f18 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:52.077069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee449bf-4ead-4e25-bbd3-1abea5342f18 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:52.077069 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee449bf-4ead-4e25-bbd3-1abea5342f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:52.096334 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-3ee449bf-4ead-4e25-bbd3-1abea5342f18 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:52.097660 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-3ee449bf-4ead-4e25-bbd3-1abea5342f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:52.157082 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1440/2883] 10.222.0.48 () {58 vars in 1016 bytes} [Wed Aug 3 13:02:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:52.178050 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b6bc2-ab39-4f0f-b75c-9bc9f185d5e7 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:52.179745 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-fa5b6bc2-ab39-4f0f-b75c-9bc9f185d5e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:52.260888 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b6bc2-ab39-4f0f-b75c-9bc9f185d5e7 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:52.266396 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e818587-e99e-418a-8eff-eb321cc8d8da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:52.267016 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e818587-e99e-418a-8eff-eb321cc8d8da service nova] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:52.267301 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e818587-e99e-418a-8eff-eb321cc8d8da service nova] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:52.267580 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e818587-e99e-418a-8eff-eb321cc8d8da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:52.276147 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e818587-e99e-418a-8eff-eb321cc8d8da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:52.277752 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e818587-e99e-418a-8eff-eb321cc8d8da service nova] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:52.287967 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1444/2884] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:02:56.198281 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8def1-63b7-443d-afdb-3a0eca855d1f None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:56.198799 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8def1-63b7-443d-afdb-3a0eca855d1f None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:56.198799 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8def1-63b7-443d-afdb-3a0eca855d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:56.218280 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-8af8def1-63b7-443d-afdb-3a0eca855d1f None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:02:56.219477 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-8af8def1-63b7-443d-afdb-3a0eca855d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:56.227486 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1441/2885] 10.222.0.48 () {58 vars in 1016 bytes} [Wed Aug 3 13:02:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:02:56.248259 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e818587-e99e-418a-8eff-eb321cc8d8da service nova] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:02:56.249690 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-2e818587-e99e-418a-8eff-eb321cc8d8da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:02:56.265216 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e818587-e99e-418a-8eff-eb321cc8d8da service nova] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:02:56.271897 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368f23e-864c-46f4-8c6b-80d324fa5461 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:02:56.272206 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368f23e-864c-46f4-8c6b-80d324fa5461 service nova] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:02:56.272494 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368f23e-864c-46f4-8c6b-80d324fa5461 service nova] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:02:56.272766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368f23e-864c-46f4-8c6b-80d324fa5461 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:02:56.281601 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368f23e-864c-46f4-8c6b-80d324fa5461 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:02:56.283173 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368f23e-864c-46f4-8c6b-80d324fa5461 service nova] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:02:56.292832 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1445/2886] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:02:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:03:01.417800 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b5e15-cd5e-4f74-8c5a-8bbd82e2a039 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:01.418329 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b5e15-cd5e-4f74-8c5a-8bbd82e2a039 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:01.418329 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b5e15-cd5e-4f74-8c5a-8bbd82e2a039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:01.438011 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-1e7b5e15-cd5e-4f74-8c5a-8bbd82e2a039 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:01.439219 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-1e7b5e15-cd5e-4f74-8c5a-8bbd82e2a039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:01.447134 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1442/2887] 10.222.0.48 () {58 vars in 1016 bytes} [Wed Aug 3 13:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:01.470814 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368f23e-864c-46f4-8c6b-80d324fa5461 service nova] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:01.482585 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368f23e-864c-46f4-8c6b-80d324fa5461 service nova] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:01.487991 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4774412-e685-43fc-8c67-0891978321e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:01.489194 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4774412-e685-43fc-8c67-0891978321e5 service nova] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:01.489471 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4774412-e685-43fc-8c67-0891978321e5 service nova] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:01.489773 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4774412-e685-43fc-8c67-0891978321e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:01.497927 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4774412-e685-43fc-8c67-0891978321e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:01.499492 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4774412-e685-43fc-8c67-0891978321e5 service nova] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:01.508832 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1446/2888] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:03:05.607206 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37bfe9-fcf7-4a9d-881b-15fe4ea97ed8 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:05.607738 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37bfe9-fcf7-4a9d-881b-15fe4ea97ed8 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:05.607738 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37bfe9-fcf7-4a9d-881b-15fe4ea97ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:05.627448 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-4c37bfe9-fcf7-4a9d-881b-15fe4ea97ed8 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:05.629375 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-4c37bfe9-fcf7-4a9d-881b-15fe4ea97ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:05.637710 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1443/2889] 10.222.0.48 () {58 vars in 1016 bytes} [Wed Aug 3 13:03:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:05.659675 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4774412-e685-43fc-8c67-0891978321e5 service nova] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:05.665596 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:05.672657 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4774412-e685-43fc-8c67-0891978321e5 service nova] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:05.679920 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43cb419-3a08-44a3-a353-7ff96f3fd88a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:05.680529 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cb419-3a08-44a3-a353-7ff96f3fd88a service nova] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:05.680819 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cb419-3a08-44a3-a353-7ff96f3fd88a service nova] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:05.681106 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cb419-3a08-44a3-a353-7ff96f3fd88a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:05.689534 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43cb419-3a08-44a3-a353-7ff96f3fd88a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:05.691111 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43cb419-3a08-44a3-a353-7ff96f3fd88a service nova] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:05.701133 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1447/2890] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:03:15.622407 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=54 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:15.696853 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=5 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:16.518742 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37bfe9-fcf7-4a9d-881b-15fe4ea97ed8 None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:16.532540 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37bfe9-fcf7-4a9d-881b-15fe4ea97ed8 None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:16.538641 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af6a50-57b2-40a8-8eaa-26bfefed1abb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:16.539265 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af6a50-57b2-40a8-8eaa-26bfefed1abb service nova] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:16.539547 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af6a50-57b2-40a8-8eaa-26bfefed1abb service nova] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:16.539820 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af6a50-57b2-40a8-8eaa-26bfefed1abb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:16.541676 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-53af6a50-57b2-40a8-8eaa-26bfefed1abb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:16.556307 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af6a50-57b2-40a8-8eaa-26bfefed1abb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:16.557925 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af6a50-57b2-40a8-8eaa-26bfefed1abb service nova] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:16.569147 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1444/2891] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:03:21.715758 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b8a07-7098-4c27-90c7-9148dd34d597 None None] REQUEST_METHOD: `POST` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:21.716230 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b8a07-7098-4c27-90c7-9148dd34d597 None None] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:21.716356 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b8a07-7098-4c27-90c7-9148dd34d597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:21.735321 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.auth.core [None req-462b8a07-7098-4c27-90c7-9148dd34d597 None None] MFA Rules not processed for user `5c0517330b7648faac9b15b72cbce9a1`. Rule list: `[]` (Enabled: `True`). {{(pid=91788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:21.736531 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-462b8a07-7098-4c27-90c7-9148dd34d597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:21.792915 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1448/2892] 10.222.0.46 () {58 vars in 958 bytes} [Wed Aug 3 13:03:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:03:22.323661 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af6a50-57b2-40a8-8eaa-26bfefed1abb service nova] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:22.325145 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-53af6a50-57b2-40a8-8eaa-26bfefed1abb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:22.398185 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af6a50-57b2-40a8-8eaa-26bfefed1abb service nova] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:22.403147 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64b8cc-573f-4e31-a6f5-520d49550571 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56847173abb48d39c0ee6fb9cdbbbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:22.403760 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64b8cc-573f-4e31-a6f5-520d49550571 service placement] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:22.404066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64b8cc-573f-4e31-a6f5-520d49550571 service placement] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:22.404340 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64b8cc-573f-4e31-a6f5-520d49550571 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:22.406119 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-ca64b8cc-573f-4e31-a6f5-520d49550571 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:22.417277 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64b8cc-573f-4e31-a6f5-520d49550571 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:22.418870 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64b8cc-573f-4e31-a6f5-520d49550571 service placement] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:22.428922 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1445/2893] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:03:31.286201 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b8a07-7098-4c27-90c7-9148dd34d597 None None] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:31.299709 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b8a07-7098-4c27-90c7-9148dd34d597 None None] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:31.305923 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc479b-fe31-4068-a81c-0f74da23d274 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:31.306551 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc479b-fe31-4068-a81c-0f74da23d274 service nova] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:31.306836 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc479b-fe31-4068-a81c-0f74da23d274 service nova] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:31.307147 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc479b-fe31-4068-a81c-0f74da23d274 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:31.308991 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-d0bc479b-fe31-4068-a81c-0f74da23d274 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:31.322831 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc479b-fe31-4068-a81c-0f74da23d274 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:31.324447 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc479b-fe31-4068-a81c-0f74da23d274 service nova] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:31.336241 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1449/2894] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:03:32.424394 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=38 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:36.896344 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb8637-1c11-4fbb-9241-89f9d2053c24 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:36.896973 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb8637-1c11-4fbb-9241-89f9d2053c24 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:36.896973 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb8637-1c11-4fbb-9241-89f9d2053c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:36.916058 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-33eb8637-1c11-4fbb-9241-89f9d2053c24 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:36.917269 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-33eb8637-1c11-4fbb-9241-89f9d2053c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:36.925131 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1446/2895] 10.222.0.48 () {58 vars in 1016 bytes} [Wed Aug 3 13:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:36.943946 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc479b-fe31-4068-a81c-0f74da23d274 service nova] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:36.955751 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc479b-fe31-4068-a81c-0f74da23d274 service nova] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:36.961228 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53421e24-d198-4cba-983f-9509f2fc8781 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:36.961880 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53421e24-d198-4cba-983f-9509f2fc8781 service nova] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:36.962162 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53421e24-d198-4cba-983f-9509f2fc8781 service nova] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:36.962439 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53421e24-d198-4cba-983f-9509f2fc8781 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:36.971008 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53421e24-d198-4cba-983f-9509f2fc8781 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:36.972613 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53421e24-d198-4cba-983f-9509f2fc8781 service nova] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:36.982151 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1450/2896] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:03:40.149767 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee2dce-11c2-4269-81d3-635e0d8cd772 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:40.150328 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee2dce-11c2-4269-81d3-635e0d8cd772 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:40.150328 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee2dce-11c2-4269-81d3-635e0d8cd772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:40.169993 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-81ee2dce-11c2-4269-81d3-635e0d8cd772 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:40.171202 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-81ee2dce-11c2-4269-81d3-635e0d8cd772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:40.179072 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1447/2897] 10.222.0.48 () {58 vars in 1016 bytes} [Wed Aug 3 13:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 03 13:03:40.198760 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53421e24-d198-4cba-983f-9509f2fc8781 service nova] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:40.209990 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53421e24-d198-4cba-983f-9509f2fc8781 service nova] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:40.215744 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee018ee5-cde6-48b4-8cdb-fcaeabe4b9dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:40.216342 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee018ee5-cde6-48b4-8cdb-fcaeabe4b9dd service nova] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:40.216627 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee018ee5-cde6-48b4-8cdb-fcaeabe4b9dd service nova] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:40.216905 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee018ee5-cde6-48b4-8cdb-fcaeabe4b9dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:40.225164 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee018ee5-cde6-48b4-8cdb-fcaeabe4b9dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:40.227350 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee018ee5-cde6-48b4-8cdb-fcaeabe4b9dd service nova] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:40.236853 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1451/2898] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:03:43.235400 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ff5b8-e323-45b2-922e-f8a50aa54e02 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:43.235893 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ff5b8-e323-45b2-922e-f8a50aa54e02 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:43.235992 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ff5b8-e323-45b2-922e-f8a50aa54e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:43.256058 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-1d0ff5b8-e323-45b2-922e-f8a50aa54e02 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:43.257279 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-1d0ff5b8-e323-45b2-922e-f8a50aa54e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:43.265867 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1448/2899] 10.222.0.48 () {58 vars in 1016 bytes} [Wed Aug 3 13:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:43.285798 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee018ee5-cde6-48b4-8cdb-fcaeabe4b9dd service nova] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:43.297162 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee018ee5-cde6-48b4-8cdb-fcaeabe4b9dd service nova] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:43.302565 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4151262-ad91-4afe-bbd9-8326e0d4c2d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:43.303159 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4151262-ad91-4afe-bbd9-8326e0d4c2d5 service nova] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:43.303434 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4151262-ad91-4afe-bbd9-8326e0d4c2d5 service nova] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:43.303705 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4151262-ad91-4afe-bbd9-8326e0d4c2d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:43.311790 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4151262-ad91-4afe-bbd9-8326e0d4c2d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:43.313341 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4151262-ad91-4afe-bbd9-8326e0d4c2d5 service nova] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:43.323283 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1452/2900] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:03:47.426087 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50ddea-dac4-438b-b051-c08cab15f0f6 None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:47.426626 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50ddea-dac4-438b-b051-c08cab15f0f6 None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:47.426626 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50ddea-dac4-438b-b051-c08cab15f0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:47.447324 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-2d50ddea-dac4-438b-b051-c08cab15f0f6 None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:47.448533 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-2d50ddea-dac4-438b-b051-c08cab15f0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:47.456284 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1449/2901] 10.222.0.48 () {58 vars in 1016 bytes} [Wed Aug 3 13:03:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:47.477889 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4151262-ad91-4afe-bbd9-8326e0d4c2d5 service nova] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:47.483464 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=50 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:03:47.489789 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4151262-ad91-4afe-bbd9-8326e0d4c2d5 service nova] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:47.495775 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd3291-9db1-407c-8e0c-1fd36f0a0a82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:47.496369 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd3291-9db1-407c-8e0c-1fd36f0a0a82 service nova] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:47.496649 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd3291-9db1-407c-8e0c-1fd36f0a0a82 service nova] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:47.496920 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd3291-9db1-407c-8e0c-1fd36f0a0a82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:47.504950 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd3291-9db1-407c-8e0c-1fd36f0a0a82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:47.506541 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd3291-9db1-407c-8e0c-1fd36f0a0a82 service nova] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:47.516675 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1453/2902] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 03 13:03:51.617715 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737fc2d-364f-4b36-a5d5-5336a86d9f4b None None] REQUEST_METHOD: `POST` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:51.618200 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737fc2d-364f-4b36-a5d5-5336a86d9f4b None None] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:51.618315 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737fc2d-364f-4b36-a5d5-5336a86d9f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:51.639146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.auth.core [None req-1737fc2d-364f-4b36-a5d5-5336a86d9f4b None None] MFA Rules not processed for user `813656e83c41478ab6f4c3340645651a`. Rule list: `[]` (Enabled: `True`). {{(pid=91789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 03 13:03:51.640364 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-1737fc2d-364f-4b36-a5d5-5336a86d9f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:03:51.648118 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1450/2903] 10.222.0.48 () {58 vars in 1016 bytes} [Wed Aug 3 13:03:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 03 13:03:51.669808 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd3291-9db1-407c-8e0c-1fd36f0a0a82 service nova] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:03:51.681233 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd3291-9db1-407c-8e0c-1fd36f0a0a82 service nova] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:03:51.686705 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de9dd0-8b81-4d42-ade8-20544d7bcee4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:03:51.687304 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de9dd0-8b81-4d42-ade8-20544d7bcee4 service nova] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:03:51.687584 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de9dd0-8b81-4d42-ade8-20544d7bcee4 service nova] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:03:51.687859 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de9dd0-8b81-4d42-ade8-20544d7bcee4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:03:51.696635 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de9dd0-8b81-4d42-ade8-20544d7bcee4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:03:51.698239 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de9dd0-8b81-4d42-ade8-20544d7bcee4 service nova] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:03:51.707641 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1454/2904] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:03:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:04:01.632282 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=15 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:01.703615 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=11 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:11.174656 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737fc2d-364f-4b36-a5d5-5336a86d9f4b None None] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:11.176088 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-1737fc2d-364f-4b36-a5d5-5336a86d9f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:11.235924 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737fc2d-364f-4b36-a5d5-5336a86d9f4b None None] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:11.239859 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e161d7f-bb94-49d5-99f1-e0bf6c1c0e4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:11.240389 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e161d7f-bb94-49d5-99f1-e0bf6c1c0e4f service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:11.240695 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e161d7f-bb94-49d5-99f1-e0bf6c1c0e4f service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:11.240973 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e161d7f-bb94-49d5-99f1-e0bf6c1c0e4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:11.243710 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-9e161d7f-bb94-49d5-99f1-e0bf6c1c0e4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:11.313422 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e161d7f-bb94-49d5-99f1-e0bf6c1c0e4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:11.314914 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e161d7f-bb94-49d5-99f1-e0bf6c1c0e4f service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:11.324601 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1451/2905] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:04:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:04:12.188433 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de9dd0-8b81-4d42-ade8-20544d7bcee4 service nova] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:12.200855 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de9dd0-8b81-4d42-ade8-20544d7bcee4 service nova] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:12.207995 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e777e-0a8e-4627-8b43-346a86dcdc8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcf670ff4f62486dbf70cf6ea0f08bbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:12.208615 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e777e-0a8e-4627-8b43-346a86dcdc8d service nova] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:12.208931 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e777e-0a8e-4627-8b43-346a86dcdc8d service nova] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:12.209274 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e777e-0a8e-4627-8b43-346a86dcdc8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:12.211757 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-954e777e-0a8e-4627-8b43-346a86dcdc8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:12.225956 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e777e-0a8e-4627-8b43-346a86dcdc8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:12.228400 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e777e-0a8e-4627-8b43-346a86dcdc8d service nova] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:12.240098 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1455/2906] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:04:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:04:16.096724 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e161d7f-bb94-49d5-99f1-e0bf6c1c0e4f service neutron] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:16.106031 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e161d7f-bb94-49d5-99f1-e0bf6c1c0e4f service neutron] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:16.109628 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771366ba-94d1-4130-9594-2a466b4a4388 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0cd747cb5f64ff7b5f8d67d3d640fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:16.110239 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771366ba-94d1-4130-9594-2a466b4a4388 service neutron] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:16.110521 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771366ba-94d1-4130-9594-2a466b4a4388 service neutron] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:16.110792 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771366ba-94d1-4130-9594-2a466b4a4388 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:16.112560 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-771366ba-94d1-4130-9594-2a466b4a4388 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:16.125711 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771366ba-94d1-4130-9594-2a466b4a4388 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:16.127156 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771366ba-94d1-4130-9594-2a466b4a4388 service neutron] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:16.138380 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1452/2907] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:04:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:04:19.240747 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e777e-0a8e-4627-8b43-346a86dcdc8d service nova] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:19.243437 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-954e777e-0a8e-4627-8b43-346a86dcdc8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:19.260594 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e777e-0a8e-4627-8b43-346a86dcdc8d service nova] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:19.270171 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d678939-c68f-48d9-9ec4-49d8b90a6bba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56847173abb48d39c0ee6fb9cdbbbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:19.270826 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d678939-c68f-48d9-9ec4-49d8b90a6bba service placement] REQUEST_METHOD: `GET` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:19.273872 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d678939-c68f-48d9-9ec4-49d8b90a6bba service placement] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:19.274352 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d678939-c68f-48d9-9ec4-49d8b90a6bba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:19.278985 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-0d678939-c68f-48d9-9ec4-49d8b90a6bba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:19.310570 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d678939-c68f-48d9-9ec4-49d8b90a6bba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:19.312372 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d678939-c68f-48d9-9ec4-49d8b90a6bba service placement] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:19.341625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1456/2908] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:04:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:04:22.017856 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771366ba-94d1-4130-9594-2a466b4a4388 service neutron] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:22.019939 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-771366ba-94d1-4130-9594-2a466b4a4388 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:22.033437 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771366ba-94d1-4130-9594-2a466b4a4388 service neutron] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:22.038670 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d286ce-3578-4d7f-bdf0-5350936b4e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:22.039494 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d286ce-3578-4d7f-bdf0-5350936b4e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:22.039774 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d286ce-3578-4d7f-bdf0-5350936b4e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:22.040048 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d286ce-3578-4d7f-bdf0-5350936b4e31 admin admin] PATH_INFO: `/v3/users/5c0517330b7648faac9b15b72cbce9a1` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:22.041204 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d286ce-3578-4d7f-bdf0-5350936b4e31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c0517330b7648faac9b15b72cbce9a1)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:22.043146 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d286ce-3578-4d7f-bdf0-5350936b4e31 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:22.091356 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-25d286ce-3578-4d7f-bdf0-5350936b4e31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c0517330b7648faac9b15b72cbce9a1'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:22.092037 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-25d286ce-3578-4d7f-bdf0-5350936b4e31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c0517330b7648faac9b15b72cbce9a1'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:22.092650 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-25d286ce-3578-4d7f-bdf0-5350936b4e31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c0517330b7648faac9b15b72cbce9a1'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:22.105656 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-25d286ce-3578-4d7f-bdf0-5350936b4e31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c0517330b7648faac9b15b72cbce9a1'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:22.112556 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-25d286ce-3578-4d7f-bdf0-5350936b4e31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c0517330b7648faac9b15b72cbce9a1'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:22.132578 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1453/2909] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:04:22 2022] DELETE /identity/v3/users/5c0517330b7648faac9b15b72cbce9a1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:04:22.360198 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d678939-c68f-48d9-9ec4-49d8b90a6bba service placement] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:22.375257 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d678939-c68f-48d9-9ec4-49d8b90a6bba service placement] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:22.462955 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95dfc8f-6bae-4bef-b5d2-4f08a9535434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:22.463625 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dfc8f-6bae-4bef-b5d2-4f08a9535434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:22.463909 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dfc8f-6bae-4bef-b5d2-4f08a9535434 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:22.464190 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dfc8f-6bae-4bef-b5d2-4f08a9535434 admin admin] PATH_INFO: `/v3/projects/8cfd4209326f4853b07d19ad87c711c6` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:22.465465 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95dfc8f-6bae-4bef-b5d2-4f08a9535434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cfd4209326f4853b07d19ad87c711c6)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:22.469451 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95dfc8f-6bae-4bef-b5d2-4f08a9535434 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:22.549231 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-e95dfc8f-6bae-4bef-b5d2-4f08a9535434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cfd4209326f4853b07d19ad87c711c6', 'request_id': 'req-e95dfc8f-6bae-4bef-b5d2-4f08a9535434'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:22.563861 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-e95dfc8f-6bae-4bef-b5d2-4f08a9535434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cfd4209326f4853b07d19ad87c711c6', 'request_id': 'req-e95dfc8f-6bae-4bef-b5d2-4f08a9535434'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:22.573037 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-e95dfc8f-6bae-4bef-b5d2-4f08a9535434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cfd4209326f4853b07d19ad87c711c6', 'request_id': 'req-e95dfc8f-6bae-4bef-b5d2-4f08a9535434'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:22.590618 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-e95dfc8f-6bae-4bef-b5d2-4f08a9535434 admin admin] The token cache is being invalidate because project 8cfd4209326f4853b07d19ad87c711c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:04:22.591070 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-e95dfc8f-6bae-4bef-b5d2-4f08a9535434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:22.592015 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-e95dfc8f-6bae-4bef-b5d2-4f08a9535434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:22.594426 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1457/2910] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:04:22 2022] DELETE /identity/v3/projects/8cfd4209326f4853b07d19ad87c711c6 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:04:22.794635 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d286ce-3578-4d7f-bdf0-5350936b4e31 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:22.796202 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-25d286ce-3578-4d7f-bdf0-5350936b4e31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:22.816539 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d286ce-3578-4d7f-bdf0-5350936b4e31 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:22.826903 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:22.882357 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518be80-59dc-451b-b939-525f8920518b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:22.882938 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518be80-59dc-451b-b939-525f8920518b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:22.883218 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518be80-59dc-451b-b939-525f8920518b admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:22.883490 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518be80-59dc-451b-b939-525f8920518b admin admin] PATH_INFO: `/v3/users/d5bfeb28d41243daa5726e189d0ed898` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:22.884926 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518be80-59dc-451b-b939-525f8920518b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5bfeb28d41243daa5726e189d0ed898)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:22.886880 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518be80-59dc-451b-b939-525f8920518b admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:22.932611 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-8518be80-59dc-451b-b939-525f8920518b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5bfeb28d41243daa5726e189d0ed898'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:22.933249 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-8518be80-59dc-451b-b939-525f8920518b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5bfeb28d41243daa5726e189d0ed898'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:22.933868 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-8518be80-59dc-451b-b939-525f8920518b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5bfeb28d41243daa5726e189d0ed898'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:22.946267 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-8518be80-59dc-451b-b939-525f8920518b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5bfeb28d41243daa5726e189d0ed898'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:22.953126 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-8518be80-59dc-451b-b939-525f8920518b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5bfeb28d41243daa5726e189d0ed898'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:22.966181 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1454/2911] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:04:22 2022] DELETE /identity/v3/users/d5bfeb28d41243daa5726e189d0ed898 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:04:23.139537 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95dfc8f-6bae-4bef-b5d2-4f08a9535434 admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:23.141107 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-e95dfc8f-6bae-4bef-b5d2-4f08a9535434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:23.155593 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95dfc8f-6bae-4bef-b5d2-4f08a9535434 admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:23.219199 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57740cf5-e1bc-4471-a9e9-6e10eebb6bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:23.219770 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57740cf5-e1bc-4471-a9e9-6e10eebb6bae admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:23.220051 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57740cf5-e1bc-4471-a9e9-6e10eebb6bae admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:23.220327 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57740cf5-e1bc-4471-a9e9-6e10eebb6bae admin admin] PATH_INFO: `/v3/projects/7050190e6c174c2c89f444d767eff396` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:23.221486 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57740cf5-e1bc-4471-a9e9-6e10eebb6bae admin admin] RBAC: Authorizing `identity:delete_project(project_id=7050190e6c174c2c89f444d767eff396)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:23.223426 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57740cf5-e1bc-4471-a9e9-6e10eebb6bae admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:23.229853 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:23.275708 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-57740cf5-e1bc-4471-a9e9-6e10eebb6bae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7050190e6c174c2c89f444d767eff396', 'request_id': 'req-57740cf5-e1bc-4471-a9e9-6e10eebb6bae'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:23.281973 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-57740cf5-e1bc-4471-a9e9-6e10eebb6bae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7050190e6c174c2c89f444d767eff396', 'request_id': 'req-57740cf5-e1bc-4471-a9e9-6e10eebb6bae'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:23.288213 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-57740cf5-e1bc-4471-a9e9-6e10eebb6bae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7050190e6c174c2c89f444d767eff396', 'request_id': 'req-57740cf5-e1bc-4471-a9e9-6e10eebb6bae'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:23.300766 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-57740cf5-e1bc-4471-a9e9-6e10eebb6bae admin admin] The token cache is being invalidate because project 7050190e6c174c2c89f444d767eff396 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:04:23.301049 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-57740cf5-e1bc-4471-a9e9-6e10eebb6bae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:23.301701 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-57740cf5-e1bc-4471-a9e9-6e10eebb6bae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:23.303215 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1458/2912] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:04:23 2022] DELETE /identity/v3/projects/7050190e6c174c2c89f444d767eff396 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:04:23.307874 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518be80-59dc-451b-b939-525f8920518b admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:23.309297 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-8518be80-59dc-451b-b939-525f8920518b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:23.323128 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518be80-59dc-451b-b939-525f8920518b admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:23.378879 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf5ac8-1e23-459c-bd5f-17dd29294af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:23.379519 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf5ac8-1e23-459c-bd5f-17dd29294af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:23.379814 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf5ac8-1e23-459c-bd5f-17dd29294af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:23.380091 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf5ac8-1e23-459c-bd5f-17dd29294af1 admin admin] PATH_INFO: `/v3/users/c4eca587c4674d978a4b2cc34ebb1420` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:23.381249 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf5ac8-1e23-459c-bd5f-17dd29294af1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4eca587c4674d978a4b2cc34ebb1420)` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:23.383997 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf5ac8-1e23-459c-bd5f-17dd29294af1 admin admin] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:23.420660 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:23.432064 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-00cf5ac8-1e23-459c-bd5f-17dd29294af1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4eca587c4674d978a4b2cc34ebb1420'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:23.432711 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-00cf5ac8-1e23-459c-bd5f-17dd29294af1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4eca587c4674d978a4b2cc34ebb1420'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:23.433353 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-00cf5ac8-1e23-459c-bd5f-17dd29294af1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4eca587c4674d978a4b2cc34ebb1420'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:23.445648 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-00cf5ac8-1e23-459c-bd5f-17dd29294af1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4eca587c4674d978a4b2cc34ebb1420'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:23.452597 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.notifications [None req-00cf5ac8-1e23-459c-bd5f-17dd29294af1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4eca587c4674d978a4b2cc34ebb1420'} {{(pid=91789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:23.466066 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1455/2913] 10.222.0.46 () {58 vars in 1224 bytes} [Wed Aug 3 13:04:23 2022] DELETE /identity/v3/users/c4eca587c4674d978a4b2cc34ebb1420 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 03 13:04:23.637477 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57740cf5-e1bc-4471-a9e9-6e10eebb6bae admin admin] Authenticating user token {{(pid=91788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:23.639041 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.fernet_utils [None req-57740cf5-e1bc-4471-a9e9-6e10eebb6bae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:23.652123 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57740cf5-e1bc-4471-a9e9-6e10eebb6bae admin admin] Validating token access rules against request {{(pid=91788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:23.716412 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8ac3f-bb1c-4c0b-8ec3-9e8bd8d843c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '813656e83c41478ab6f4c3340645651a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef821f4e4aa44ffbb19f8f2890cba575', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:23.717141 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8ac3f-bb1c-4c0b-8ec3-9e8bd8d843c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:23.717425 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8ac3f-bb1c-4c0b-8ec3-9e8bd8d843c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:23.718000 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8ac3f-bb1c-4c0b-8ec3-9e8bd8d843c8 admin admin] PATH_INFO: `/v3/projects/5196b0ffac644a28a273c37fe5cecb42` {{(pid=91788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:23.719347 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8ac3f-bb1c-4c0b-8ec3-9e8bd8d843c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5196b0ffac644a28a273c37fe5cecb42)` {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:23.721508 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8ac3f-bb1c-4c0b-8ec3-9e8bd8d843c8 admin admin] RBAC: Authorization granted {{(pid=91788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:23.795008 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-c0f8ac3f-bb1c-4c0b-8ec3-9e8bd8d843c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5196b0ffac644a28a273c37fe5cecb42', 'request_id': 'req-c0f8ac3f-bb1c-4c0b-8ec3-9e8bd8d843c8'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:23.802950 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-c0f8ac3f-bb1c-4c0b-8ec3-9e8bd8d843c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5196b0ffac644a28a273c37fe5cecb42', 'request_id': 'req-c0f8ac3f-bb1c-4c0b-8ec3-9e8bd8d843c8'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:23.810553 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-c0f8ac3f-bb1c-4c0b-8ec3-9e8bd8d843c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5196b0ffac644a28a273c37fe5cecb42', 'request_id': 'req-c0f8ac3f-bb1c-4c0b-8ec3-9e8bd8d843c8'} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:23.830608 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-c0f8ac3f-bb1c-4c0b-8ec3-9e8bd8d843c8 admin admin] The token cache is being invalidate because project 5196b0ffac644a28a273c37fe5cecb42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 03 13:04:23.831078 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-c0f8ac3f-bb1c-4c0b-8ec3-9e8bd8d843c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:23.831926 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG keystone.notifications [None req-c0f8ac3f-bb1c-4c0b-8ec3-9e8bd8d843c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 03 13:04:23.834224 dv-cinder-850836-4-smb devstack@keystone.service[91788]: [pid: 91788|app: 0|req: 1459/2914] 10.222.0.46 () {58 vars in 1233 bytes} [Wed Aug 3 13:04:23 2022] DELETE /identity/v3/projects/5196b0ffac644a28a273c37fe5cecb42 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 03 13:04:33.462631 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=16,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:33.825801 dv-cinder-850836-4-smb devstack@keystone.service[91788]: DEBUG dbcounter [-] [91788] Writing DB stats keystone:SELECT=73,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 13:04:44.683783 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf5ac8-1e23-459c-bd5f-17dd29294af1 admin admin] Authenticating user token {{(pid=91789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 03 13:04:44.685188 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-00cf5ac8-1e23-459c-bd5f-17dd29294af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:44.753132 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf5ac8-1e23-459c-bd5f-17dd29294af1 admin admin] Validating token access rules against request {{(pid=91789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 03 13:04:44.811736 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f6a41-dd5b-443a-866f-dfa578e738a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a56847173abb48d39c0ee6fb9cdbbbaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ac833dfff634496816842c851545d21', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 03 13:04:44.812346 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f6a41-dd5b-443a-866f-dfa578e738a4 service placement] REQUEST_METHOD: `GET` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 03 13:04:44.812628 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f6a41-dd5b-443a-866f-dfa578e738a4 service placement] SCRIPT_NAME: `/identity` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 03 13:04:44.812901 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f6a41-dd5b-443a-866f-dfa578e738a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 03 13:04:44.814716 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.fernet_utils [None req-084f6a41-dd5b-443a-866f-dfa578e738a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 03 13:04:44.826833 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f6a41-dd5b-443a-866f-dfa578e738a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 03 13:04:44.828411 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f6a41-dd5b-443a-866f-dfa578e738a4 service placement] RBAC: Authorization granted {{(pid=91789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 03 13:04:44.838875 dv-cinder-850836-4-smb devstack@keystone.service[91789]: [pid: 91789|app: 0|req: 1456/2915] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Aug 3 13:04:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 03 13:04:54.833963 dv-cinder-850836-4-smb devstack@keystone.service[91789]: DEBUG dbcounter [-] [91789] Writing DB stats keystone:SELECT=58 {{(pid=91789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}